Lutz & Sons, Inc. · A-008230

Verdict
Le moins cher sans erreur : Gemma 4 31B, à 0,16 € pour 1 000 documents.
- GPT-6 Sol ne fait aucune erreur non plus, mais coûte 78,6× plus cher.
Prompt soumis à chaque modèle
Extract the following data from the attached document and return only JSON with these keys:
supplier_name supplier's name (exactly as printed, including the legal form)
supplier_id supplier's tax ID (EIN), if printed
invoice_number document number
payment_reference payment reference to quote with the payment
issue_date invoice date (YYYY-MM-DD)
due_date due date (YYYY-MM-DD)
net_by_rate amount per sales tax rate, e.g. {"8.25": 1845.00}; non-taxable amounts under "0"
vat_by_rate sales tax per rate, e.g. {"8.25": 152.21}
total total due (number, negative for credit notes)
currency ISO 4217 currency code (USD, GBP, EUR, …)
bank_account supplier's bank details as "routing-number account-number", or IBAN
Rules:
- Return the supplier's data only, never the customer's.
- If a value is not on the document, return null. Do not guess.
- If the document has no tax breakdown, return net_by_rate and vat_by_rate as null.
- Amounts as numbers with a decimal point, no thousands separators and no currency symbol.
Notre notation
Correspondance exacte par champ, après normalisation des dates, des montants et des espaces. Les diacritiques manquants comptent comme une erreur. Le coût correspond à la consommation réelle de tokens de cette exécution, convertie au taux indiqué en bas de page.
Ce que chaque modèle a extrait
| Champ | Valeur correcte | Gemma 4 31B11 / 11 champs | DeepSeek V4.1 Flash11 / 11 champs | Mistral Small 410 / 11 champs | GPT-6 Luna11 / 11 champs | Gemini 3.5 Flash Lite11 / 11 champs | Qwen3.8 Flash11 / 11 champs | Gemini 3.8 Flash11 / 11 champs | Mistral Medium 3.511 / 11 champs | Claude Sonnet 511 / 11 champs | GPT-6 Sol11 / 11 champs |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Fournisseur | Lutz & Sons, Inc. | Lutz & Sons, Inc. (correct) | Lutz & Sons, Inc. (correct) | Lutz & Sons, Inc. (correct) | Lutz & Sons, Inc. (correct) | Lutz & Sons, Inc. (correct) | Lutz & Sons, Inc. (correct) | Lutz & Sons, Inc. (correct) | Lutz & Sons, Inc. (correct) | Lutz & Sons, Inc. (correct) | Lutz & Sons, Inc. (correct) |
| Identifiant du fournisseur (EIN, IČO…) | 85-3103421 | 85-3103421 (correct) | 85-3103421 (correct) | 85-3103421 (correct) | 85-3103421 (correct) | 85-3103421 (correct) | 85-3103421 (correct) | 85-3103421 (correct) | 85-3103421 (correct) | 85-3103421 (correct) | 85-3103421 (correct) |
| Numéro de facture | A-008230 | A-008230 (correct) | A-008230 (correct) | A-008230 (correct) | A-008230 (correct) | A-008230 (correct) | A-008230 (correct) | A-008230 (correct) | A-008230 (correct) | A-008230 (correct) | A-008230 (correct) |
| Référence de paiement | CUST-73475 | CUST-73475 (correct) | CUST-73475 (correct) | CUST-73475 (correct) | CUST-73475 (correct) | CUST-73475 (correct) | CUST-73475 (correct) | CUST-73475 (correct) | CUST-73475 (correct) | CUST-73475 (correct) | CUST-73475 (correct) |
| Date de facture | 2026-05-13 | 2026-05-13 (correct) | 2026-05-13 (correct) | 2026-05-13 (correct) | 2026-05-13 (correct) | 2026-05-13 (correct) | 2026-05-13 (correct) | 2026-05-13 (correct) | 2026-05-13 (correct) | 2026-05-13 (correct) | 2026-05-13 (correct) |
| Date d'échéance | 2026-07-12 | 2026-07-12 (correct) | 2026-07-12 (correct) | 2026-07-12 (correct) | 2026-07-12 (correct) | 2026-07-12 (correct) | 2026-07-12 (correct) | 2026-07-12 (correct) | 2026-07-12 (correct) | 2026-07-12 (correct) | 2026-07-12 (correct) |
| HT par taux | 8.6 %: 27182.22 | 8.6 %: 27182.22 (correct) | 8.6 %: 27182.22 (correct) | 0 %: 27182.22mauvais taux | 8.6 %: 27182.22 (correct) | 8.6 %: 27182.22 (correct) | 8.6 %: 27182.22 (correct) | 8.6 %: 27182.22 (correct) | 0 %: 0.00, 8.6 %: 27182.22 (correct) | 8.6 %: 27182.22 (correct) | 8.6 %: 27182.22 (correct) |
| Taxe par taux | 8.6 %: 2337.67 | 8.6 %: 2337.67 (correct) | 8.6 %: 2337.67 (correct) | 8.6 %: 2337.67 (correct) | 8.6 %: 2337.67 (correct) | 8.6 %: 2337.67 (correct) | 8.6 %: 2337.67 (correct) | 8.6 %: 2337.67 (correct) | 8.6 %: 2337.67 (correct) | 8.6 %: 2337.67 (correct) | 8.6 %: 2337.67 (correct) |
| Total | 29519.89 | 29519.89 (correct) | 29519.89 (correct) | 29519.89 (correct) | 29519.89 (correct) | 29519.89 (correct) | 29519.89 (correct) | 29519.89 (correct) | 29519.89 (correct) | 29519.89 (correct) | 29519.89 (correct) |
| Devise | USD | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) | USD (correct) |
| Compte bancaire | 091000022 7789510781 | 091000022 7789510781 (correct) | 091000022 7789510781 (correct) | 091000022 7789510781 (correct) | 091000022 7789510781 (correct) | 091000022 7789510781 (correct) | 091000022 7789510781 (correct) | 091000022 7789510781 (correct) | 091000022 7789510781 (correct) | 091000022 7789510781 (correct) | 091000022 7789510781 (correct) |
| Tokens | entrée / sortie | 584 / 219 | 1 549 / 318 | 2 693 / 173 | 4 871 / 189 | 1 406 / 218 | 3 108 / 1 511 | 1 406 / 689 | 2 693 / 181 | 5 163 / 197 | 4 871 / 114 |
| dont raisonnement caché | facturé comme sortie | 0 | 184 | 0 | 73 | 0 | 1 301 | 528 | 0 | 0 | 0 |
| dont depuis le cache | entrée facturée à prix réduit | 307 | 436 | 0 | 0 | 0 | 384 | 0 | 0 | 0 | 0 |
| Coût de ce document | cette exécution | 0,0002 € | 0,0004 € | 0,0005 € | 0,0006 € | 0,0009 € | 0,0010 € | 0,0033 € | 0,0050 € | 0,0113 € | 0,0123 € |
| Pour 1 000 documents | pour ce même type de document | 0,16 € | 0,42 € | 0,47 € | 0,65 € | 0,89 € | 1,03 € | 3,35 € | 4,97 € | 11,31 € | 12,25 € |
| Latence | cette exécution | 12,2 s | 4 s | 1,9 s | 3,8 s | 2 s | 21 s | 4,3 s | 7,9 s | 3,4 s | 3,3 s |