ModelVerdict

Onofre Diez Guitart · R-2025/1100

SpanishClean image13 fields

Document es-p0027 · layout es-L03 · 13 fields · public part of the dataset · Same invoice in English (US) → · Report an error in this example

Onofre Diez Guitart · R-2025/1100

Verdict

Cheapest without an error: Gemma 4 31B at $0.20 per 1,000 documents.

  • GPT-6 Sol is also error-free but 82.8× more expensive.

Prompt given to every model

Extraiga del documento adjunto los siguientes datos y devuelva exclusivamente un JSON con estas claves:

supplier_name      Nombre o razón social del emisor de la factura (exactamente como figura en el documento, incluidos acentos y forma jurídica)
supplier_id        NIF del emisor (en empresas también llamado CIF, p. ej. B12345674; en autónomos, DNI con letra), sin el prefijo de país «ES»
vat_id             NIF-IVA (número de IVA intracomunitario, «ES» + NIF) del emisor, solo si figura como tal en el documento
invoice_number     Número de factura (o del documento)
payment_reference  Concepto o referencia que debe indicarse al realizar el pago
issue_date         Fecha de expedición de la factura (YYYY-MM-DD)
tax_point_date     Fecha de operación (fecha de devengo del IVA) (YYYY-MM-DD)
due_date           Fecha de vencimiento (YYYY-MM-DD)
net_by_rate        Base imponible por tipo de IVA, p. ej. {"21": 18450.00, "10": 1200.00}
vat_by_rate        Cuota de IVA por tipo, p. ej. {"21": 3874.50}
total              Importe total de la factura / importe a pagar (número, negativo en facturas rectificativas que abonan un importe)
currency           Moneda según ISO 4217 (EUR, USD, …)
bank_account       IBAN del emisor

Reglas:
- No devuelva datos del cliente (destinatario), solo los del emisor.
- Si un dato no figura en el documento, devuelva null. No invente nada.
- Si el documento no contiene desglose del IVA (operación exenta, factura proforma), devuelva net_by_rate y vat_by_rate como null.
- Importes como números con punto decimal, sin separadores de miles y sin moneda.

How we score

Exact match per field after normalising dates, amounts and whitespace. Missing diacritics count as an error. Cost is the real token spend of this run, converted at the rate shown in the footer.

What each model extracted

FieldCorrect valueGemma 4 31B13 / 13 fieldsMistral Small 413 / 13 fieldsDeepSeek V4.1 Flash12 / 13 fieldsGPT-6 Luna13 / 13 fieldsGemini 3.5 Flash Lite13 / 13 fieldsQwen3.8 Flash13 / 13 fieldsMistral Medium 3.513 / 13 fieldsGemini 3.8 Flash13 / 13 fieldsClaude Sonnet 513 / 13 fieldsGPT-6 Sol13 / 13 fields
SupplierOnofre Diez GuitartOnofre Diez Guitart (correct)Onofre Diez Guitart (correct) Onofre Díez Guitartlost diacriticsOnofre Diez Guitart (correct)Onofre Diez Guitart (correct)Onofre Diez Guitart (correct)Onofre Diez Guitart (correct)Onofre Diez Guitart (correct)Onofre Diez Guitart (correct)Onofre Diez Guitart (correct)
Supplier ID (EIN, IČO…)52977256E52977256E (correct)52977256E (correct)52977256E (correct)52977256-E (correct)52977256-E (correct)52977256-E (correct)52977256E (correct)52977256-E (correct)52977256-E (correct)52977256E (correct)
VAT IDES52977256EES 52977256E (correct)ES52977256E (correct)ES52977256E (correct)ES52977256E (correct)ES 52977256E (correct)ES 52977256E (correct)ES52977256E (correct)ES 52977256E (correct)ES52977256E (correct)ES52977256E (correct)
Invoice numberR-2025/1100R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)
Payment referenceR-2025/1100R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)R-2025/1100 (correct)
Invoice date2025-04-152025-04-15 (correct)2025-04-15 (correct)2025-04-15 (correct)2025-04-15 (correct)2025-04-15 (correct)2025-04-15 (correct)2025-04-15 (correct)2025-04-15 (correct)2025-04-15 (correct)2025-04-15 (correct)
Tax point2025-04-102025-04-10 (correct)2025-04-10 (correct)2025-04-10 (correct)2025-04-10 (correct)2025-04-10 (correct)2025-04-10 (correct)2025-04-10 (correct)2025-04-10 (correct)2025-04-10 (correct)2025-04-10 (correct)
Due date2025-04-222025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)2025-04-22 (correct)
Net by tax rate10 %: -168.00, 21 %: -247.2410 %: -168.00, 21 %: -247.24 (correct)10 %: -168.00, 21 %: -247.24 (correct)10 %: -168.00, 21 %: -247.24 (correct)10 %: -168.00, 21 %: -247.24 (correct)10 %: -168.00, 21 %: -247.24 (correct)10 %: -168.00, 21 %: -247.24 (correct)10 %: -168.00, 21 %: -247.24 (correct)10 %: -168.00, 21 %: -247.24 (correct)10 %: -168.00, 21 %: -247.24 (correct)10 %: -168.00, 21 %: -247.24 (correct)
Tax by rate10 %: -16.80, 21 %: -51.9210 %: -16.80, 21 %: -51.92 (correct)10 %: -16.80, 21 %: -51.92 (correct)10 %: -16.80, 21 %: -51.92 (correct)10 %: -16.80, 21 %: -51.92 (correct)10 %: -16.80, 21 %: -51.92 (correct)10 %: -16.80, 21 %: -51.92 (correct)10 %: -16.80, 21 %: -51.92 (correct)10 %: -16.80, 21 %: -51.92 (correct)10 %: -16.80, 21 %: -51.92 (correct)10 %: -16.80, 21 %: -51.92 (correct)
Total-483.96-483.96 (correct)-483.96 (correct)-483.96 (correct)-483.96 (correct)-483.96 (correct)-483.96 (correct)-483.96 (correct)-483.96 (correct)-483.96 (correct)-483.96 (correct)
CurrencyEUREUR (correct)EUR (correct)EUR (correct)EUR (correct)EUR (correct)EUR (correct)EUR (correct)EUR (correct)EUR (correct)EUR (correct)
Bank accountES9530583409536568711960ES95 3058 3409 5365 6871 1960 (correct)ES9530583409536568711960 (correct)ES9530583409536568711960 (correct)ES9530583409536568711960 (correct)ES95 3058 3409 5365 6871 1960 (correct)ES95 3058 3409 5365 6871 1960 (correct)ES9530583409536568711960 (correct)ES95 3058 3409 5365 6871 1960 (correct)ES95 3058 3409 5365 6871 1960 (correct)ES9530583409536568711960 (correct)
Tokensinput / output743 / 2512,649 / 2311,795 / 5825,193 / 3661,555 / 2943,326 / 3,4452,649 / 2291,555 / 1,4105,420 / 2655,193 / 395
of which hidden reasoningbilled as output0038721303,16301,1870242
of which from cacheinput billed at a discount4660664006400000
Cost of this documentthis run$0.0002$0.0005$0.0006$0.0008$0.0012$0.0020$0.0057$0.0065$0.0135$0.0169
Per 1,000 documentsfor the same kind of document$0.20$0.54$0.64$0.83$1.20$2.03$5.69$6.45$13.49$16.93
Latencythis run9.4 s2.1 s7.6 s4.8 s1.6 s41.4 s2.4 s6 s4.2 s8.5 s