Gemini 3.5 Flash Lite vs Gemma 4 31B
Same documents, same prompt: where each model is right, what it really costs and how fast it answers.
At a glance
| Task · documents | English (US) | Czech | German | Spanish | French |
|---|---|---|---|---|---|
| Invoice extraction | 99.2% / 97.6% | 99.5% / 96.1% | 100.0% / 94.9% | 98.2% / 95.4% | 98.7% / 93.6% |
| Email triage | 96.3% / 96.5% | 95.8% / 97.1% | 94.7% / 95.1% | — | — |
| Personal data detection | 99.5% / 99.9% | 98.1% / 99.8% | 99.6% / 99.9% | — | — |
| Contract clauses | 100.0% / 99.6% | 99.9% / 100.0% | 98.0% / 94.4% | — | — |
Correct fields: Gemini 3.5 Flash Lite / Gemma 4 31B; the better one in bold. Click a cell to see the details.
Invoice extraction · English (US) (150 documents)
Gemini 3.5 Flash Lite is more accurate by 1.6 pp. Gemma 4 31B is 5.2× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.2% | 97.6% |
| Error-free documents | 92% | 81% |
| Per 1,000 documents | $0.87 | $0.17 |
| To fix / 1,000 | 80 | 187 |
| Speed (median) | 1.7 sec | 8.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Supplier | 100.0% | 99.3% |
| Supplier ID (EIN, IČO…) | 100.0% | 98.0% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 96.7% | 99.3% |
| Invoice date | 97.3% | 98.7% |
| Due date | 99.3% | 98.7% |
| Net by tax rate | 98.0% | 95.3% |
| Tax by rate | 100.0% | 98.7% |
| Total | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Bank account | 100.0% | 86.0% |
Documents where they differ
- Harmon Logistics LLC · INV256017 · Scan · Gemini 3.5 Flash Lite 11/11, Gemma 4 31B 8/11
- Austin Landscaping Inc. · INV-17836 · Scan · Gemini 3.5 Flash Lite 11/11, Gemma 4 31B 9/11
- Gomez & Sons, LLC · 7855 · Scan · Gemini 3.5 Flash Lite 11/11, Gemma 4 31B 9/11
- Atlanta Office Products LLC · A-001328 · PDF text · Gemini 3.5 Flash Lite 9/11, Gemma 4 31B 11/11
- Summit Services Inc. · INV-15230 · Scan · Gemini 3.5 Flash Lite 11/11, Gemma 4 31B 10/11
- Jennifer Moore · 5113 · Scan · Gemini 3.5 Flash Lite 11/11, Gemma 4 31B 10/11
- Mason-Nelson Group LLC · 2025-3952 · Photo · Gemini 3.5 Flash Lite 11/11, Gemma 4 31B 10/11
- Sarah Villanueva · 2025-7876 · Clean image · Gemini 3.5 Flash Lite 11/11, Gemma 4 31B 10/11
Invoice extraction · Czech (150 documents)
Gemini 3.5 Flash Lite is more accurate by 3.4 pp. Gemma 4 31B is 4.9× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.5% | 96.1% |
| Error-free documents | 93% | 67% |
| Per 1,000 documents | $1.03 | $0.21 |
| To fix / 1,000 | 67 | 333 |
| Speed (median) | 1.8 sec | 10.4 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Supplier | 100.0% | 96.7% |
| Supplier ID (EIN, IČO…) | 100.0% | 93.3% |
| VAT ID | 100.0% | 96.7% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 95.3% | 96.0% |
| Invoice date | 100.0% | 96.0% |
| Tax point | 100.0% | 95.3% |
| Due date | 100.0% | 94.0% |
| Net by tax rate | 100.0% | 98.0% |
| Tax by rate | 100.0% | 97.3% |
| Total | 100.0% | 99.3% |
| Currency | 98.7% | 100.0% |
| Bank account | 99.3% | 86.7% |
Documents where they differ
- Jiřina Švecová · 25401227 · Clean image · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 11/13
- Bednář spol. s r.o. · 20250610 · Clean image · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 11/13
- Stejskal, v.o.s. · FV2600175 · Photo · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 11/13
- Ekolog s.r.o. · FV2600132 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 11/13
- Sedláček s.r.o. · 2025/0774 · Scan · Gemini 3.5 Flash Lite 12/13, Gemma 4 31B 13/13
- Pavlík a Zeman s.r.o. · 25500457 · Clean image · Gemini 3.5 Flash Lite 12/13, Gemma 4 31B 13/13
- Hruška a Šťastný s.r.o. · 2025/0324 · Clean image · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 12/13
- Moravská energetická spol. s r.o. · 25101373 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 12/13
Invoice extraction · German (150 documents)
Gemini 3.5 Flash Lite is more accurate by 5.1 pp. Gemma 4 31B is 5.2× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.0% | 94.9% |
| Error-free documents | 100% | 64% |
| Per 1,000 documents | $1.03 | $0.20 |
| To fix / 1,000 | 0 | 360 |
| Speed (median) | 1.5 sec | 7.7 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Supplier | 100.0% | 98.7% |
| Supplier ID (EIN, IČO…) | 100.0% | 99.3% |
| VAT ID | 100.0% | 94.0% |
| Invoice number | 100.0% | 99.3% |
| Payment reference | 100.0% | 98.7% |
| Invoice date | 100.0% | 87.3% |
| Tax point | 100.0% | 92.0% |
| Due date | 100.0% | 90.7% |
| Net by tax rate | 100.0% | 94.7% |
| Tax by rate | 100.0% | 97.3% |
| Total | 100.0% | 99.3% |
| Currency | 100.0% | 99.3% |
| Bank account | 100.0% | 82.7% |
Documents where they differ
- Spedition Müller GmbH · 2026-1446 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 8/13
- Wesermetall GmbH · RE2501375 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 9/13
- Zimmermann & Schulz GmbH · RE11274 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 10/13
- Dachdeckerei Fischer GmbH · 2025/0014 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 10/13
- Schmidt & Bauer GmbH & Co. KG · RE-2025-01397 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 10/13
- Richter GmbH & Co. KG · 2025-0509 · Clean image · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 11/13
- Nordtec GmbH & Co. KG · RE-2025-00909 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 11/13
- Berger UG (haftungsbeschränkt) · GS10609 · Clean image · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 11/13
Invoice extraction · Spanish (100 documents)
Gemini 3.5 Flash Lite is more accurate by 2.8 pp. Gemma 4 31B is 5.1× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 98.2% | 95.4% |
| Error-free documents | 79% | 54% |
| Per 1,000 documents | $1.05 | $0.20 |
| To fix / 1,000 | 210 | 460 |
| Speed (median) | 1.6 sec | 8.7 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Supplier | 98.0% | 95.4% |
| Supplier ID (EIN, IČO…) | 100.0% | 93.1% |
| VAT ID | 83.0% | 98.9% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 99.0% | 95.4% |
| Invoice date | 99.0% | 98.9% |
| Tax point | 98.0% | 100.0% |
| Due date | 100.0% | 97.7% |
| Net by tax rate | 100.0% | 81.6% |
| Tax by rate | 100.0% | 100.0% |
| Total | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Bank account | 100.0% | 79.3% |
Documents where they differ
- Coloma Servicios Informáticos S.L.U. · PRO-2025-0066 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 11/13
- Talavera y Aller Asociados, S.L. · 2025/0610 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 11/13
- Distribuciones Mayo Santana, S.L.U. · A-2025-0563 · Clean image · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 11/13
- Construcciones del Norte S.L.U. · PF25/0020 · Clean image · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 12/13
- Climatización Levante S.L. · F2025-1305 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 12/13
- Polo Soluciones Digitales S.A. · 2025/1068 · Scan · Gemini 3.5 Flash Lite 12/13, Gemma 4 31B 13/13
- Centro de Formación del Sur S.L.U. · F2025-1424 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 12/13
- Carpintería Montenegro Juárez, S.L.U. · F2025-1314 · PDF text · Gemini 3.5 Flash Lite 12/13, Gemma 4 31B 13/13
Invoice extraction · French (100 documents)
Gemini 3.5 Flash Lite is more accurate by 5.1 pp. Gemma 4 31B is 4.8× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 98.7% | 93.6% |
| Error-free documents | 85% | 51% |
| Per 1,000 documents | $1.07 | $0.22 |
| To fix / 1,000 | 150 | 494 |
| Speed (median) | 1.5 sec | 7.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Supplier | 98.0% | 96.6% |
| Supplier ID (EIN, IČO…) | 100.0% | 77.0% |
| VAT ID | 100.0% | 95.4% |
| Invoice number | 99.0% | 97.7% |
| Payment reference | 91.0% | 96.6% |
| Invoice date | 98.0% | 96.6% |
| Tax point | 98.0% | 94.3% |
| Due date | 100.0% | 96.6% |
| Net by tax rate | 100.0% | 93.1% |
| Tax by rate | 100.0% | 100.0% |
| Total | 100.0% | 100.0% |
| Currency | 100.0% | 98.9% |
| Bank account | 99.0% | 73.6% |
Documents where they differ
- Lefèvre & Fils SARL · FAC-2026-00198 · Photo · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 8/13
- Guérin & Fils EURL · 2026-05-688 · Clean image · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 10/13
- SA Établissements Gauthier · F2025-1451 · Photo · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 10/13
- Nettoyage Christine Rivière EI · 2025-12-1174 · Clean image · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 11/13
- Établissements Bonnet EURL · AV-10599 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 11/13
- Bernard et Associés SASU · FAC-2025-01115 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 11/13
- Établissements Michel SA · FAC25100622 · Clean image · Gemini 3.5 Flash Lite 12/13, Gemma 4 31B 13/13
- Carrosserie Gauthier SASU · F-11079 · Scan · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 12/13
Email triage · English (US) (150 documents)
Gemma 4 31B is more accurate by 0.2 pp. Gemma 4 31B is 3.5× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 96.3% | 96.5% |
| Error-free documents | 69% | 72% |
| Per 1,000 documents | $0.42 | $0.12 |
| To fix / 1,000 | 313 | 280 |
| Speed (median) | 0.7 sec | 2.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 84.0% | 85.3% |
| Sentiment | 82.7% | 83.3% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Daniel Stewart · Email · Gemini 3.5 Flash Lite 9/9, Gemma 4 31B 7/9
- Allison Floyd · Email · Gemini 3.5 Flash Lite 9/9, Gemma 4 31B 7/9
- Robert Lewis · Email · Gemini 3.5 Flash Lite 7/9, Gemma 4 31B 9/9
- Luke Sims · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 9/9
- Russell Bates · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 9/9
- Jane Rubio · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 9/9
- Gene Everett · Email · Gemini 3.5 Flash Lite 9/9, Gemma 4 31B 8/9
- Jason Davis · Email · Gemini 3.5 Flash Lite 9/9, Gemma 4 31B 8/9
Email triage · Czech (150 documents)
Gemma 4 31B is more accurate by 1.3 pp. Gemma 4 31B is 3.2× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 95.8% | 97.1% |
| Error-free documents | 64% | 75% |
| Per 1,000 documents | $0.51 | $0.16 |
| To fix / 1,000 | 360 | 253 |
| Speed (median) | 0.7 sec | 2.5 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 80.0% | 85.3% |
| Sentiment | 84.0% | 88.7% |
| Customer name | 98.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Alois Sedlák · Email · Gemini 3.5 Flash Lite 9/9, Gemma 4 31B 8/9
- Blanka Kučerová · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 9/9
- Simona Kolářová · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 9/9
- Natálie Kratochvílová · Email · Gemini 3.5 Flash Lite 9/9, Gemma 4 31B 8/9
- Andrea Dostálová · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 9/9
- Adam Vaněk · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 9/9
- Václav Vítek · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 9/9
- Dominika Šťastná · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 9/9
Email triage · German (150 documents)
Gemma 4 31B is more accurate by 0.4 pp. Gemma 4 31B is 3.2× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 94.7% | 95.1% |
| Error-free documents | 57% | 62% |
| Per 1,000 documents | $0.48 | $0.15 |
| To fix / 1,000 | 433 | 380 |
| Speed (median) | 0.8 sec | 3.6 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 76.0% | 78.0% |
| Sentiment | 76.7% | 78.0% |
| Customer name | 99.3% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Swantje Noack · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 9/9
- Alexej Sauer · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 7/9
- Raymund Weiß · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 9/9
- Benedikt Speer · Email · Gemini 3.5 Flash Lite 9/9, Gemma 4 31B 8/9
- Roselinde Heinz · Email · Gemini 3.5 Flash Lite 9/9, Gemma 4 31B 8/9
- Linda Bähr · Email · Gemini 3.5 Flash Lite 9/9, Gemma 4 31B 8/9
- Sibille Lehmann · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 9/9
- Helen Noack · Email · Gemini 3.5 Flash Lite 8/9, Gemma 4 31B 9/9
Personal data detection · English (US) (150 documents)
Gemma 4 31B is more accurate by 0.4 pp. Gemma 4 31B is 4.8× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.5% | 99.9% |
| Error-free documents | 97% | 99% |
| Per 1,000 documents | $0.41 | $0.08 |
| To fix / 1,000 | 27 | 7 |
| Speed (median) | 0.8 sec | 2.4 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Names | 100.0% | 100.0% |
| Email addresses | 99.3% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 98.7% | 99.3% |
| Dates of birth | 98.7% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
- Matthew Ramirez · Text · Gemini 3.5 Flash Lite 6/7, Gemma 4 31B 7/7
Personal data detection · Czech (150 documents)
Gemma 4 31B is more accurate by 1.7 pp. Gemma 4 31B is 3.8× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 98.1% | 99.8% |
| Error-free documents | 88% | 99% |
| Per 1,000 documents | $0.45 | $0.12 |
| To fix / 1,000 | 120 | 13 |
| Speed (median) | 0.8 sec | 2.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Names | 91.3% | 100.0% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 99.3% | 98.7% |
| Dates of birth | 96.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
- Růžena Tichá · Text · Gemini 3.5 Flash Lite 6/7, Gemma 4 31B 7/7
- Květa Kučerová · Text · Gemini 3.5 Flash Lite 6/7, Gemma 4 31B 7/7
- Artur Musil · Text · Gemini 3.5 Flash Lite 6/7, Gemma 4 31B 7/7
- Rudolf Konečný · Text · Gemini 3.5 Flash Lite 6/7, Gemma 4 31B 7/7
- Jindřiška Bartošová · Text · Gemini 3.5 Flash Lite 6/7, Gemma 4 31B 7/7
- Zikmund Sedláček · Text · Gemini 3.5 Flash Lite 6/7, Gemma 4 31B 7/7
Personal data detection · German (150 documents)
Gemma 4 31B is more accurate by 0.3 pp. Gemma 4 31B is 4.5× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.6% | 99.9% |
| Error-free documents | 97% | 99% |
| Per 1,000 documents | $0.45 | $0.10 |
| To fix / 1,000 | 27 | 7 |
| Speed (median) | 0.8 sec | 1.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Names | 97.3% | 100.0% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 100.0% | 99.3% |
| Dates of birth | 100.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
- Rosi Karz · Text · Gemini 3.5 Flash Lite 6/7, Gemma 4 31B 7/7
- Gunnar Zorbach · Text · Gemini 3.5 Flash Lite 7/7, Gemma 4 31B 6/7
- Fritz Rogner · Text · Gemini 3.5 Flash Lite 6/7, Gemma 4 31B 7/7
Contract clauses · English (US) (150 documents)
Gemini 3.5 Flash Lite is more accurate by 0.3 pp. Gemma 4 31B is 3.8× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 100.0% | 99.6% |
| Error-free documents | 99% | 97% |
| Per 1,000 documents | $0.69 | $0.18 |
| To fix / 1,000 | 7 | 27 |
| Speed (median) | 1.0 sec | 2.5 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Provider | 100.0% | 98.0% |
| Provider ID | 100.0% | 100.0% |
| Client | 100.0% | 98.0% |
| Client ID | 100.0% | 100.0% |
| Contract type | 99.3% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 99.3% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
Both models got the same number of fields right on every example document.
Contract clauses · Czech (150 documents)
Gemma 4 31B is more accurate by 0.1 pp. Gemma 4 31B is 3.4× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 99.9% | 100.0% |
| Error-free documents | 98% | 99% |
| Per 1,000 documents | $0.85 | $0.25 |
| To fix / 1,000 | 20 | 7 |
| Speed (median) | 0.9 sec | 6.0 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Provider | 99.3% | 100.0% |
| Provider ID | 100.0% | 100.0% |
| Client | 99.3% | 100.0% |
| Client ID | 100.0% | 100.0% |
| Contract type | 99.3% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 99.3% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Elektrotrade s.r.o. · Konečný a Dostál spol. s r.o. · Contract text · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 12/13
- Elektro Vaněk spol. s r.o. · Fišer a.s. · Contract text · Gemini 3.5 Flash Lite 12/13, Gemma 4 31B 13/13
- Autoservis Tesař spol. s r.o. · Tiskárna Beránek s.r.o. · Contract text · Gemini 3.5 Flash Lite 12/13, Gemma 4 31B 13/13
Contract clauses · German (150 documents)
Gemini 3.5 Flash Lite is more accurate by 3.6 pp. Gemma 4 31B is 3.6× cheaper.
| Metric | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Correct fields | 98.0% | 94.4% |
| Error-free documents | 84% | 27% |
| Per 1,000 documents | $0.79 | $0.22 |
| To fix / 1,000 | 160 | 727 |
| Speed (median) | 1.0 sec | 2.6 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemini 3.5 Flash Lite | Gemma 4 31B |
|---|---|---|
| Provider | 100.0% | 100.0% |
| Provider ID | 86.0% | 100.0% |
| Client | 100.0% | 100.0% |
| Client ID | 88.7% | 100.0% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 100.0% |
| End date | 99.3% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 27.3% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Hahn GmbH · Bauer & Klein GmbH · Contract text · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 12/13
- Wesermetall e.K. · Weserform GmbH · Contract text · Gemini 3.5 Flash Lite 11/13, Gemma 4 31B 12/13
- Haustechnik Braun UG (haftungsbeschränkt) · Nordbau GmbH · Contract text · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 12/13
- Hansawerk GmbH · Schreinerei Weber AG · Contract text · Gemini 3.5 Flash Lite 11/13, Gemma 4 31B 12/13
- Maintec GmbH · Schreinerei Wagner GmbH · Contract text · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 12/13
- Winkler & Beck e.K. · Meyer & Weber e.K. · Contract text · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 12/13
- Kraus Consulting GmbH · Lange Consulting GmbH & Co. KG · Contract text · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 12/13
- Hansametall GmbH & Co. KG · Roth & Schröder UG (haftungsbeschränkt) · Contract text · Gemini 3.5 Flash Lite 13/13, Gemma 4 31B 12/13