Gemma 4 31B vs Qwen3.8 Flash
Same documents, same prompt: where each model is right, what it really costs and how fast it answers.
At a glance
| Task · documents | English (US) | Czech | German | Spanish | French |
|---|---|---|---|---|---|
| Invoice extraction | 97.6% / 82.4% | 96.1% / 91.8% | 94.9% / 93.5% | 95.4% / 87.9% | 93.6% / 90.6% |
| Email triage | 96.5% / 97.5% | 97.1% / 98.5% | 95.1% / 97.9% | — | — |
| Personal data detection | 99.9% / 99.2% | 99.8% / 97.0% | 99.9% / 99.6% | — | — |
| Contract clauses | 99.6% / 95.1% | 100.0% / 99.9% | 94.4% / 98.0% | — | — |
Correct fields: Gemma 4 31B / Qwen3.8 Flash; the better one in bold. Click a cell to see the details.
Invoice extraction · English (US) (150 documents)
Gemma 4 31B is more accurate by 15.3 pp. Gemma 4 31B is 6.9× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 97.6% | 82.4% |
| Error-free documents | 81% | 57% |
| Per 1,000 documents | $0.17 | $1.15 |
| To fix / 1,000 | 187 | 427 |
| Speed (median) | 8.9 sec | 17.4 sec |
| Valid answers | 100.0% | 90.7% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Supplier | 99.3% | 85.3% |
| Supplier ID (EIN, IČO…) | 98.0% | 88.7% |
| Invoice number | 100.0% | 85.3% |
| Payment reference | 99.3% | 79.3% |
| Invoice date | 98.7% | 85.3% |
| Due date | 98.7% | 85.3% |
| Net by tax rate | 95.3% | 70.0% |
| Tax by rate | 98.7% | 76.0% |
| Total | 100.0% | 85.3% |
| Currency | 100.0% | 84.0% |
| Bank account | 86.0% | 81.3% |
Documents where they differ
- Reid Office Products LLC · A-003849 · Scan · Gemma 4 31B 11/11, Qwen3.8 Flash 0/11
- Eagle Partners Co. · 4272 · Clean image · Gemma 4 31B 11/11, Qwen3.8 Flash 0/11
- Raleigh Engineering Inc. · INV253511 · Scan · Gemma 4 31B 11/11, Qwen3.8 Flash 1/11
- Hughes Janitorial Services Corp. · A-001911 · Scan · Gemma 4 31B 11/11, Qwen3.8 Flash 1/11
- Summit Services Inc. · INV-15230 · Scan · Gemma 4 31B 10/11, Qwen3.8 Flash 2/11
- Miranda-Vega Group LLC · 4959 · PDF text · Gemma 4 31B 11/11, Qwen3.8 Flash 8/11
- Harmon Logistics LLC · INV256017 · Scan · Gemma 4 31B 8/11, Qwen3.8 Flash 11/11
- Liberty Systems Inc. · INV-17299 · PDF text · Gemma 4 31B 11/11, Qwen3.8 Flash 9/11
Invoice extraction · Czech (150 documents)
Gemma 4 31B is more accurate by 4.3 pp. Gemma 4 31B is 4.8× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 96.1% | 91.8% |
| Error-free documents | 67% | 77% |
| Per 1,000 documents | $0.21 | $1.02 |
| To fix / 1,000 | 333 | 233 |
| Speed (median) | 10.4 sec | 17.0 sec |
| Valid answers | 100.0% | 96.7% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Supplier | 96.7% | 93.3% |
| Supplier ID (EIN, IČO…) | 93.3% | 94.0% |
| VAT ID | 96.7% | 94.0% |
| Invoice number | 100.0% | 94.7% |
| Payment reference | 96.0% | 94.0% |
| Invoice date | 96.0% | 94.7% |
| Tax point | 95.3% | 94.7% |
| Due date | 94.0% | 94.7% |
| Net by tax rate | 98.0% | 80.0% |
| Tax by rate | 97.3% | 80.7% |
| Total | 99.3% | 94.0% |
| Currency | 100.0% | 94.0% |
| Bank account | 86.7% | 90.7% |
Documents where they differ
- Sedláček s.r.o. · 2025/0774 · Scan · Gemma 4 31B 13/13, Qwen3.8 Flash 0/13
- Sedlák s.r.o. · 20250158 · Photo · Gemma 4 31B 12/13, Qwen3.8 Flash 9/13
- Dvořák s.r.o. · FV2501487 · PDF text · Gemma 4 31B 13/13, Qwen3.8 Flash 11/13
- Hruška spol. s r.o. · 20250328 · PDF text · Gemma 4 31B 13/13, Qwen3.8 Flash 11/13
- Jiřina Švecová · 25401227 · Clean image · Gemma 4 31B 11/13, Qwen3.8 Flash 13/13
- Stavmet s.r.o. · 20250906 · PDF text · Gemma 4 31B 13/13, Qwen3.8 Flash 11/13
- Východočeská obchodní s.r.o. · FV2600186 · PDF text · Gemma 4 31B 13/13, Qwen3.8 Flash 11/13
- Bednář spol. s r.o. · 20250610 · Clean image · Gemma 4 31B 11/13, Qwen3.8 Flash 13/13
Invoice extraction · German (150 documents)
Gemma 4 31B is more accurate by 1.4 pp. Gemma 4 31B is 5.6× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 94.9% | 93.5% |
| Error-free documents | 64% | 87% |
| Per 1,000 documents | $0.20 | $1.12 |
| To fix / 1,000 | 360 | 127 |
| Speed (median) | 7.7 sec | 19.0 sec |
| Valid answers | 100.0% | 94.0% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Supplier | 98.7% | 94.0% |
| Supplier ID (EIN, IČO…) | 99.3% | 94.0% |
| VAT ID | 94.0% | 94.0% |
| Invoice number | 99.3% | 92.7% |
| Payment reference | 98.7% | 88.7% |
| Invoice date | 87.3% | 94.0% |
| Tax point | 92.0% | 94.0% |
| Due date | 90.7% | 94.0% |
| Net by tax rate | 94.7% | 94.0% |
| Tax by rate | 97.3% | 94.0% |
| Total | 99.3% | 94.0% |
| Currency | 99.3% | 94.0% |
| Bank account | 82.7% | 94.0% |
Documents where they differ
- Bauunternehmung Schröder GmbH · 2026-0622 · Clean image · Gemma 4 31B 13/13, Qwen3.8 Flash 0/13
- Schreinerei Ferdi Schuster · 2025/0939 · Clean image · Gemma 4 31B 13/13, Qwen3.8 Flash 0/13
- Spedition Müller GmbH · 2026-1446 · Scan · Gemma 4 31B 8/13, Qwen3.8 Flash 13/13
- Wesermetall GmbH · RE2501375 · Scan · Gemma 4 31B 9/13, Qwen3.8 Flash 13/13
- Zimmermann & Schulz GmbH · RE11274 · Scan · Gemma 4 31B 10/13, Qwen3.8 Flash 13/13
- Schmidt & Bauer GmbH & Co. KG · RE-2025-01397 · Scan · Gemma 4 31B 10/13, Qwen3.8 Flash 13/13
- Dachdeckerei Fischer GmbH · 2025/0014 · Scan · Gemma 4 31B 10/13, Qwen3.8 Flash 12/13
- Richter GmbH & Co. KG · 2025-0509 · Clean image · Gemma 4 31B 11/13, Qwen3.8 Flash 13/13
Invoice extraction · Spanish (87 documents)
Gemma 4 31B is more accurate by 7.5 pp. Gemma 4 31B is 6.8× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 95.4% | 87.9% |
| Error-free documents | 54% | 74% |
| Per 1,000 documents | $0.20 | $1.40 |
| To fix / 1,000 | 460 | 260 |
| Speed (median) | 8.7 sec | 22.3 sec |
| Valid answers | 100.0% | 90.0% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Supplier | 95.4% | 86.0% |
| Supplier ID (EIN, IČO…) | 93.1% | 89.0% |
| VAT ID | 98.9% | 86.0% |
| Invoice number | 100.0% | 89.0% |
| Payment reference | 95.4% | 85.0% |
| Invoice date | 98.9% | 89.0% |
| Tax point | 100.0% | 87.0% |
| Due date | 97.7% | 89.0% |
| Net by tax rate | 81.6% | 86.0% |
| Tax by rate | 100.0% | 90.0% |
| Total | 100.0% | 89.0% |
| Currency | 100.0% | 89.0% |
| Bank account | 79.3% | 89.0% |
Documents where they differ
- Centro de Formación Mediterránea S.L. · 2026/0876 · Scan · Gemma 4 31B 13/13, Qwen3.8 Flash 0/13
- Aguirre Formación S.L. · 2025/0652 · Clean image · Gemma 4 31B 13/13, Qwen3.8 Flash 0/13
- Centro de Formación Centro S.L.U. · A-2025-1405 · Clean image · Gemma 4 31B 12/13, Qwen3.8 Flash 0/13
- Coloma Servicios Informáticos S.L.U. · PRO-2025-0066 · Scan · Gemma 4 31B 11/13, Qwen3.8 Flash 0/13
- Talavera y Aller Asociados, S.L. · 2025/0610 · Scan · Gemma 4 31B 11/13, Qwen3.8 Flash 13/13
- Distribuciones Mayo Santana, S.L.U. · A-2025-0563 · Clean image · Gemma 4 31B 11/13, Qwen3.8 Flash 13/13
- Talleres Rozas Zapata S.L. · FV25-01486 · Clean image · Gemma 4 31B 12/13, Qwen3.8 Flash 13/13
- Climatización Levante S.L. · F2025-1305 · Scan · Gemma 4 31B 12/13, Qwen3.8 Flash 13/13
Invoice extraction · French (87 documents)
Gemma 4 31B is more accurate by 2.9 pp. Gemma 4 31B is 5.5× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 93.6% | 90.6% |
| Error-free documents | 51% | 82% |
| Per 1,000 documents | $0.22 | $1.23 |
| To fix / 1,000 | 494 | 180 |
| Speed (median) | 7.2 sec | 19.8 sec |
| Valid answers | 100.0% | 95.0% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Supplier | 96.6% | 91.0% |
| Supplier ID (EIN, IČO…) | 77.0% | 91.0% |
| VAT ID | 95.4% | 91.0% |
| Invoice number | 97.7% | 90.0% |
| Payment reference | 96.6% | 86.0% |
| Invoice date | 96.6% | 91.0% |
| Tax point | 94.3% | 92.0% |
| Due date | 96.6% | 89.0% |
| Net by tax rate | 93.1% | 91.0% |
| Tax by rate | 100.0% | 94.0% |
| Total | 100.0% | 91.0% |
| Currency | 98.9% | 91.0% |
| Bank account | 73.6% | 90.0% |
Documents where they differ
- Guérin & Fils EURL · 2026-05-688 · Clean image · Gemma 4 31B 10/13, Qwen3.8 Flash 1/13
- Lefèvre & Fils SARL · FAC-2026-00198 · Photo · Gemma 4 31B 8/13, Qwen3.8 Flash 12/13
- Nettoyage Christine Rivière EI · 2025-12-1174 · Clean image · Gemma 4 31B 11/13, Qwen3.8 Flash 13/13
- SA Établissements Gauthier · F2025-1451 · Photo · Gemma 4 31B 10/13, Qwen3.8 Flash 12/13
- Établissements Bonnet EURL · AV-10599 · Scan · Gemma 4 31B 11/13, Qwen3.8 Flash 13/13
- SARL Garcia Informatique · F2025-0111 · Clean image · Gemma 4 31B 11/13, Qwen3.8 Flash 13/13
- Bernard et Associés SASU · FAC-2025-01115 · Scan · Gemma 4 31B 11/13, Qwen3.8 Flash 13/13
- Carrosserie Gauthier SASU · F-11079 · Scan · Gemma 4 31B 12/13, Qwen3.8 Flash 13/13
Email triage · English (US) (150 documents)
Qwen3.8 Flash is more accurate by 1 pp. Gemma 4 31B is 2.5× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 96.5% | 97.5% |
| Error-free documents | 72% | 79% |
| Per 1,000 documents | $0.12 | $0.30 |
| To fix / 1,000 | 280 | 213 |
| Speed (median) | 2.2 sec | 8.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 85.3% | 97.3% |
| Sentiment | 83.3% | 80.7% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 99.3% |
Documents where they differ
- Sheila Evans · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Jane Rubio · Email · Gemma 4 31B 9/9, Qwen3.8 Flash 8/9
- Gene Everett · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Jason Davis · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Daniel Stewart · Email · Gemma 4 31B 7/9, Qwen3.8 Flash 8/9
- Allison Floyd · Email · Gemma 4 31B 7/9, Qwen3.8 Flash 8/9
- Christine Copeland · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Sandra Hogan · Email · Gemma 4 31B 9/9, Qwen3.8 Flash 8/9
Email triage · Czech (150 documents)
Qwen3.8 Flash is more accurate by 1.4 pp. Gemma 4 31B is 2.8× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 97.1% | 98.5% |
| Error-free documents | 75% | 87% |
| Per 1,000 documents | $0.16 | $0.45 |
| To fix / 1,000 | 253 | 133 |
| Speed (median) | 2.5 sec | 13.0 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 85.3% | 99.3% |
| Sentiment | 88.7% | 88.7% |
| Customer name | 100.0% | 99.3% |
| Order number | 100.0% | 99.3% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Alois Sedlák · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Lucie Kašparová · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Natálie Kratochvílová · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Šimon Beran · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Magdalena Sedláčková · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Ctibor Dušek · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Milan Matějka · Email · Gemma 4 31B 9/9, Qwen3.8 Flash 8/9
- Vanda Vacková · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
Email triage · German (150 documents)
Qwen3.8 Flash is more accurate by 2.7 pp. Gemma 4 31B is 2.6× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 95.1% | 97.9% |
| Error-free documents | 62% | 81% |
| Per 1,000 documents | $0.15 | $0.39 |
| To fix / 1,000 | 380 | 187 |
| Speed (median) | 3.6 sec | 12.1 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 78.0% | 96.0% |
| Sentiment | 78.0% | 84.7% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Alexej Sauer · Email · Gemma 4 31B 7/9, Qwen3.8 Flash 8/9
- Sylwia Gerlach · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Benedikt Speer · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Cristina Krause · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Cynthia Hahn · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Roselinde Heinz · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
- Nadja Wiek · Email · Gemma 4 31B 9/9, Qwen3.8 Flash 8/9
- Marta Kambs · Email · Gemma 4 31B 8/9, Qwen3.8 Flash 9/9
Personal data detection · English (US) (150 documents)
Gemma 4 31B is more accurate by 0.7 pp. Gemma 4 31B is 3.3× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.9% | 99.2% |
| Error-free documents | 99% | 99% |
| Per 1,000 documents | $0.08 | $0.28 |
| To fix / 1,000 | 7 | 13 |
| Speed (median) | 2.4 sec | 7.5 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Names | 100.0% | 99.3% |
| Email addresses | 100.0% | 99.3% |
| Phone numbers | 100.0% | 99.3% |
| Addresses | 99.3% | 98.7% |
| Dates of birth | 100.0% | 99.3% |
| National IDs | 100.0% | 99.3% |
| Bank accounts | 100.0% | 99.3% |
Documents where they differ
Both models got the same number of fields right on every example document.
Personal data detection · Czech (150 documents)
Gemma 4 31B is more accurate by 2.9 pp. Gemma 4 31B is 3.4× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.8% | 97.0% |
| Error-free documents | 99% | 89% |
| Per 1,000 documents | $0.12 | $0.41 |
| To fix / 1,000 | 13 | 113 |
| Speed (median) | 2.9 sec | 9.6 sec |
| Valid answers | 100.0% | 99.3% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Names | 100.0% | 90.7% |
| Email addresses | 100.0% | 98.0% |
| Phone numbers | 100.0% | 97.3% |
| Addresses | 98.7% | 96.7% |
| Dates of birth | 100.0% | 98.0% |
| National IDs | 100.0% | 99.3% |
| Bank accounts | 100.0% | 98.7% |
Documents where they differ
- Naděžda Žáková · Text · Gemma 4 31B 7/7, Qwen3.8 Flash 6/7
Personal data detection · German (150 documents)
Gemma 4 31B is more accurate by 0.3 pp. Gemma 4 31B is 3.5× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.9% | 99.6% |
| Error-free documents | 99% | 99% |
| Per 1,000 documents | $0.10 | $0.36 |
| To fix / 1,000 | 7 | 7 |
| Speed (median) | 1.9 sec | 12.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Names | 100.0% | 99.3% |
| Email addresses | 100.0% | 99.3% |
| Phone numbers | 100.0% | 99.3% |
| Addresses | 99.3% | 99.3% |
| Dates of birth | 100.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
- Gunnar Zorbach · Text · Gemma 4 31B 6/7, Qwen3.8 Flash 7/7
Contract clauses · English (US) (150 documents)
Gemma 4 31B is more accurate by 4.5 pp. Gemma 4 31B is 3.4× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.6% | 95.1% |
| Error-free documents | 97% | 69% |
| Per 1,000 documents | $0.18 | $0.62 |
| To fix / 1,000 | 27 | 307 |
| Speed (median) | 2.5 sec | 14.1 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Provider | 98.0% | 69.3% |
| Provider ID | 100.0% | 100.0% |
| Client | 98.0% | 69.3% |
| Client ID | 100.0% | 100.0% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 99.3% | 99.3% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 99.3% |
| Governing law | 100.0% | 99.3% |
Documents where they differ
- Page Printing LLC · Raleigh Printing Inc. · Contract text · Gemma 4 31B 13/13, Qwen3.8 Flash 9/13
- Santiago-Harris Group Co. · Columbus Printing Inc. · Contract text · Gemma 4 31B 13/13, Qwen3.8 Flash 11/13
- Pittsburgh Construction Co. · Evans Electric LLC · Contract text · Gemma 4 31B 13/13, Qwen3.8 Flash 11/13
- Frye & Sons, Co. · Nunez-Smith Group Inc. · Contract text · Gemma 4 31B 13/13, Qwen3.8 Flash 11/13
- Kim Electric Co. · Ramos & Sons, Co. · Contract text · Gemma 4 31B 13/13, Qwen3.8 Flash 11/13
- Blue Ridge Services Corp. · Bishop-Kim Group LLC · Contract text · Gemma 4 31B 13/13, Qwen3.8 Flash 11/13
- White Landscaping Co. · Douglas-Ali Group LLC · Contract text · Gemma 4 31B 13/13, Qwen3.8 Flash 11/13
- Rose & Sons, Inc. · Eagle Systems Inc. · Contract text · Gemma 4 31B 13/13, Qwen3.8 Flash 11/13
Contract clauses · Czech (150 documents)
Gemma 4 31B is more accurate by 0.1 pp. Gemma 4 31B is 2.5× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 100.0% | 99.9% |
| Error-free documents | 99% | 99% |
| Per 1,000 documents | $0.25 | $0.63 |
| To fix / 1,000 | 7 | 13 |
| Speed (median) | 6.0 sec | 13.6 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Provider | 100.0% | 100.0% |
| Provider ID | 100.0% | 100.0% |
| Client | 100.0% | 100.0% |
| Client ID | 100.0% | 100.0% |
| Contract type | 100.0% | 98.7% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 99.3% | 100.0% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Elektrotrade s.r.o. · Konečný a Dostál spol. s r.o. · Contract text · Gemma 4 31B 12/13, Qwen3.8 Flash 13/13
- Interservis s.r.o. · Staněk s.r.o. · Contract text · Gemma 4 31B 13/13, Qwen3.8 Flash 12/13
Contract clauses · German (150 documents)
Qwen3.8 Flash is more accurate by 3.6 pp. Gemma 4 31B is 3.5× cheaper.
| Metric | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 94.4% | 98.0% |
| Error-free documents | 27% | 87% |
| Per 1,000 documents | $0.22 | $0.78 |
| To fix / 1,000 | 727 | 127 |
| Speed (median) | 2.6 sec | 19.7 sec |
| Valid answers | 100.0% | 99.3% |
Accuracy per field
| Field | Gemma 4 31B | Qwen3.8 Flash |
|---|---|---|
| Provider | 100.0% | 99.3% |
| Provider ID | 100.0% | 94.7% |
| Client | 100.0% | 99.3% |
| Client ID | 100.0% | 94.7% |
| Contract type | 100.0% | 99.3% |
| Price (net) | 100.0% | 99.3% |
| Currency | 100.0% | 99.3% |
| Billing period | 100.0% | 99.3% |
| Effective date | 100.0% | 99.3% |
| End date | 100.0% | 99.3% |
| Notice period (months) | 100.0% | 99.3% |
| Late-payment penalty (% per day) | 27.3% | 99.3% |
| Governing law | 100.0% | 91.3% |
Documents where they differ
- Hansawerk GmbH · Schreinerei Weber AG · Contract text · Gemma 4 31B 12/13, Qwen3.8 Flash 10/13
- Hahn & Schulz GmbH & Co. KG · Alpentec GmbH · Contract text · Gemma 4 31B 13/13, Qwen3.8 Flash 12/13
- Hahn GmbH · Bauer & Klein GmbH · Contract text · Gemma 4 31B 12/13, Qwen3.8 Flash 13/13
- Wesermetall e.K. · Weserform GmbH · Contract text · Gemma 4 31B 12/13, Qwen3.8 Flash 11/13
- Haustechnik Braun UG (haftungsbeschränkt) · Nordbau GmbH · Contract text · Gemma 4 31B 12/13, Qwen3.8 Flash 13/13
- Winkler & Beck e.K. · Meyer & Weber e.K. · Contract text · Gemma 4 31B 12/13, Qwen3.8 Flash 13/13
- Hansametall GmbH & Co. KG · Roth & Schröder UG (haftungsbeschränkt) · Contract text · Gemma 4 31B 12/13, Qwen3.8 Flash 13/13
- Neumann Consulting UG (haftungsbeschränkt) · Huber AG · Contract text · Gemma 4 31B 12/13, Qwen3.8 Flash 13/13