Mistral Small 4 vs Qwen3.8 Flash
Same documents, same prompt: where each model is right, what it really costs and how fast it answers.
At a glance
| Task · documents | English (US) | Czech | German | Spanish | French |
|---|---|---|---|---|---|
| Invoice extraction | 95.6% / 82.4% | 93.6% / 91.8% | 94.6% / 93.5% | 91.9% / 87.9% | 94.2% / 90.6% |
| Email triage | 89.7% / 97.5% | 87.7% / 98.5% | 87.1% / 97.9% | — | — |
| Personal data detection | 99.4% / 99.2% | 98.8% / 97.0% | 99.1% / 99.6% | — | — |
| Contract clauses | 91.5% / 95.1% | 99.0% / 99.9% | 94.0% / 98.0% | — | — |
Correct fields: Mistral Small 4 / Qwen3.8 Flash; the better one in bold. Click a cell to see the details.
Invoice extraction · English (US) (150 documents)
Mistral Small 4 is more accurate by 13.2 pp. Mistral Small 4 is 2.8× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 95.6% | 82.4% |
| Error-free documents | 58% | 57% |
| Per 1,000 documents | $0.41 | $1.15 |
| To fix / 1,000 | 420 | 427 |
| Speed (median) | 1.8 sec | 17.4 sec |
| Valid answers | 100.0% | 90.7% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Supplier | 100.0% | 85.3% |
| Supplier ID (EIN, IČO…) | 99.3% | 88.7% |
| Invoice number | 100.0% | 85.3% |
| Payment reference | 87.3% | 79.3% |
| Invoice date | 97.3% | 85.3% |
| Due date | 98.7% | 85.3% |
| Net by tax rate | 72.0% | 70.0% |
| Tax by rate | 99.3% | 76.0% |
| Total | 100.0% | 85.3% |
| Currency | 99.3% | 84.0% |
| Bank account | 98.0% | 81.3% |
Documents where they differ
- Reid Office Products LLC · A-003849 · Scan · Mistral Small 4 10/11, Qwen3.8 Flash 0/11
- Eagle Partners Co. · 4272 · Clean image · Mistral Small 4 10/11, Qwen3.8 Flash 0/11
- Hughes Janitorial Services Corp. · A-001911 · Scan · Mistral Small 4 10/11, Qwen3.8 Flash 1/11
- Summit Services Inc. · INV-15230 · Scan · Mistral Small 4 10/11, Qwen3.8 Flash 2/11
- Raleigh Engineering Inc. · INV253511 · Scan · Mistral Small 4 9/11, Qwen3.8 Flash 1/11
- Miranda-Vega Group LLC · 4959 · PDF text · Mistral Small 4 10/11, Qwen3.8 Flash 8/11
- Cochran-Graham Group LLC · A-007505 · Clean image · Mistral Small 4 9/11, Qwen3.8 Flash 11/11
- Liberty Systems Inc. · INV-17299 · PDF text · Mistral Small 4 11/11, Qwen3.8 Flash 9/11
Invoice extraction · Czech (150 documents)
Mistral Small 4 is more accurate by 1.8 pp. Mistral Small 4 is 2.3× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 93.6% | 91.8% |
| Error-free documents | 56% | 77% |
| Per 1,000 documents | $0.44 | $1.02 |
| To fix / 1,000 | 440 | 233 |
| Speed (median) | 2.0 sec | 17.0 sec |
| Valid answers | 100.0% | 96.7% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Supplier | 91.3% | 93.3% |
| Supplier ID (EIN, IČO…) | 92.7% | 94.0% |
| VAT ID | 94.0% | 94.0% |
| Invoice number | 100.0% | 94.7% |
| Payment reference | 97.3% | 94.0% |
| Invoice date | 98.0% | 94.7% |
| Tax point | 76.0% | 94.7% |
| Due date | 97.3% | 94.7% |
| Net by tax rate | 90.0% | 80.0% |
| Tax by rate | 94.7% | 80.7% |
| Total | 98.7% | 94.0% |
| Currency | 97.3% | 94.0% |
| Bank account | 90.0% | 90.7% |
Documents where they differ
- Sedláček s.r.o. · 2025/0774 · Scan · Mistral Small 4 11/13, Qwen3.8 Flash 0/13
- Sedlák s.r.o. · 20250158 · Photo · Mistral Small 4 13/13, Qwen3.8 Flash 9/13
- Dvořák s.r.o. · FV2501487 · PDF text · Mistral Small 4 13/13, Qwen3.8 Flash 11/13
- Pavlík a Zeman s.r.o. · 25500457 · Clean image · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Hruška a Šťastný s.r.o. · 2025/0324 · Clean image · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Tesař s.r.o. · 20250237 · Scan · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Hruška spol. s r.o. · 20250328 · PDF text · Mistral Small 4 13/13, Qwen3.8 Flash 11/13
- Stavmet s.r.o. · 20250906 · PDF text · Mistral Small 4 13/13, Qwen3.8 Flash 11/13
Invoice extraction · German (140 documents)
Mistral Small 4 is more accurate by 1.1 pp. Mistral Small 4 is 2.6× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 94.6% | 93.5% |
| Error-free documents | 50% | 87% |
| Per 1,000 documents | $0.44 | $1.12 |
| To fix / 1,000 | 500 | 127 |
| Speed (median) | 2.0 sec | 19.0 sec |
| Valid answers | 100.0% | 94.0% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Supplier | 98.6% | 94.0% |
| Supplier ID (EIN, IČO…) | 80.0% | 94.0% |
| VAT ID | 92.9% | 94.0% |
| Invoice number | 100.0% | 92.7% |
| Payment reference | 87.1% | 88.7% |
| Invoice date | 100.0% | 94.0% |
| Tax point | 87.9% | 94.0% |
| Due date | 98.6% | 94.0% |
| Net by tax rate | 94.3% | 94.0% |
| Tax by rate | 99.3% | 94.0% |
| Total | 100.0% | 94.0% |
| Currency | 100.0% | 94.0% |
| Bank account | 91.4% | 94.0% |
Documents where they differ
- Bauunternehmung Schröder GmbH · 2026-0622 · Clean image · Mistral Small 4 12/13, Qwen3.8 Flash 0/13
- Schreinerei Ferdi Schuster · 2025/0939 · Clean image · Mistral Small 4 11/13, Qwen3.8 Flash 0/13
- Maurizio Schröder · RE10338 · PDF text · Mistral Small 4 10/13, Qwen3.8 Flash 13/13
- Druckerei Baumann GmbH · 2025-0324 · Scan · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Gebäudereinigung Klara Weiß · 2025-1126 · PDF text · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Isarplan e.K. · 2025/0849 · PDF text · Mistral Small 4 12/13, Qwen3.8 Flash 13/13
- Malerbetrieb Otfried Haas · RE-2025-00168 · Scan · Mistral Small 4 12/13, Qwen3.8 Flash 13/13
- Christoph Haas – Hausmeisterservice · 2025-1432 · Clean image · Mistral Small 4 12/13, Qwen3.8 Flash 13/13
Invoice extraction · Spanish (84 documents)
Mistral Small 4 is more accurate by 4 pp. Mistral Small 4 is 3.1× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 91.9% | 87.9% |
| Error-free documents | 31% | 74% |
| Per 1,000 documents | $0.44 | $1.40 |
| To fix / 1,000 | 691 | 260 |
| Speed (median) | 2.2 sec | 22.3 sec |
| Valid answers | 100.0% | 90.0% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Supplier | 97.6% | 86.0% |
| Supplier ID (EIN, IČO…) | 98.8% | 89.0% |
| VAT ID | 53.6% | 86.0% |
| Invoice number | 100.0% | 89.0% |
| Payment reference | 88.1% | 85.0% |
| Invoice date | 100.0% | 89.0% |
| Tax point | 69.1% | 87.0% |
| Due date | 100.0% | 89.0% |
| Net by tax rate | 96.4% | 86.0% |
| Tax by rate | 97.6% | 90.0% |
| Total | 98.8% | 89.0% |
| Currency | 100.0% | 89.0% |
| Bank account | 95.2% | 89.0% |
Documents where they differ
- Centro de Formación Mediterránea S.L. · 2026/0876 · Scan · Mistral Small 4 11/13, Qwen3.8 Flash 0/13
- Aguirre Formación S.L. · 2025/0652 · Clean image · Mistral Small 4 11/13, Qwen3.8 Flash 0/13
- Coloma Servicios Informáticos S.L.U. · PRO-2025-0066 · Scan · Mistral Small 4 11/13, Qwen3.8 Flash 0/13
- Centro de Formación Centro S.L.U. · A-2025-1405 · Clean image · Mistral Small 4 11/13, Qwen3.8 Flash 0/13
- Talleres Ibérica, S.A. · PF25/1188 · Clean image · Mistral Small 4 12/13, Qwen3.8 Flash 3/13
- Academia Checa S.L. · F2025-0208 · Clean image · Mistral Small 4 10/13, Qwen3.8 Flash 13/13
- Centro de Formación del Sur S.L.U. · F2025-1424 · Scan · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Leyre Lladó Vall · F2025-1476 · Photo · Mistral Small 4 10/13, Qwen3.8 Flash 12/13
Invoice extraction · French (76 documents)
Mistral Small 4 is more accurate by 3.6 pp. Mistral Small 4 is 2.8× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 94.2% | 90.6% |
| Error-free documents | 50% | 82% |
| Per 1,000 documents | $0.45 | $1.23 |
| To fix / 1,000 | 500 | 180 |
| Speed (median) | 2.1 sec | 19.8 sec |
| Valid answers | 100.0% | 95.0% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Supplier | 96.1% | 91.0% |
| Supplier ID (EIN, IČO…) | 93.4% | 91.0% |
| VAT ID | 93.4% | 91.0% |
| Invoice number | 100.0% | 90.0% |
| Payment reference | 85.5% | 86.0% |
| Invoice date | 100.0% | 91.0% |
| Tax point | 92.1% | 92.0% |
| Due date | 100.0% | 89.0% |
| Net by tax rate | 94.7% | 91.0% |
| Tax by rate | 100.0% | 94.0% |
| Total | 100.0% | 91.0% |
| Currency | 94.7% | 91.0% |
| Bank account | 75.0% | 90.0% |
Documents where they differ
- Guérin & Fils EURL · 2026-05-688 · Clean image · Mistral Small 4 13/13, Qwen3.8 Flash 1/13
- Établissements Blanc SAS · F-11122 · Scan · Mistral Small 4 11/13, Qwen3.8 Flash 0/13
- Nettoyage Mercier SASU · AC-10176 · Clean image · Mistral Small 4 13/13, Qwen3.8 Flash 3/13
- Carrosserie Alain Meunier EI · FAC-2026-00869 · Clean image · Mistral Small 4 10/13, Qwen3.8 Flash 13/13
- Occiservices SASU · AVO-2025-01209 · Clean image · Mistral Small 4 10/13, Qwen3.8 Flash 13/13
- Maçonnerie Arnaude Dumont EI · FAC26021277 · Scan · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Catherine Dubois EI · FAC-2025-00139 · PDF text · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- SAS Marie et Associés · FAC25070013 · Scan · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
Email triage · English (US) (150 documents)
Qwen3.8 Flash is more accurate by 7.8 pp. Mistral Small 4 is 3.2× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 89.7% | 97.5% |
| Error-free documents | 37% | 79% |
| Per 1,000 documents | $0.09 | $0.30 |
| To fix / 1,000 | 627 | 213 |
| Speed (median) | 0.8 sec | 8.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 61.3% | 97.3% |
| Sentiment | 71.3% | 80.7% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 99.3% | 100.0% |
| Currency | 99.3% | 100.0% |
| Deadline | 76.0% | 99.3% |
Documents where they differ
- Robert Lewis · Email · Mistral Small 4 6/9, Qwen3.8 Flash 9/9
- Omar Cabrera · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Russell Bates · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Kyle Schwartz · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Jennifer Chapman · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Cody Baldwin · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Dale Sanchez · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Leah Douglas · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
Email triage · Czech (149 documents)
Qwen3.8 Flash is more accurate by 10.8 pp. Mistral Small 4 is 3.8× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 87.7% | 98.5% |
| Error-free documents | 32% | 87% |
| Per 1,000 documents | $0.12 | $0.45 |
| To fix / 1,000 | 685 | 133 |
| Speed (median) | 0.8 sec | 13.0 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 52.4% | 99.3% |
| Sentiment | 72.5% | 88.7% |
| Customer name | 98.7% | 99.3% |
| Order number | 100.0% | 99.3% |
| Invoice number | 100.0% | 100.0% |
| Amount | 98.0% | 100.0% |
| Currency | 98.0% | 100.0% |
| Deadline | 69.8% | 100.0% |
Documents where they differ
- Rostislav Novák · Email · Mistral Small 4 6/9, Qwen3.8 Flash 9/9
- Milan Kašpar · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Eduard Stejskal · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Alexandr Kubíček · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Simona Kolářová · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Petra Šťastná · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Adam Vaněk · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Štěpánka Vítková · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
Email triage · German (143 documents)
Qwen3.8 Flash is more accurate by 10.8 pp. Mistral Small 4 is 3.7× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 87.1% | 97.9% |
| Error-free documents | 29% | 81% |
| Per 1,000 documents | $0.11 | $0.39 |
| To fix / 1,000 | 706 | 187 |
| Speed (median) | 0.8 sec | 12.1 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 55.2% | 96.0% |
| Sentiment | 65.0% | 84.7% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 96.5% | 100.0% |
| Currency | 96.5% | 100.0% |
| Deadline | 70.6% | 100.0% |
Documents where they differ
- Berthold Anders · Email · Mistral Small 4 5/9, Qwen3.8 Flash 9/9
- Rolf-Peter Metz · Email · Mistral Small 4 6/9, Qwen3.8 Flash 8/9
- Swantje Noack · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Luzia Drewes · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Cynthia Hahn · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Sibille Lehmann · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Antonietta Wende · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
- Marta Kambs · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
Personal data detection · English (US) (149 documents)
Mistral Small 4 is more accurate by 0.2 pp. Mistral Small 4 is 3.6× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.4% | 99.2% |
| Error-free documents | 96% | 99% |
| Per 1,000 documents | $0.08 | $0.28 |
| To fix / 1,000 | 40 | 13 |
| Speed (median) | 0.8 sec | 7.5 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Names | 97.3% | 99.3% |
| Email addresses | 100.0% | 99.3% |
| Phone numbers | 100.0% | 99.3% |
| Addresses | 98.7% | 98.7% |
| Dates of birth | 100.0% | 99.3% |
| National IDs | 100.0% | 99.3% |
| Bank accounts | 100.0% | 99.3% |
Documents where they differ
- Christopher Scott · Text · Mistral Small 4 6/7, Qwen3.8 Flash 7/7
- Denise Jones · Text · Mistral Small 4 6/7, Qwen3.8 Flash 7/7
- Margaret Mills · Text · Mistral Small 4 6/7, Qwen3.8 Flash 7/7
- David Fitzpatrick · Text · Mistral Small 4 6/7, Qwen3.8 Flash 7/7
Personal data detection · Czech (149 documents)
Mistral Small 4 is more accurate by 1.8 pp. Mistral Small 4 is 4.4× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 98.8% | 97.0% |
| Error-free documents | 92% | 89% |
| Per 1,000 documents | $0.09 | $0.41 |
| To fix / 1,000 | 81 | 113 |
| Speed (median) | 0.9 sec | 9.6 sec |
| Valid answers | 100.0% | 99.3% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Names | 94.0% | 90.7% |
| Email addresses | 100.0% | 98.0% |
| Phone numbers | 100.0% | 97.3% |
| Addresses | 98.7% | 96.7% |
| Dates of birth | 98.7% | 98.0% |
| National IDs | 100.0% | 99.3% |
| Bank accounts | 100.0% | 98.7% |
Documents where they differ
- Rudolf Konečný · Text · Mistral Small 4 5/7, Qwen3.8 Flash 7/7
- Naděžda Žáková · Text · Mistral Small 4 7/7, Qwen3.8 Flash 6/7
Personal data detection · German (139 documents)
Qwen3.8 Flash is more accurate by 0.5 pp. Mistral Small 4 is 4× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.1% | 99.6% |
| Error-free documents | 94% | 99% |
| Per 1,000 documents | $0.09 | $0.36 |
| To fix / 1,000 | 65 | 7 |
| Speed (median) | 0.9 sec | 12.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Names | 95.0% | 99.3% |
| Email addresses | 100.0% | 99.3% |
| Phone numbers | 100.0% | 99.3% |
| Addresses | 99.3% | 99.3% |
| Dates of birth | 100.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 99.3% | 100.0% |
Documents where they differ
- Rosi Karz · Text · Mistral Small 4 6/7, Qwen3.8 Flash 7/7
Contract clauses · English (US) (150 documents)
Qwen3.8 Flash is more accurate by 3.6 pp. Mistral Small 4 is 3.6× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 91.5% | 95.1% |
| Error-free documents | 43% | 69% |
| Per 1,000 documents | $0.17 | $0.62 |
| To fix / 1,000 | 567 | 307 |
| Speed (median) | 1.1 sec | 14.1 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Provider | 43.3% | 69.3% |
| Provider ID | 100.0% | 100.0% |
| Client | 46.7% | 69.3% |
| Client ID | 100.0% | 100.0% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 99.3% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 99.3% |
| Governing law | 100.0% | 99.3% |
Documents where they differ
- Chambers & Sons, Corp. · Reed & Sons, LLC · Contract text · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Murray Plumbing Inc. · Gray & Sons, Co. · Contract text · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Seattle Printing Inc. · Gutierrez Landscaping LLC · Contract text · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Page Printing LLC · Raleigh Printing Inc. · Contract text · Mistral Small 4 11/13, Qwen3.8 Flash 9/13
- Summit Services LLC · Fry Electric LLC · Contract text · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Griffith-Chan Group Inc. · Wilkerson & Sons, Inc. · Contract text · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Wilson Supply Inc. · Jones Logistics Corp. · Contract text · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Minneapolis Engineering Inc. · Liberty Industries LLC · Contract text · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
Contract clauses · Czech (150 documents)
Qwen3.8 Flash is more accurate by 0.9 pp. Mistral Small 4 is 2.8× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 99.0% | 99.9% |
| Error-free documents | 92% | 99% |
| Per 1,000 documents | $0.23 | $0.63 |
| To fix / 1,000 | 80 | 13 |
| Speed (median) | 1.2 sec | 13.6 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Provider | 95.3% | 100.0% |
| Provider ID | 100.0% | 100.0% |
| Client | 95.3% | 100.0% |
| Client ID | 100.0% | 100.0% |
| Contract type | 100.0% | 98.7% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 96.7% | 100.0% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Blažek s.r.o. · Moravec s.r.o. · Contract text · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Elektrotrade s.r.o. · Konečný a Dostál spol. s r.o. · Contract text · Mistral Small 4 12/13, Qwen3.8 Flash 13/13
- Bureš a Kadlec s.r.o. · Kříž s.r.o. · Contract text · Mistral Small 4 12/13, Qwen3.8 Flash 13/13
- Interservis s.r.o. · Staněk s.r.o. · Contract text · Mistral Small 4 13/13, Qwen3.8 Flash 12/13
Contract clauses · German (141 documents)
Qwen3.8 Flash is more accurate by 4 pp. Mistral Small 4 is 3.8× cheaper.
| Metric | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Correct fields | 94.0% | 98.0% |
| Error-free documents | 45% | 87% |
| Per 1,000 documents | $0.21 | $0.78 |
| To fix / 1,000 | 553 | 127 |
| Speed (median) | 1.2 sec | 19.7 sec |
| Valid answers | 100.0% | 99.3% |
Accuracy per field
| Field | Mistral Small 4 | Qwen3.8 Flash |
|---|---|---|
| Provider | 98.6% | 99.3% |
| Provider ID | 62.4% | 94.7% |
| Client | 98.6% | 99.3% |
| Client ID | 63.1% | 94.7% |
| Contract type | 100.0% | 99.3% |
| Price (net) | 100.0% | 99.3% |
| Currency | 100.0% | 99.3% |
| Billing period | 100.0% | 99.3% |
| Effective date | 99.3% | 99.3% |
| End date | 100.0% | 99.3% |
| Notice period (months) | 100.0% | 99.3% |
| Late-payment penalty (% per day) | 100.0% | 99.3% |
| Governing law | 100.0% | 91.3% |
Documents where they differ
- Richter & Scholz e.K. · Köhler AG · Contract text · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Meyer AG · Hartmann GmbH · Contract text · Mistral Small 4 11/13, Qwen3.8 Flash 13/13
- Haustechnik Braun UG (haftungsbeschränkt) · Nordbau GmbH · Contract text · Mistral Small 4 12/13, Qwen3.8 Flash 13/13
- Hansawerk GmbH · Schreinerei Weber AG · Contract text · Mistral Small 4 11/13, Qwen3.8 Flash 10/13
- Winkler & Beck e.K. · Meyer & Weber e.K. · Contract text · Mistral Small 4 12/13, Qwen3.8 Flash 13/13
- Kraus Consulting GmbH · Lange Consulting GmbH & Co. KG · Contract text · Mistral Small 4 13/13, Qwen3.8 Flash 12/13
- Hansametall GmbH & Co. KG · Roth & Schröder UG (haftungsbeschränkt) · Contract text · Mistral Small 4 12/13, Qwen3.8 Flash 13/13
- Neumann Consulting UG (haftungsbeschränkt) · Huber AG · Contract text · Mistral Small 4 12/13, Qwen3.8 Flash 13/13