DeepSeek V4.1 Flash vs Mistral Medium 3.5
Same documents, same prompt: where each model is right, what it really costs and how fast it answers.
At a glance
| Task · documents | English (US) | Czech | German | Spanish | French |
|---|---|---|---|---|---|
| Invoice extraction | 99.4% / 97.8% | 99.9% / 93.5% | 99.5% / 97.4% | 98.3% / 97.0% | 99.4% / 98.2% |
| Email triage | 97.6% / 94.9% | 97.4% / 94.5% | 96.3% / 92.7% | — | — |
| Personal data detection | 99.6% / 99.7% | 99.7% / 99.8% | 99.8% / 100.0% | — | — |
| Contract clauses | 100.0% / 98.1% | 100.0% / 100.0% | 97.2% / 97.1% | — | — |
Correct fields: DeepSeek V4.1 Flash / Mistral Medium 3.5; the better one in bold. Click a cell to see the details.
Invoice extraction · English (US) (150 documents)
DeepSeek V4.1 Flash is more accurate by 1.6 pp. DeepSeek V4.1 Flash is 8.4× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.4% | 97.8% |
| Error-free documents | 93% | 79% |
| Per 1,000 documents | $0.52 | $4.37 |
| To fix / 1,000 | 67 | 207 |
| Speed (median) | 5.7 sec | 2.3 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Supplier | 100.0% | 100.0% |
| Supplier ID (EIN, IČO…) | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 96.7% | 94.7% |
| Invoice date | 100.0% | 98.7% |
| Due date | 100.0% | 99.3% |
| Net by tax rate | 100.0% | 88.0% |
| Tax by rate | 100.0% | 98.7% |
| Total | 100.0% | 100.0% |
| Currency | 99.3% | 100.0% |
| Bank account | 97.3% | 96.0% |
Documents where they differ
- Gomez & Sons, LLC · 7855 · Scan · DeepSeek V4.1 Flash 11/11, Mistral Medium 3.5 9/11
- Reid Office Products LLC · A-003849 · Scan · DeepSeek V4.1 Flash 10/11, Mistral Medium 3.5 11/11
- Miranda-Vega Group LLC · 4959 · PDF text · DeepSeek V4.1 Flash 11/11, Mistral Medium 3.5 10/11
- Raleigh Engineering Inc. · INV253511 · Scan · DeepSeek V4.1 Flash 11/11, Mistral Medium 3.5 10/11
- Archer-Smith Group LLC · A-004846 · Scan · DeepSeek V4.1 Flash 11/11, Mistral Medium 3.5 10/11
- Austin Landscaping Inc. · INV-17836 · Scan · DeepSeek V4.1 Flash 10/11, Mistral Medium 3.5 11/11
- Jon Miller · INV250236 · Clean image · DeepSeek V4.1 Flash 11/11, Mistral Medium 3.5 10/11
Invoice extraction · Czech (150 documents)
DeepSeek V4.1 Flash is more accurate by 6.4 pp. DeepSeek V4.1 Flash is 9.4× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.9% | 93.5% |
| Error-free documents | 99% | 63% |
| Per 1,000 documents | $0.50 | $4.69 |
| To fix / 1,000 | 13 | 367 |
| Speed (median) | 5.0 sec | 2.6 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Supplier | 99.3% | 90.0% |
| Supplier ID (EIN, IČO…) | 100.0% | 87.3% |
| VAT ID | 100.0% | 85.3% |
| Invoice number | 100.0% | 99.3% |
| Payment reference | 100.0% | 95.3% |
| Invoice date | 100.0% | 88.7% |
| Tax point | 100.0% | 86.7% |
| Due date | 100.0% | 90.7% |
| Net by tax rate | 100.0% | 99.3% |
| Tax by rate | 100.0% | 98.7% |
| Total | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Bank account | 99.3% | 94.0% |
Documents where they differ
- Pavlík a Zeman s.r.o. · 25500457 · Clean image · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 9/13
- Hrubý s.r.o. · DB2500960 · Clean image · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 9/13
- Jiřina Švecová · 25401227 · Clean image · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 10/13
- Stejskal, v.o.s. · FV2600175 · Photo · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 10/13
- Slavěna Pospíšilová · 26200409 · Scan · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 10/13
- Stavsklad s.r.o. · 2025/1111 · Scan · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 10/13
- Sedláček s.r.o. · 2025/0774 · Scan · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 12/13
- Dvořák a Matějka spol. s r.o. · FV2501205 · Photo · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 12/13
Invoice extraction · German (150 documents)
DeepSeek V4.1 Flash is more accurate by 2.2 pp. DeepSeek V4.1 Flash is 8.3× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.5% | 97.4% |
| Error-free documents | 94% | 75% |
| Per 1,000 documents | $0.57 | $4.72 |
| To fix / 1,000 | 60 | 253 |
| Speed (median) | 6.4 sec | 2.5 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Supplier | 99.3% | 97.3% |
| Supplier ID (EIN, IČO…) | 98.7% | 98.7% |
| VAT ID | 99.3% | 96.0% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 100.0% | 92.7% |
| Invoice date | 100.0% | 98.0% |
| Tax point | 99.3% | 90.7% |
| Due date | 99.3% | 97.3% |
| Net by tax rate | 100.0% | 98.0% |
| Tax by rate | 100.0% | 100.0% |
| Total | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Bank account | 98.0% | 97.3% |
Documents where they differ
- Meier GmbH · 2025-0264 · Photo · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 10/13
- Bauunternehmung Schröder GmbH · 2026-0622 · Clean image · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 10/13
- Druckerei Baumann GmbH · 2025-0324 · Scan · DeepSeek V4.1 Flash 12/13, Mistral Medium 3.5 13/13
- Ostmetall GmbH · AN-2025-00580 · Clean image · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 12/13
- Hoffmann UG (haftungsbeschränkt) · 2025/1479 · Clean image · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 12/13
- Dachdeckerei Fischer GmbH · 2025/0014 · Scan · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 12/13
- Malerbetrieb Otfried Haas · RE-2025-00168 · Scan · DeepSeek V4.1 Flash 12/13, Mistral Medium 3.5 11/13
- Christoph Haas – Hausmeisterservice · 2025-1432 · Clean image · DeepSeek V4.1 Flash 12/13, Mistral Medium 3.5 11/13
Invoice extraction · Spanish (79 documents)
DeepSeek V4.1 Flash is more accurate by 1.3 pp. DeepSeek V4.1 Flash is 6.7× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 98.3% | 97.0% |
| Error-free documents | 77% | 67% |
| Per 1,000 documents | $0.71 | $4.75 |
| To fix / 1,000 | 228 | 330 |
| Speed (median) | 5.8 sec | 2.5 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Supplier | 93.7% | 99.0% |
| Supplier ID (EIN, IČO…) | 100.0% | 100.0% |
| VAT ID | 100.0% | 94.0% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 97.5% | 93.0% |
| Invoice date | 100.0% | 100.0% |
| Tax point | 98.7% | 93.0% |
| Due date | 100.0% | 97.0% |
| Net by tax rate | 88.6% | 85.0% |
| Tax by rate | 100.0% | 100.0% |
| Total | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Bank account | 98.7% | 100.0% |
Documents where they differ
- Talleres Rozas Zapata S.L. · FV25-01486 · Clean image · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 12/13
- Academia Checa S.L. · F2025-0208 · Clean image · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 12/13
- Goñi Logística S.L. · R-2025/1460 · Scan · DeepSeek V4.1 Flash 12/13, Mistral Medium 3.5 13/13
- Onofre Diez Guitart · R-2025/1100 · Clean image · DeepSeek V4.1 Flash 12/13, Mistral Medium 3.5 13/13
Invoice extraction · French (74 documents)
DeepSeek V4.1 Flash is more accurate by 1.2 pp. DeepSeek V4.1 Flash is 7.4× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.4% | 98.2% |
| Error-free documents | 92% | 81% |
| Per 1,000 documents | $0.65 | $4.81 |
| To fix / 1,000 | 81 | 190 |
| Speed (median) | 5.7 sec | 2.6 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Supplier | 100.0% | 99.0% |
| Supplier ID (EIN, IČO…) | 100.0% | 99.0% |
| VAT ID | 98.7% | 98.0% |
| Invoice number | 100.0% | 100.0% |
| Payment reference | 98.7% | 94.0% |
| Invoice date | 100.0% | 100.0% |
| Tax point | 100.0% | 100.0% |
| Due date | 100.0% | 100.0% |
| Net by tax rate | 100.0% | 95.0% |
| Tax by rate | 100.0% | 98.0% |
| Total | 100.0% | 99.0% |
| Currency | 100.0% | 96.0% |
| Bank account | 94.6% | 98.0% |
Documents where they differ
- Établissements Blanc SAS · F-11122 · Scan · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 11/13
- Constance Martin – Rédactrice (EI) · FAC25080663 · Scan · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 12/13
- Guérin & Fils EURL · 2026-05-688 · Clean image · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 12/13
Email triage · English (US) (150 documents)
DeepSeek V4.1 Flash is more accurate by 2.7 pp. DeepSeek V4.1 Flash is 6.3× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 97.6% | 94.9% |
| Error-free documents | 79% | 57% |
| Per 1,000 documents | $0.23 | $1.47 |
| To fix / 1,000 | 213 | 427 |
| Speed (median) | 3.8 sec | 0.8 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 96.7% | 63.3% |
| Sentiment | 82.0% | 90.7% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Cody Baldwin · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 7/9
- Danielle Little · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 7/9
- Kyle Schwartz · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- James Arnold · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- Gene Everett · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- Laurie Knight · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- Dale Sanchez · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- David Patel · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
Email triage · Czech (150 documents)
DeepSeek V4.1 Flash is more accurate by 2.9 pp. DeepSeek V4.1 Flash is 6.6× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 97.4% | 94.5% |
| Error-free documents | 77% | 55% |
| Per 1,000 documents | $0.30 | $1.95 |
| To fix / 1,000 | 227 | 447 |
| Speed (median) | 4.2 sec | 0.8 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 98.7% | 63.3% |
| Sentiment | 78.0% | 87.3% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Milan Kašpar · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- Eduard Stejskal · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- Alois Sedlák · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- Lucie Kašparová · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- Alexandr Kubíček · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- Ignác Bartoš · Email · DeepSeek V4.1 Flash 8/9, Mistral Medium 3.5 9/9
- Lýdie Tůmová · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- Zuzana Brožová · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
Email triage · German (145 documents)
DeepSeek V4.1 Flash is more accurate by 3.6 pp. DeepSeek V4.1 Flash is 5.8× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 96.3% | 92.7% |
| Error-free documents | 68% | 48% |
| Per 1,000 documents | $0.30 | $1.77 |
| To fix / 1,000 | 324 | 520 |
| Speed (median) | 4.2 sec | 0.8 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Category | 100.0% | 100.0% |
| Priority | 97.2% | 56.7% |
| Sentiment | 69.7% | 78.0% |
| Customer name | 100.0% | 100.0% |
| Order number | 100.0% | 100.0% |
| Invoice number | 100.0% | 100.0% |
| Amount | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Deadline | 100.0% | 100.0% |
Documents where they differ
- Augusta Lange · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 7/9
- Rolf-Peter Metz · Email · DeepSeek V4.1 Flash 8/9, Mistral Medium 3.5 7/9
- Friedbert Hoffmann · Email · DeepSeek V4.1 Flash 8/9, Mistral Medium 3.5 9/9
- Swantje Noack · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- Rosemarie Steuer · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- Raymund Weiß · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
- Sylwia Gerlach · Email · DeepSeek V4.1 Flash 8/9, Mistral Medium 3.5 9/9
- Pamela Mosemann · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
Personal data detection · English (US) (150 documents)
Mistral Medium 3.5 is more accurate by 0.1 pp. DeepSeek V4.1 Flash is 4× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.6% | 99.7% |
| Error-free documents | 97% | 98% |
| Per 1,000 documents | $0.29 | $1.15 |
| To fix / 1,000 | 27 | 20 |
| Speed (median) | 3.8 sec | 0.8 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Names | 98.7% | 99.3% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 98.7% | 98.7% |
| Dates of birth | 100.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
Both models got the same number of fields right on every example document.
Personal data detection · Czech (150 documents)
Mistral Medium 3.5 is more accurate by 0.1 pp. DeepSeek V4.1 Flash is 4.4× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.7% | 99.8% |
| Error-free documents | 98% | 99% |
| Per 1,000 documents | $0.31 | $1.40 |
| To fix / 1,000 | 20 | 13 |
| Speed (median) | 4.2 sec | 0.8 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Names | 100.0% | 98.7% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 98.0% | 100.0% |
| Dates of birth | 100.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
- Zikmund Sedláček · Text · DeepSeek V4.1 Flash 7/7, Mistral Medium 3.5 6/7
Personal data detection · German (148 documents)
Mistral Medium 3.5 is more accurate by 0.2 pp. DeepSeek V4.1 Flash is 4.5× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 99.8% | 100.0% |
| Error-free documents | 99% | 100% |
| Per 1,000 documents | $0.31 | $1.38 |
| To fix / 1,000 | 13 | 0 |
| Speed (median) | 3.7 sec | 0.9 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Names | 100.0% | 100.0% |
| Email addresses | 100.0% | 100.0% |
| Phone numbers | 100.0% | 100.0% |
| Addresses | 98.7% | 100.0% |
| Dates of birth | 100.0% | 100.0% |
| National IDs | 100.0% | 100.0% |
| Bank accounts | 100.0% | 100.0% |
Documents where they differ
- Gunnar Zorbach · Text · DeepSeek V4.1 Flash 6/7, Mistral Medium 3.5 7/7
Contract clauses · English (US) (150 documents)
DeepSeek V4.1 Flash is more accurate by 1.9 pp. DeepSeek V4.1 Flash is 7.3× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.0% | 98.1% |
| Error-free documents | 100% | 87% |
| Per 1,000 documents | $0.32 | $2.35 |
| To fix / 1,000 | 0 | 127 |
| Speed (median) | 3.9 sec | 1.1 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Provider | 100.0% | 87.3% |
| Provider ID | 100.0% | 100.0% |
| Client | 100.0% | 88.7% |
| Client ID | 100.0% | 99.3% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 100.0% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Page Printing LLC · Raleigh Printing Inc. · Contract text · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 11/13
- Frontier Solutions Inc. · San Diego Office Products Co. · Contract text · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 11/13
- Boston Supply LLC · Summit Systems Corp. · Contract text · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 11/13
- Blue Ridge Services Co. · Foster Janitorial Services Corp. · Contract text · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 12/13
Contract clauses · Czech (150 documents)
Both are equally accurate. DeepSeek V4.1 Flash is 7.3× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 100.0% | 100.0% |
| Error-free documents | 100% | 100% |
| Per 1,000 documents | $0.42 | $3.06 |
| To fix / 1,000 | 0 | 0 |
| Speed (median) | 4.3 sec | 1.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Provider | 100.0% | 100.0% |
| Provider ID | 100.0% | 100.0% |
| Client | 100.0% | 100.0% |
| Client ID | 100.0% | 100.0% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 100.0% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
Both models got the same number of fields right on every example document.
Contract clauses · German (145 documents)
DeepSeek V4.1 Flash is more accurate by 0.1 pp. DeepSeek V4.1 Flash is 5.4× cheaper.
| Metric | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Correct fields | 97.2% | 97.1% |
| Error-free documents | 77% | 75% |
| Per 1,000 documents | $0.51 | $2.76 |
| To fix / 1,000 | 228 | 247 |
| Speed (median) | 4.6 sec | 1.2 sec |
| Valid answers | 100.0% | 100.0% |
Accuracy per field
| Field | DeepSeek V4.1 Flash | Mistral Medium 3.5 |
|---|---|---|
| Provider | 100.0% | 100.0% |
| Provider ID | 81.4% | 82.0% |
| Client | 100.0% | 100.0% |
| Client ID | 82.8% | 80.7% |
| Contract type | 100.0% | 100.0% |
| Price (net) | 100.0% | 100.0% |
| Currency | 100.0% | 100.0% |
| Billing period | 100.0% | 100.0% |
| Effective date | 100.0% | 100.0% |
| End date | 100.0% | 100.0% |
| Notice period (months) | 100.0% | 100.0% |
| Late-payment penalty (% per day) | 100.0% | 100.0% |
| Governing law | 100.0% | 100.0% |
Documents where they differ
- Haustechnik Braun UG (haftungsbeschränkt) · Nordbau GmbH · Contract text · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 11/13
- Maintec GmbH · Schreinerei Wagner GmbH · Contract text · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 12/13
- Neumann Consulting UG (haftungsbeschränkt) · Huber AG · Contract text · DeepSeek V4.1 Flash 13/13, Mistral Medium 3.5 12/13
- Walter Systemtechnik GmbH & Co. KG · Weiß Handel GmbH · Contract text · DeepSeek V4.1 Flash 12/13, Mistral Medium 3.5 13/13
- Fuchs GmbH · Hartmann & Brandt UG (haftungsbeschränkt) · Contract text · DeepSeek V4.1 Flash 12/13, Mistral Medium 3.5 13/13