ModelVerdict

Comparison

DeepSeek V4.1 Flash vs Mistral Medium 3.5

Same documents, same prompt: where each model is right, what it really costs and how fast it answers.

At a glance

Task · documentsEnglish (US)CzechGermanSpanishFrench
Invoice extraction99.4% / 97.8%99.9% / 93.5%99.5% / 97.4%98.3% / 97.0%99.4% / 98.2%
Email triage97.6% / 94.9%97.4% / 94.5%96.3% / 92.7%——
Personal data detection99.6% / 99.7%99.7% / 99.8%99.8% / 100.0%——
Contract clauses100.0% / 98.1%100.0% / 100.0%97.2% / 97.1%——

Correct fields: DeepSeek V4.1 Flash / Mistral Medium 3.5; the better one in bold. Click a cell to see the details.

Invoice extraction · English (US) (150 documents)

DeepSeek V4.1 Flash is more accurate by 1.6 pp. DeepSeek V4.1 Flash is 8.4× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields99.4%97.8%
Error-free documents93%79%
Per 1,000 documents$0.52$4.37
To fix / 1,00067207
Speed (median)5.7 sec2.3 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Supplier100.0%100.0%
Supplier ID (EIN, IČO…)100.0%100.0%
Invoice number100.0%100.0%
Payment reference96.7%94.7%
Invoice date100.0%98.7%
Due date100.0%99.3%
Net by tax rate100.0%88.0%
Tax by rate100.0%98.7%
Total100.0%100.0%
Currency99.3%100.0%
Bank account97.3%96.0%

Documents where they differ

Invoice extraction · Czech (150 documents)

DeepSeek V4.1 Flash is more accurate by 6.4 pp. DeepSeek V4.1 Flash is 9.4× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields99.9%93.5%
Error-free documents99%63%
Per 1,000 documents$0.50$4.69
To fix / 1,00013367
Speed (median)5.0 sec2.6 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Supplier99.3%90.0%
Supplier ID (EIN, IČO…)100.0%87.3%
VAT ID100.0%85.3%
Invoice number100.0%99.3%
Payment reference100.0%95.3%
Invoice date100.0%88.7%
Tax point100.0%86.7%
Due date100.0%90.7%
Net by tax rate100.0%99.3%
Tax by rate100.0%98.7%
Total100.0%100.0%
Currency100.0%100.0%
Bank account99.3%94.0%

Documents where they differ

Invoice extraction · German (150 documents)

DeepSeek V4.1 Flash is more accurate by 2.2 pp. DeepSeek V4.1 Flash is 8.3× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields99.5%97.4%
Error-free documents94%75%
Per 1,000 documents$0.57$4.72
To fix / 1,00060253
Speed (median)6.4 sec2.5 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Supplier99.3%97.3%
Supplier ID (EIN, IČO…)98.7%98.7%
VAT ID99.3%96.0%
Invoice number100.0%100.0%
Payment reference100.0%92.7%
Invoice date100.0%98.0%
Tax point99.3%90.7%
Due date99.3%97.3%
Net by tax rate100.0%98.0%
Tax by rate100.0%100.0%
Total100.0%100.0%
Currency100.0%100.0%
Bank account98.0%97.3%

Documents where they differ

Invoice extraction · Spanish (79 documents)

DeepSeek V4.1 Flash is more accurate by 1.3 pp. DeepSeek V4.1 Flash is 6.7× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields98.3%97.0%
Error-free documents77%67%
Per 1,000 documents$0.71$4.75
To fix / 1,000228330
Speed (median)5.8 sec2.5 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Supplier93.7%99.0%
Supplier ID (EIN, IČO…)100.0%100.0%
VAT ID100.0%94.0%
Invoice number100.0%100.0%
Payment reference97.5%93.0%
Invoice date100.0%100.0%
Tax point98.7%93.0%
Due date100.0%97.0%
Net by tax rate88.6%85.0%
Tax by rate100.0%100.0%
Total100.0%100.0%
Currency100.0%100.0%
Bank account98.7%100.0%

Documents where they differ

Invoice extraction · French (74 documents)

DeepSeek V4.1 Flash is more accurate by 1.2 pp. DeepSeek V4.1 Flash is 7.4× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields99.4%98.2%
Error-free documents92%81%
Per 1,000 documents$0.65$4.81
To fix / 1,00081190
Speed (median)5.7 sec2.6 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Supplier100.0%99.0%
Supplier ID (EIN, IČO…)100.0%99.0%
VAT ID98.7%98.0%
Invoice number100.0%100.0%
Payment reference98.7%94.0%
Invoice date100.0%100.0%
Tax point100.0%100.0%
Due date100.0%100.0%
Net by tax rate100.0%95.0%
Tax by rate100.0%98.0%
Total100.0%99.0%
Currency100.0%96.0%
Bank account94.6%98.0%

Documents where they differ

Email triage · English (US) (150 documents)

DeepSeek V4.1 Flash is more accurate by 2.7 pp. DeepSeek V4.1 Flash is 6.3× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields97.6%94.9%
Error-free documents79%57%
Per 1,000 documents$0.23$1.47
To fix / 1,000213427
Speed (median)3.8 sec0.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Category100.0%100.0%
Priority96.7%63.3%
Sentiment82.0%90.7%
Customer name100.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

  • Cody Baldwin · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 7/9
  • Danielle Little · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 7/9
  • Kyle Schwartz · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
  • James Arnold · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
  • Gene Everett · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
  • Laurie Knight · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
  • Dale Sanchez · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
  • David Patel · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9

Email triage · Czech (150 documents)

DeepSeek V4.1 Flash is more accurate by 2.9 pp. DeepSeek V4.1 Flash is 6.6× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields97.4%94.5%
Error-free documents77%55%
Per 1,000 documents$0.30$1.95
To fix / 1,000227447
Speed (median)4.2 sec0.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Category100.0%100.0%
Priority98.7%63.3%
Sentiment78.0%87.3%
Customer name100.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

Email triage · German (145 documents)

DeepSeek V4.1 Flash is more accurate by 3.6 pp. DeepSeek V4.1 Flash is 5.8× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields96.3%92.7%
Error-free documents68%48%
Per 1,000 documents$0.30$1.77
To fix / 1,000324520
Speed (median)4.2 sec0.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Category100.0%100.0%
Priority97.2%56.7%
Sentiment69.7%78.0%
Customer name100.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

  • Augusta Lange · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 7/9
  • Rolf-Peter Metz · Email · DeepSeek V4.1 Flash 8/9, Mistral Medium 3.5 7/9
  • Friedbert Hoffmann · Email · DeepSeek V4.1 Flash 8/9, Mistral Medium 3.5 9/9
  • Swantje Noack · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
  • Rosemarie Steuer · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
  • Raymund Weiß · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9
  • Sylwia Gerlach · Email · DeepSeek V4.1 Flash 8/9, Mistral Medium 3.5 9/9
  • Pamela Mosemann · Email · DeepSeek V4.1 Flash 9/9, Mistral Medium 3.5 8/9

Personal data detection · English (US) (150 documents)

Mistral Medium 3.5 is more accurate by 0.1 pp. DeepSeek V4.1 Flash is 4× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields99.6%99.7%
Error-free documents97%98%
Per 1,000 documents$0.29$1.15
To fix / 1,0002720
Speed (median)3.8 sec0.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Names98.7%99.3%
Email addresses100.0%100.0%
Phone numbers100.0%100.0%
Addresses98.7%98.7%
Dates of birth100.0%100.0%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

Both models got the same number of fields right on every example document.

Personal data detection · Czech (150 documents)

Mistral Medium 3.5 is more accurate by 0.1 pp. DeepSeek V4.1 Flash is 4.4× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields99.7%99.8%
Error-free documents98%99%
Per 1,000 documents$0.31$1.40
To fix / 1,0002013
Speed (median)4.2 sec0.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Names100.0%98.7%
Email addresses100.0%100.0%
Phone numbers100.0%100.0%
Addresses98.0%100.0%
Dates of birth100.0%100.0%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

Personal data detection · German (148 documents)

Mistral Medium 3.5 is more accurate by 0.2 pp. DeepSeek V4.1 Flash is 4.5× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields99.8%100.0%
Error-free documents99%100%
Per 1,000 documents$0.31$1.38
To fix / 1,000130
Speed (median)3.7 sec0.9 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Names100.0%100.0%
Email addresses100.0%100.0%
Phone numbers100.0%100.0%
Addresses98.7%100.0%
Dates of birth100.0%100.0%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

  • Gunnar Zorbach · Text · DeepSeek V4.1 Flash 6/7, Mistral Medium 3.5 7/7

Contract clauses · English (US) (150 documents)

DeepSeek V4.1 Flash is more accurate by 1.9 pp. DeepSeek V4.1 Flash is 7.3× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields100.0%98.1%
Error-free documents100%87%
Per 1,000 documents$0.32$2.35
To fix / 1,0000127
Speed (median)3.9 sec1.1 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Provider100.0%87.3%
Provider ID100.0%100.0%
Client100.0%88.7%
Client ID100.0%99.3%
Contract type100.0%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ

Contract clauses · Czech (150 documents)

Both are equally accurate. DeepSeek V4.1 Flash is 7.3× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields100.0%100.0%
Error-free documents100%100%
Per 1,000 documents$0.42$3.06
To fix / 1,00000
Speed (median)4.3 sec1.2 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Provider100.0%100.0%
Provider ID100.0%100.0%
Client100.0%100.0%
Client ID100.0%100.0%
Contract type100.0%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ

Both models got the same number of fields right on every example document.

Contract clauses · German (145 documents)

DeepSeek V4.1 Flash is more accurate by 0.1 pp. DeepSeek V4.1 Flash is 5.4× cheaper.

MetricDeepSeek V4.1 FlashMistral Medium 3.5
Correct fields97.2%97.1%
Error-free documents77%75%
Per 1,000 documents$0.51$2.76
To fix / 1,000228247
Speed (median)4.6 sec1.2 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Medium 3.5
Provider100.0%100.0%
Provider ID81.4%82.0%
Client100.0%100.0%
Client ID82.8%80.7%
Contract type100.0%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ