ModelVerdict

Comparison

DeepSeek V4.1 Flash vs Mistral Small 4

Same documents, same prompt: where each model is right, what it really costs and how fast it answers.

At a glance

Task · documentsEnglish (US)CzechGermanSpanishFrench
Invoice extraction99.4% / 95.6%99.9% / 93.6%99.5% / 94.6%98.3% / 91.9%99.4% / 94.2%
Email triage97.6% / 89.7%97.4% / 87.7%96.3% / 87.1%——
Personal data detection99.6% / 99.4%99.7% / 98.8%99.8% / 99.1%——
Contract clauses100.0% / 91.5%100.0% / 99.0%97.2% / 94.0%——

Correct fields: DeepSeek V4.1 Flash / Mistral Small 4; the better one in bold. Click a cell to see the details.

Invoice extraction · English (US) (150 documents)

DeepSeek V4.1 Flash is more accurate by 3.8 pp. Mistral Small 4 is 1.3× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields99.4%95.6%
Error-free documents93%58%
Per 1,000 documents$0.52$0.41
To fix / 1,00067420
Speed (median)5.7 sec1.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Supplier100.0%100.0%
Supplier ID (EIN, IČO…)100.0%99.3%
Invoice number100.0%100.0%
Payment reference96.7%87.3%
Invoice date100.0%97.3%
Due date100.0%98.7%
Net by tax rate100.0%72.0%
Tax by rate100.0%99.3%
Total100.0%100.0%
Currency99.3%99.3%
Bank account97.3%98.0%

Documents where they differ

Invoice extraction · Czech (150 documents)

DeepSeek V4.1 Flash is more accurate by 6.3 pp. Mistral Small 4 is 1.1× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields99.9%93.6%
Error-free documents99%56%
Per 1,000 documents$0.50$0.44
To fix / 1,00013440
Speed (median)5.0 sec2.0 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Supplier99.3%91.3%
Supplier ID (EIN, IČO…)100.0%92.7%
VAT ID100.0%94.0%
Invoice number100.0%100.0%
Payment reference100.0%97.3%
Invoice date100.0%98.0%
Tax point100.0%76.0%
Due date100.0%97.3%
Net by tax rate100.0%90.0%
Tax by rate100.0%94.7%
Total100.0%98.7%
Currency100.0%97.3%
Bank account99.3%90.0%

Documents where they differ

Invoice extraction · German (150 documents)

DeepSeek V4.1 Flash is more accurate by 4.9 pp. Mistral Small 4 is 1.3× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields99.5%94.6%
Error-free documents94%50%
Per 1,000 documents$0.57$0.44
To fix / 1,00060500
Speed (median)6.4 sec2.0 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Supplier99.3%98.6%
Supplier ID (EIN, IČO…)98.7%80.0%
VAT ID99.3%92.9%
Invoice number100.0%100.0%
Payment reference100.0%87.1%
Invoice date100.0%100.0%
Tax point99.3%87.9%
Due date99.3%98.6%
Net by tax rate100.0%94.3%
Tax by rate100.0%99.3%
Total100.0%100.0%
Currency100.0%100.0%
Bank account98.0%91.4%

Documents where they differ

Invoice extraction · Spanish (79 documents)

DeepSeek V4.1 Flash is more accurate by 6.3 pp. Mistral Small 4 is 1.6× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields98.3%91.9%
Error-free documents77%31%
Per 1,000 documents$0.71$0.44
To fix / 1,000228691
Speed (median)5.8 sec2.2 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Supplier93.7%97.6%
Supplier ID (EIN, IČO…)100.0%98.8%
VAT ID100.0%53.6%
Invoice number100.0%100.0%
Payment reference97.5%88.1%
Invoice date100.0%100.0%
Tax point98.7%69.1%
Due date100.0%100.0%
Net by tax rate88.6%96.4%
Tax by rate100.0%97.6%
Total100.0%98.8%
Currency100.0%100.0%
Bank account98.7%95.2%

Documents where they differ

Invoice extraction · French (74 documents)

DeepSeek V4.1 Flash is more accurate by 5.1 pp. Mistral Small 4 is 1.5× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields99.4%94.2%
Error-free documents92%50%
Per 1,000 documents$0.65$0.45
To fix / 1,00081500
Speed (median)5.7 sec2.1 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Supplier100.0%96.1%
Supplier ID (EIN, IČO…)100.0%93.4%
VAT ID98.7%93.4%
Invoice number100.0%100.0%
Payment reference98.7%85.5%
Invoice date100.0%100.0%
Tax point100.0%92.1%
Due date100.0%100.0%
Net by tax rate100.0%94.7%
Tax by rate100.0%100.0%
Total100.0%100.0%
Currency100.0%94.7%
Bank account94.6%75.0%

Documents where they differ

Email triage · English (US) (150 documents)

DeepSeek V4.1 Flash is more accurate by 7.9 pp. Mistral Small 4 is 2.5× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields97.6%89.7%
Error-free documents79%37%
Per 1,000 documents$0.23$0.09
To fix / 1,000213627
Speed (median)3.8 sec0.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Category100.0%100.0%
Priority96.7%61.3%
Sentiment82.0%71.3%
Customer name100.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%99.3%
Currency100.0%99.3%
Deadline100.0%76.0%

Documents where they differ

  • Omar Cabrera · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 7/9
  • Kyle Schwartz · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 7/9
  • Jennifer Chapman · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 7/9
  • Cody Baldwin · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 7/9
  • Dale Sanchez · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 7/9
  • Leah Douglas · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 7/9
  • Sandra Hogan · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 7/9
  • Robert Lewis · Email · DeepSeek V4.1 Flash 8/9, Mistral Small 4 6/9

Email triage · Czech (150 documents)

DeepSeek V4.1 Flash is more accurate by 9.7 pp. Mistral Small 4 is 2.5× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields97.4%87.7%
Error-free documents77%32%
Per 1,000 documents$0.30$0.12
To fix / 1,000227685
Speed (median)4.2 sec0.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Category100.0%100.0%
Priority98.7%52.4%
Sentiment78.0%72.5%
Customer name100.0%98.7%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%98.0%
Currency100.0%98.0%
Deadline100.0%69.8%

Documents where they differ

Email triage · German (145 documents)

DeepSeek V4.1 Flash is more accurate by 9.2 pp. Mistral Small 4 is 2.8× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields96.3%87.1%
Error-free documents68%29%
Per 1,000 documents$0.30$0.11
To fix / 1,000324706
Speed (median)4.2 sec0.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Category100.0%100.0%
Priority97.2%55.2%
Sentiment69.7%65.0%
Customer name100.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%96.5%
Currency100.0%96.5%
Deadline100.0%70.6%

Documents where they differ

  • Berthold Anders · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 5/9
  • Rolf-Peter Metz · Email · DeepSeek V4.1 Flash 8/9, Mistral Small 4 6/9
  • Swantje Noack · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 7/9
  • Cynthia Hahn · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 7/9
  • Antonietta Wende · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 7/9
  • Marta Kambs · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 7/9
  • Augusta Lange · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 7/9
  • Friedrich Klemm · Email · DeepSeek V4.1 Flash 9/9, Mistral Small 4 7/9

Personal data detection · English (US) (150 documents)

DeepSeek V4.1 Flash is more accurate by 0.2 pp. Mistral Small 4 is 3.7× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields99.6%99.4%
Error-free documents97%96%
Per 1,000 documents$0.29$0.08
To fix / 1,0002740
Speed (median)3.8 sec0.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Names98.7%97.3%
Email addresses100.0%100.0%
Phone numbers100.0%100.0%
Addresses98.7%98.7%
Dates of birth100.0%100.0%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

Personal data detection · Czech (150 documents)

DeepSeek V4.1 Flash is more accurate by 1 pp. Mistral Small 4 is 3.4× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields99.7%98.8%
Error-free documents98%92%
Per 1,000 documents$0.31$0.09
To fix / 1,0002081
Speed (median)4.2 sec0.9 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Names100.0%94.0%
Email addresses100.0%100.0%
Phone numbers100.0%100.0%
Addresses98.0%98.7%
Dates of birth100.0%98.7%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

Personal data detection · German (148 documents)

DeepSeek V4.1 Flash is more accurate by 0.7 pp. Mistral Small 4 is 3.4× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields99.8%99.1%
Error-free documents99%94%
Per 1,000 documents$0.31$0.09
To fix / 1,0001365
Speed (median)3.7 sec0.9 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Names100.0%95.0%
Email addresses100.0%100.0%
Phone numbers100.0%100.0%
Addresses98.7%99.3%
Dates of birth100.0%100.0%
National IDs100.0%100.0%
Bank accounts100.0%99.3%

Documents where they differ

  • Rosi Karz · Text · DeepSeek V4.1 Flash 7/7, Mistral Small 4 6/7
  • Gunnar Zorbach · Text · DeepSeek V4.1 Flash 6/7, Mistral Small 4 7/7

Contract clauses · English (US) (150 documents)

DeepSeek V4.1 Flash is more accurate by 8.5 pp. Mistral Small 4 is 1.9× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields100.0%91.5%
Error-free documents100%43%
Per 1,000 documents$0.32$0.17
To fix / 1,0000567
Speed (median)3.9 sec1.1 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Provider100.0%43.3%
Provider ID100.0%100.0%
Client100.0%46.7%
Client ID100.0%100.0%
Contract type100.0%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ

Contract clauses · Czech (150 documents)

DeepSeek V4.1 Flash is more accurate by 1 pp. Mistral Small 4 is 1.8× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields100.0%99.0%
Error-free documents100%92%
Per 1,000 documents$0.42$0.23
To fix / 1,000080
Speed (median)4.3 sec1.2 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Provider100.0%95.3%
Provider ID100.0%100.0%
Client100.0%95.3%
Client ID100.0%100.0%
Contract type100.0%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%96.7%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ

Contract clauses · German (145 documents)

DeepSeek V4.1 Flash is more accurate by 3.2 pp. Mistral Small 4 is 2.5× cheaper.

MetricDeepSeek V4.1 FlashMistral Small 4
Correct fields97.2%94.0%
Error-free documents77%45%
Per 1,000 documents$0.51$0.21
To fix / 1,000228553
Speed (median)4.6 sec1.2 sec
Valid answers100.0%100.0%

Accuracy per field

FieldDeepSeek V4.1 FlashMistral Small 4
Provider100.0%98.6%
Provider ID81.4%62.4%
Client100.0%98.6%
Client ID82.8%63.1%
Contract type100.0%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%99.3%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ