ModelVerdict

Comparison

Mistral Small 4 vs Qwen3.8 Flash

Same documents, same prompt: where each model is right, what it really costs and how fast it answers.

At a glance

Task · documentsEnglish (US)CzechGermanSpanishFrench
Invoice extraction95.6% / 82.4%93.6% / 91.8%94.6% / 93.5%91.9% / 87.9%94.2% / 90.6%
Email triage89.7% / 97.5%87.7% / 98.5%87.1% / 97.9%——
Personal data detection99.4% / 99.2%98.8% / 97.0%99.1% / 99.6%——
Contract clauses91.5% / 95.1%99.0% / 99.9%94.0% / 98.0%——

Correct fields: Mistral Small 4 / Qwen3.8 Flash; the better one in bold. Click a cell to see the details.

Invoice extraction · English (US) (150 documents)

Mistral Small 4 is more accurate by 13.2 pp. Mistral Small 4 is 2.8× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields95.6%82.4%
Error-free documents58%57%
Per 1,000 documents$0.41$1.15
To fix / 1,000420427
Speed (median)1.8 sec17.4 sec
Valid answers100.0%90.7%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Supplier100.0%85.3%
Supplier ID (EIN, IČO…)99.3%88.7%
Invoice number100.0%85.3%
Payment reference87.3%79.3%
Invoice date97.3%85.3%
Due date98.7%85.3%
Net by tax rate72.0%70.0%
Tax by rate99.3%76.0%
Total100.0%85.3%
Currency99.3%84.0%
Bank account98.0%81.3%

Documents where they differ

Invoice extraction · Czech (150 documents)

Mistral Small 4 is more accurate by 1.8 pp. Mistral Small 4 is 2.3× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields93.6%91.8%
Error-free documents56%77%
Per 1,000 documents$0.44$1.02
To fix / 1,000440233
Speed (median)2.0 sec17.0 sec
Valid answers100.0%96.7%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Supplier91.3%93.3%
Supplier ID (EIN, IČO…)92.7%94.0%
VAT ID94.0%94.0%
Invoice number100.0%94.7%
Payment reference97.3%94.0%
Invoice date98.0%94.7%
Tax point76.0%94.7%
Due date97.3%94.7%
Net by tax rate90.0%80.0%
Tax by rate94.7%80.7%
Total98.7%94.0%
Currency97.3%94.0%
Bank account90.0%90.7%

Documents where they differ

Invoice extraction · German (140 documents)

Mistral Small 4 is more accurate by 1.1 pp. Mistral Small 4 is 2.6× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields94.6%93.5%
Error-free documents50%87%
Per 1,000 documents$0.44$1.12
To fix / 1,000500127
Speed (median)2.0 sec19.0 sec
Valid answers100.0%94.0%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Supplier98.6%94.0%
Supplier ID (EIN, IČO…)80.0%94.0%
VAT ID92.9%94.0%
Invoice number100.0%92.7%
Payment reference87.1%88.7%
Invoice date100.0%94.0%
Tax point87.9%94.0%
Due date98.6%94.0%
Net by tax rate94.3%94.0%
Tax by rate99.3%94.0%
Total100.0%94.0%
Currency100.0%94.0%
Bank account91.4%94.0%

Documents where they differ

Invoice extraction · Spanish (84 documents)

Mistral Small 4 is more accurate by 4 pp. Mistral Small 4 is 3.1× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields91.9%87.9%
Error-free documents31%74%
Per 1,000 documents$0.44$1.40
To fix / 1,000691260
Speed (median)2.2 sec22.3 sec
Valid answers100.0%90.0%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Supplier97.6%86.0%
Supplier ID (EIN, IČO…)98.8%89.0%
VAT ID53.6%86.0%
Invoice number100.0%89.0%
Payment reference88.1%85.0%
Invoice date100.0%89.0%
Tax point69.1%87.0%
Due date100.0%89.0%
Net by tax rate96.4%86.0%
Tax by rate97.6%90.0%
Total98.8%89.0%
Currency100.0%89.0%
Bank account95.2%89.0%

Documents where they differ

Invoice extraction · French (76 documents)

Mistral Small 4 is more accurate by 3.6 pp. Mistral Small 4 is 2.8× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields94.2%90.6%
Error-free documents50%82%
Per 1,000 documents$0.45$1.23
To fix / 1,000500180
Speed (median)2.1 sec19.8 sec
Valid answers100.0%95.0%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Supplier96.1%91.0%
Supplier ID (EIN, IČO…)93.4%91.0%
VAT ID93.4%91.0%
Invoice number100.0%90.0%
Payment reference85.5%86.0%
Invoice date100.0%91.0%
Tax point92.1%92.0%
Due date100.0%89.0%
Net by tax rate94.7%91.0%
Tax by rate100.0%94.0%
Total100.0%91.0%
Currency94.7%91.0%
Bank account75.0%90.0%

Documents where they differ

Email triage · English (US) (150 documents)

Qwen3.8 Flash is more accurate by 7.8 pp. Mistral Small 4 is 3.2× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields89.7%97.5%
Error-free documents37%79%
Per 1,000 documents$0.09$0.30
To fix / 1,000627213
Speed (median)0.8 sec8.9 sec
Valid answers100.0%100.0%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Category100.0%100.0%
Priority61.3%97.3%
Sentiment71.3%80.7%
Customer name100.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount99.3%100.0%
Currency99.3%100.0%
Deadline76.0%99.3%

Documents where they differ

  • Robert Lewis · Email · Mistral Small 4 6/9, Qwen3.8 Flash 9/9
  • Omar Cabrera · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
  • Russell Bates · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
  • Kyle Schwartz · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
  • Jennifer Chapman · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
  • Cody Baldwin · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
  • Dale Sanchez · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9
  • Leah Douglas · Email · Mistral Small 4 7/9, Qwen3.8 Flash 9/9

Email triage · Czech (149 documents)

Qwen3.8 Flash is more accurate by 10.8 pp. Mistral Small 4 is 3.8× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields87.7%98.5%
Error-free documents32%87%
Per 1,000 documents$0.12$0.45
To fix / 1,000685133
Speed (median)0.8 sec13.0 sec
Valid answers100.0%100.0%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Category100.0%100.0%
Priority52.4%99.3%
Sentiment72.5%88.7%
Customer name98.7%99.3%
Order number100.0%99.3%
Invoice number100.0%100.0%
Amount98.0%100.0%
Currency98.0%100.0%
Deadline69.8%100.0%

Documents where they differ

Email triage · German (143 documents)

Qwen3.8 Flash is more accurate by 10.8 pp. Mistral Small 4 is 3.7× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields87.1%97.9%
Error-free documents29%81%
Per 1,000 documents$0.11$0.39
To fix / 1,000706187
Speed (median)0.8 sec12.1 sec
Valid answers100.0%100.0%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Category100.0%100.0%
Priority55.2%96.0%
Sentiment65.0%84.7%
Customer name100.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount96.5%100.0%
Currency96.5%100.0%
Deadline70.6%100.0%

Documents where they differ

Personal data detection · English (US) (149 documents)

Mistral Small 4 is more accurate by 0.2 pp. Mistral Small 4 is 3.6× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields99.4%99.2%
Error-free documents96%99%
Per 1,000 documents$0.08$0.28
To fix / 1,0004013
Speed (median)0.8 sec7.5 sec
Valid answers100.0%100.0%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Names97.3%99.3%
Email addresses100.0%99.3%
Phone numbers100.0%99.3%
Addresses98.7%98.7%
Dates of birth100.0%99.3%
National IDs100.0%99.3%
Bank accounts100.0%99.3%

Documents where they differ

Personal data detection · Czech (149 documents)

Mistral Small 4 is more accurate by 1.8 pp. Mistral Small 4 is 4.4× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields98.8%97.0%
Error-free documents92%89%
Per 1,000 documents$0.09$0.41
To fix / 1,00081113
Speed (median)0.9 sec9.6 sec
Valid answers100.0%99.3%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Names94.0%90.7%
Email addresses100.0%98.0%
Phone numbers100.0%97.3%
Addresses98.7%96.7%
Dates of birth98.7%98.0%
National IDs100.0%99.3%
Bank accounts100.0%98.7%

Documents where they differ

Personal data detection · German (139 documents)

Qwen3.8 Flash is more accurate by 0.5 pp. Mistral Small 4 is 4× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields99.1%99.6%
Error-free documents94%99%
Per 1,000 documents$0.09$0.36
To fix / 1,000657
Speed (median)0.9 sec12.2 sec
Valid answers100.0%100.0%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Names95.0%99.3%
Email addresses100.0%99.3%
Phone numbers100.0%99.3%
Addresses99.3%99.3%
Dates of birth100.0%100.0%
National IDs100.0%100.0%
Bank accounts99.3%100.0%

Documents where they differ

  • Rosi Karz · Text · Mistral Small 4 6/7, Qwen3.8 Flash 7/7

Contract clauses · English (US) (150 documents)

Qwen3.8 Flash is more accurate by 3.6 pp. Mistral Small 4 is 3.6× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields91.5%95.1%
Error-free documents43%69%
Per 1,000 documents$0.17$0.62
To fix / 1,000567307
Speed (median)1.1 sec14.1 sec
Valid answers100.0%100.0%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Provider43.3%69.3%
Provider ID100.0%100.0%
Client46.7%69.3%
Client ID100.0%100.0%
Contract type100.0%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%99.3%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%99.3%
Governing law100.0%99.3%

Documents where they differ

Contract clauses · Czech (150 documents)

Qwen3.8 Flash is more accurate by 0.9 pp. Mistral Small 4 is 2.8× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields99.0%99.9%
Error-free documents92%99%
Per 1,000 documents$0.23$0.63
To fix / 1,0008013
Speed (median)1.2 sec13.6 sec
Valid answers100.0%100.0%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Provider95.3%100.0%
Provider ID100.0%100.0%
Client95.3%100.0%
Client ID100.0%100.0%
Contract type100.0%98.7%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date96.7%100.0%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ

Contract clauses · German (141 documents)

Qwen3.8 Flash is more accurate by 4 pp. Mistral Small 4 is 3.8× cheaper.

MetricMistral Small 4Qwen3.8 Flash
Correct fields94.0%98.0%
Error-free documents45%87%
Per 1,000 documents$0.21$0.78
To fix / 1,000553127
Speed (median)1.2 sec19.7 sec
Valid answers100.0%99.3%

Accuracy per field

FieldMistral Small 4Qwen3.8 Flash
Provider98.6%99.3%
Provider ID62.4%94.7%
Client98.6%99.3%
Client ID63.1%94.7%
Contract type100.0%99.3%
Price (net)100.0%99.3%
Currency100.0%99.3%
Billing period100.0%99.3%
Effective date99.3%99.3%
End date100.0%99.3%
Notice period (months)100.0%99.3%
Late-payment penalty (% per day)100.0%99.3%
Governing law100.0%91.3%

Documents where they differ