ModelVerdict

Comparison

Gemini 3.5 Flash Lite vs GPT-6 Sol

Same documents, same prompt: where each model is right, what it really costs and how fast it answers.

At a glance

Task · documentsEnglish (US)CzechGermanSpanishFrench
Invoice extraction99.2% / 99.9%99.5% / 99.9%100.0% / 100.0%98.2% / 99.2%98.7% / 99.9%
Email triage96.3% / 99.0%95.8% / 99.0%94.7% / 98.2%——
Personal data detection99.5% / 99.7%98.1% / 99.7%99.6% / 99.7%——
Contract clauses100.0% / 100.0%99.9% / 100.0%98.0% / 100.0%——

Correct fields: Gemini 3.5 Flash Lite / GPT-6 Sol; the better one in bold. Click a cell to see the details.

Invoice extraction · English (US) (150 documents)

GPT-6 Sol is more accurate by 0.7 pp. Gemini 3.5 Flash Lite is 11.1× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields99.2%99.9%
Error-free documents92%99%
Per 1,000 documents$0.87$9.65
To fix / 1,000807
Speed (median)1.7 sec4.1 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Supplier100.0%100.0%
Supplier ID (EIN, IČO…)100.0%100.0%
Invoice number100.0%100.0%
Payment reference96.7%100.0%
Invoice date97.3%100.0%
Due date99.3%100.0%
Net by tax rate98.0%100.0%
Tax by rate100.0%100.0%
Total100.0%100.0%
Currency100.0%100.0%
Bank account100.0%99.3%

Documents where they differ

Invoice extraction · Czech (150 documents)

GPT-6 Sol is more accurate by 0.4 pp. Gemini 3.5 Flash Lite is 9.8× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields99.5%99.9%
Error-free documents93%99%
Per 1,000 documents$1.03$10.12
To fix / 1,0006713
Speed (median)1.8 sec3.9 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Supplier100.0%99.3%
Supplier ID (EIN, IČO…)100.0%100.0%
VAT ID100.0%100.0%
Invoice number100.0%100.0%
Payment reference95.3%99.3%
Invoice date100.0%100.0%
Tax point100.0%100.0%
Due date100.0%100.0%
Net by tax rate100.0%100.0%
Tax by rate100.0%100.0%
Total100.0%100.0%
Currency98.7%100.0%
Bank account99.3%100.0%

Documents where they differ

Invoice extraction · German (150 documents)

Both are equally accurate. Gemini 3.5 Flash Lite is 10.3× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields100.0%100.0%
Error-free documents100%99%
Per 1,000 documents$1.03$10.65
To fix / 1,00007
Speed (median)1.5 sec4.9 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Supplier100.0%100.0%
Supplier ID (EIN, IČO…)100.0%100.0%
VAT ID100.0%100.0%
Invoice number100.0%100.0%
Payment reference100.0%100.0%
Invoice date100.0%100.0%
Tax point100.0%100.0%
Due date100.0%100.0%
Net by tax rate100.0%100.0%
Tax by rate100.0%100.0%
Total100.0%100.0%
Currency100.0%100.0%
Bank account100.0%99.3%

Documents where they differ

Both models got the same number of fields right on every example document.

Invoice extraction · Spanish (100 documents)

GPT-6 Sol is more accurate by 0.9 pp. Gemini 3.5 Flash Lite is 10.3× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields98.2%99.2%
Error-free documents79%89%
Per 1,000 documents$1.05$10.76
To fix / 1,000210110
Speed (median)1.6 sec5.7 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Supplier98.0%98.0%
Supplier ID (EIN, IČO…)100.0%100.0%
VAT ID83.0%100.0%
Invoice number100.0%100.0%
Payment reference99.0%100.0%
Invoice date99.0%100.0%
Tax point98.0%100.0%
Due date100.0%100.0%
Net by tax rate100.0%92.0%
Tax by rate100.0%100.0%
Total100.0%100.0%
Currency100.0%100.0%
Bank account100.0%99.0%

Documents where they differ

Invoice extraction · French (100 documents)

GPT-6 Sol is more accurate by 1.2 pp. Gemini 3.5 Flash Lite is 10.4× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields98.7%99.9%
Error-free documents85%99%
Per 1,000 documents$1.07$11.05
To fix / 1,00015010
Speed (median)1.5 sec5.9 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Supplier98.0%100.0%
Supplier ID (EIN, IČO…)100.0%100.0%
VAT ID100.0%100.0%
Invoice number99.0%100.0%
Payment reference91.0%99.0%
Invoice date98.0%100.0%
Tax point98.0%100.0%
Due date100.0%100.0%
Net by tax rate100.0%100.0%
Tax by rate100.0%100.0%
Total100.0%100.0%
Currency100.0%100.0%
Bank account99.0%100.0%

Documents where they differ

Email triage · English (US) (150 documents)

GPT-6 Sol is more accurate by 2.7 pp. Gemini 3.5 Flash Lite is 5.8× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields96.3%99.0%
Error-free documents69%92%
Per 1,000 documents$0.42$2.44
To fix / 1,00031380
Speed (median)0.7 sec2.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Category100.0%100.0%
Priority84.0%98.0%
Sentiment82.7%93.3%
Customer name100.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

  • Robert Lewis · Email · Gemini 3.5 Flash Lite 7/9, GPT-6 Sol 9/9
  • Luke Sims · Email · Gemini 3.5 Flash Lite 8/9, GPT-6 Sol 9/9
  • Russell Bates · Email · Gemini 3.5 Flash Lite 8/9, GPT-6 Sol 9/9
  • Sheila Evans · Email · Gemini 3.5 Flash Lite 8/9, GPT-6 Sol 9/9
  • Jane Rubio · Email · Gemini 3.5 Flash Lite 8/9, GPT-6 Sol 9/9
  • Laurie Knight · Email · Gemini 3.5 Flash Lite 8/9, GPT-6 Sol 9/9
  • David Patel · Email · Gemini 3.5 Flash Lite 8/9, GPT-6 Sol 9/9
  • Scott Davis · Email · Gemini 3.5 Flash Lite 8/9, GPT-6 Sol 9/9

Email triage · Czech (150 documents)

GPT-6 Sol is more accurate by 3.2 pp. Gemini 3.5 Flash Lite is 6.3× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields95.8%99.0%
Error-free documents64%91%
Per 1,000 documents$0.51$3.19
To fix / 1,00036093
Speed (median)0.7 sec2.8 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Category100.0%100.0%
Priority80.0%98.0%
Sentiment84.0%92.7%
Customer name98.0%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

Email triage · German (150 documents)

GPT-6 Sol is more accurate by 3.5 pp. Gemini 3.5 Flash Lite is 5.7× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields94.7%98.2%
Error-free documents57%84%
Per 1,000 documents$0.48$2.73
To fix / 1,000433160
Speed (median)0.8 sec2.9 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Category100.0%100.0%
Priority76.0%97.3%
Sentiment76.7%86.7%
Customer name99.3%100.0%
Order number100.0%100.0%
Invoice number100.0%100.0%
Amount100.0%100.0%
Currency100.0%100.0%
Deadline100.0%100.0%

Documents where they differ

Personal data detection · English (US) (150 documents)

GPT-6 Sol is more accurate by 0.2 pp. Gemini 3.5 Flash Lite is 5.1× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields99.5%99.7%
Error-free documents97%98%
Per 1,000 documents$0.41$2.09
To fix / 1,0002720
Speed (median)0.8 sec2.6 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Names100.0%100.0%
Email addresses99.3%100.0%
Phone numbers100.0%100.0%
Addresses98.7%98.0%
Dates of birth98.7%100.0%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

Personal data detection · Czech (150 documents)

GPT-6 Sol is more accurate by 1.6 pp. Gemini 3.5 Flash Lite is 4.9× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields98.1%99.7%
Error-free documents88%98%
Per 1,000 documents$0.45$2.22
To fix / 1,00012020
Speed (median)0.8 sec2.5 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Names91.3%100.0%
Email addresses100.0%100.0%
Phone numbers100.0%100.0%
Addresses99.3%98.0%
Dates of birth96.0%100.0%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

Personal data detection · German (150 documents)

GPT-6 Sol is more accurate by 0.1 pp. Gemini 3.5 Flash Lite is 4.7× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields99.6%99.7%
Error-free documents97%98%
Per 1,000 documents$0.45$2.13
To fix / 1,0002720
Speed (median)0.8 sec2.6 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Names97.3%100.0%
Email addresses100.0%100.0%
Phone numbers100.0%100.0%
Addresses100.0%98.0%
Dates of birth100.0%100.0%
National IDs100.0%100.0%
Bank accounts100.0%100.0%

Documents where they differ

  • Rosi Karz · Text · Gemini 3.5 Flash Lite 6/7, GPT-6 Sol 7/7
  • Fritz Rogner · Text · Gemini 3.5 Flash Lite 6/7, GPT-6 Sol 7/7

Contract clauses · English (US) (150 documents)

Both are equally accurate. Gemini 3.5 Flash Lite is 4.8× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields100.0%100.0%
Error-free documents99%100%
Per 1,000 documents$0.69$3.33
To fix / 1,00070
Speed (median)1.0 sec2.5 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Provider100.0%100.0%
Provider ID100.0%100.0%
Client100.0%100.0%
Client ID100.0%100.0%
Contract type99.3%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ

Both models got the same number of fields right on every example document.

Contract clauses · Czech (150 documents)

GPT-6 Sol is more accurate by 0.1 pp. Gemini 3.5 Flash Lite is 5.4× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields99.9%100.0%
Error-free documents98%100%
Per 1,000 documents$0.85$4.62
To fix / 1,000200
Speed (median)0.9 sec2.0 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Provider99.3%100.0%
Provider ID100.0%100.0%
Client99.3%100.0%
Client ID100.0%100.0%
Contract type99.3%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date100.0%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ

Contract clauses · German (150 documents)

GPT-6 Sol is more accurate by 2 pp. Gemini 3.5 Flash Lite is 5.5× cheaper.

MetricGemini 3.5 Flash LiteGPT-6 Sol
Correct fields98.0%100.0%
Error-free documents84%100%
Per 1,000 documents$0.79$4.36
To fix / 1,0001600
Speed (median)1.0 sec2.9 sec
Valid answers100.0%100.0%

Accuracy per field

FieldGemini 3.5 Flash LiteGPT-6 Sol
Provider100.0%100.0%
Provider ID86.0%100.0%
Client100.0%100.0%
Client ID88.7%100.0%
Contract type100.0%100.0%
Price (net)100.0%100.0%
Currency100.0%100.0%
Billing period100.0%100.0%
Effective date100.0%100.0%
End date99.3%100.0%
Notice period (months)100.0%100.0%
Late-payment penalty (% per day)100.0%100.0%
Governing law100.0%100.0%

Documents where they differ