ModelVerdict

Sheena Flowers

English (US)Text7 fields

Document en-p0021 · layout hr · 7 fields · public part of the dataset · Same invoice in Czech → · Report an error in this example

Text (the model got exactly this text)

Employee record – Reyes, Sanchez and Torres

Employee: Sheena Flowers
Date of birth: November 17, 1991
SSN: 959-86-3108
Home address: 977 Gonzalez Ferry, West Cynthia, AR 55305
Phone: (940) 555-0034
Personal email: sheena.flowers@mail.example
Direct deposit account: 250086570342

Hired as staff accountant starting May 5, 2026, 90-day probation period.

Employer: Reyes, Sanchez and Torres, EIN 95-5510638

Verdict

Cheapest without an error: Mistral Small 4 at $0.10 per 1,000 documents.

  • Claude Sonnet 5 is also error-free but 34.8× more expensive.

Prompt given to every model

Find all personal data of natural persons in the text below (for anonymisation) and return only
JSON with these keys, each a list of strings (an empty list when there is none):

person_names       full names of people, each person once, as written in the text
email_addresses    email addresses of people
phone_numbers      phone numbers of people, as written
postal_addresses   home or delivery addresses of people, as written (street, city, ZIP)
birth_dates        dates of birth (YYYY-MM-DD)
national_ids       national identification numbers (e.g. SSN, birth numbers)
bank_accounts      bank account numbers of people, as written

Rules:
- Only data of natural persons. Company names, company registration or tax numbers (EIN, IČO,
  VAT), generic company addresses such as info@ or support@, order and ticket numbers are not
  personal data: leave them out.
- Dates that are not dates of birth (meetings, deliveries, start dates) are not personal data.
- Do not invent or complete values; copy them from the text.

How we score

Exact match per field after normalising dates, amounts and whitespace. Missing diacritics count as an error. Cost is the real token spend of this run, converted at the rate shown in the footer.

What each model extracted

FieldCorrect valueMistral Small 47 / 7 fieldsGemma 4 31B7 / 7 fieldsGPT-6 Luna7 / 7 fieldsDeepSeek V4.1 Flash7 / 7 fieldsQwen3.8 Flash7 / 7 fieldsGemini 3.5 Flash Lite7 / 7 fieldsMistral Medium 3.57 / 7 fieldsGemini 3.8 Flash7 / 7 fieldsGPT-6 Sol7 / 7 fieldsClaude Sonnet 57 / 7 fields
NamesSheena FlowersSheena Flowers (correct)Sheena Flowers (correct)Sheena Flowers (correct)Sheena Flowers (correct)Sheena Flowers (correct)Sheena Flowers (correct)Sheena Flowers (correct)Sheena Flowers (correct)Sheena Flowers (correct)Sheena Flowers (correct)
Email addressessheena.flowers@mail.examplesheena.flowers@mail.example (correct)sheena.flowers@mail.example (correct)sheena.flowers@mail.example (correct)sheena.flowers@mail.example (correct)sheena.flowers@mail.example (correct)sheena.flowers@mail.example (correct)sheena.flowers@mail.example (correct)sheena.flowers@mail.example (correct)sheena.flowers@mail.example (correct)sheena.flowers@mail.example (correct)
Phone numbers(940) 555-0034(940) 555-0034 (correct)(940) 555-0034 (correct)(940) 555-0034 (correct)(940) 555-0034 (correct)(940) 555-0034 (correct)(940) 555-0034 (correct)(940) 555-0034 (correct)(940) 555-0034 (correct)(940) 555-0034 (correct)(940) 555-0034 (correct)
Addresses977 Gonzalez Ferry, West Cynthia, AR 55305977 Gonzalez Ferry, West Cynthia, AR 55305 (correct)977 Gonzalez Ferry, West Cynthia, AR 55305 (correct)977 Gonzalez Ferry, West Cynthia, AR 55305 (correct)977 Gonzalez Ferry, West Cynthia, AR 55305 (correct)977 Gonzalez Ferry, West Cynthia, AR 55305 (correct)977 Gonzalez Ferry, West Cynthia, AR 55305 (correct)977 Gonzalez Ferry, West Cynthia, AR 55305 (correct)977 Gonzalez Ferry, West Cynthia, AR 55305 (correct)977 Gonzalez Ferry, West Cynthia, AR 55305 (correct)977 Gonzalez Ferry, West Cynthia, AR 55305 (correct)
Dates of birth1991-11-171991-11-17 (correct)1991-11-17 (correct)1991-11-17 (correct)1991-11-17 (correct)1991-11-17 (correct)1991-11-17 (correct)1991-11-17 (correct)1991-11-17 (correct)1991-11-17 (correct)1991-11-17 (correct)
National IDs959-86-3108959-86-3108 (correct)959-86-3108 (correct)959-86-3108 (correct)959-86-3108 (correct)959-86-3108 (correct)959-86-3108 (correct)959-86-3108 (correct)959-86-3108 (correct)959-86-3108 (correct)959-86-3108 (correct)
Bank accounts250086570342250086570342 (correct)250086570342 (correct)250086570342 (correct)250086570342 (correct)250086570342 (correct)250086570342 (correct)250086570342 (correct)250086570342 (correct)250086570342 (correct)250086570342 (correct)
Tokensinput / output394 / 122415 / 124485 / 127618 / 252713 / 858403 / 181394 / 122403 / 464485 / 1611,109 / 143
of which hidden reasoningbilled as output003715768300354710
of which from cacheinput billed at a discount20324903665120139000
Cost of this documentthis run$0.0001$0.0001$0.0001$0.0002$0.0004$0.0006$0.0015$0.0020$0.0026$0.0036
Per 1,000 documentsfor the same kind of document$0.10$0.11$0.11$0.22$0.44$0.57$1.51$2.04$2.58$3.65
Latencythis run1 s7.6 s1.7 s3 s12.9 s0.9 s1.3 s2.2 s3.5 s2.3 s