Charles Johnson
Texte (le modèle a reçu exactement ce texte)
Ticket #61554 · Damaged delivery Customer: Charles Johnson Email: charles.johnson@mail.example Phone: (748) 555-0041 The customer reports that the goods from order SO-360001 arrived damaged and asks for a replacement. The replacement ships no later than March 3, 2026. Assigned to: Robert Rich. Copy sent to info@kelly.example.
Verdict
Le moins cher sans erreur : Mistral Small 4, à 0,06 € pour 1 000 documents.
- Claude Sonnet 5 ne fait aucune erreur non plus, mais coûte 47,1× plus cher.
Prompt soumis à chaque modèle
Find all personal data of natural persons in the text below (for anonymisation) and return only JSON with these keys, each a list of strings (an empty list when there is none): person_names full names of people, each person once, as written in the text email_addresses email addresses of people phone_numbers phone numbers of people, as written postal_addresses home or delivery addresses of people, as written (street, city, ZIP) birth_dates dates of birth (YYYY-MM-DD) national_ids national identification numbers (e.g. SSN, birth numbers) bank_accounts bank account numbers of people, as written Rules: - Only data of natural persons. Company names, company registration or tax numbers (EIN, IČO, VAT), generic company addresses such as info@ or support@, order and ticket numbers are not personal data: leave them out. - Dates that are not dates of birth (meetings, deliveries, start dates) are not personal data. - Do not invent or complete values; copy them from the text.
Notre notation
Correspondance exacte par champ, après normalisation des dates, des montants et des espaces. Les diacritiques manquants comptent comme une erreur. Le coût correspond à la consommation réelle de tokens de cette exécution, convertie au taux indiqué en bas de page.
Ce que chaque modèle a extrait
| Champ | Valeur correcte | Mistral Small 47 / 7 champs | Gemma 4 31B7 / 7 champs | GPT-6 Luna7 / 7 champs | Qwen3.8 Flash7 / 7 champs | DeepSeek V4.1 Flash7 / 7 champs | Gemini 3.5 Flash Lite7 / 7 champs | Mistral Medium 3.57 / 7 champs | GPT-6 Sol7 / 7 champs | Gemini 3.8 Flash7 / 7 champs | Claude Sonnet 57 / 7 champs |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Noms | Charles Johnson; Robert Rich | Charles Johnson; Robert Rich (correct) | Charles Johnson; Robert Rich (correct) | Charles Johnson; Robert Rich (correct) | Charles Johnson; Robert Rich (correct) | Charles Johnson; Robert Rich (correct) | Charles Johnson; Robert Rich (correct) | Charles Johnson; Robert Rich (correct) | Charles Johnson; Robert Rich (correct) | Charles Johnson; Robert Rich (correct) | Charles Johnson; Robert Rich (correct) |
| Adresses e-mail | charles.johnson@mail.example | charles.johnson@mail.example (correct) | charles.johnson@mail.example (correct) | charles.johnson@mail.example (correct) | charles.johnson@mail.example (correct) | charles.johnson@mail.example (correct) | charles.johnson@mail.example (correct) | charles.johnson@mail.example (correct) | charles.johnson@mail.example (correct) | charles.johnson@mail.example (correct) | charles.johnson@mail.example (correct) |
| Numéros de téléphone | (748) 555-0041 | (748) 555-0041 (correct) | (748) 555-0041 (correct) | (748) 555-0041 (correct) | (748) 555-0041 (correct) | (748) 555-0041 (correct) | (748) 555-0041 (correct) | (748) 555-0041 (correct) | (748) 555-0041 (correct) | (748) 555-0041 (correct) | (748) 555-0041 (correct) |
| Adresses | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Dates de naissance | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Numéros d'identification | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Comptes bancaires | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Tokens | entrée / sortie | 335 / 73 | 360 / 76 | 448 / 104 | 658 / 429 | 580 / 332 | 348 / 110 | 335 / 73 | 448 / 60 | 348 / 389 | 1 054 / 103 |
| dont raisonnement caché | facturé comme sortie | 0 | 0 | 42 | 325 | 264 | 0 | 0 | 0 | 325 | 0 |
| dont depuis le cache | entrée facturée à prix réduit | 203 | 246 | 0 | 512 | 366 | 0 | 0 | 0 | 0 | 0 |
| Coût de ce document | cette exécution | 0,0001 € | 0,0001 € | 0,0001 € | 0,0002 € | 0,0002 € | 0,0003 € | 0,0010 € | 0,0014 € | 0,0016 € | 0,0029 € |
| Pour 1 000 documents | pour ce même type de document | 0,06 € | 0,07 € | 0,09 € | 0,21 € | 0,25 € | 0,35 € | 0,97 € | 1,38 € | 1,58 € | 2,89 € |
| Latence | cette exécution | 0,8 s | 3,5 s | 1,5 s | 13,5 s | 4,1 s | 0,7 s | 0,7 s | 2,4 s | 1,8 s | 2,7 s |