Denise Jones
Texte (le modèle a reçu exactement ce texte)
Meeting minutes Attendees: Denise Jones, Brian Jackson For the vendor: Nelson, Guzman and Wang, EIN 34-4732436 1. The budget for next quarter was approved without changes. 2. Denise Jones will compare the offers before the next meeting. 3. Brian Jackson will confirm the delivery dates. Minutes also sent to office@nelson-guzman.example.
Verdict
Le moins cher sans erreur : Gemma 4 31B, à 0,06 € pour 1 000 documents.
- Claude Sonnet 5 ne fait aucune erreur non plus, mais coûte 42,6× plus cher.
- Mistral Small 4 est 1,2× moins cher, mais : valeur inventée (Noms).
Prompt soumis à chaque modèle
Find all personal data of natural persons in the text below (for anonymisation) and return only JSON with these keys, each a list of strings (an empty list when there is none): person_names full names of people, each person once, as written in the text email_addresses email addresses of people phone_numbers phone numbers of people, as written postal_addresses home or delivery addresses of people, as written (street, city, ZIP) birth_dates dates of birth (YYYY-MM-DD) national_ids national identification numbers (e.g. SSN, birth numbers) bank_accounts bank account numbers of people, as written Rules: - Only data of natural persons. Company names, company registration or tax numbers (EIN, IČO, VAT), generic company addresses such as info@ or support@, order and ticket numbers are not personal data: leave them out. - Dates that are not dates of birth (meetings, deliveries, start dates) are not personal data. - Do not invent or complete values; copy them from the text.
Notre notation
Correspondance exacte par champ, après normalisation des dates, des montants et des espaces. Les diacritiques manquants comptent comme une erreur. Le coût correspond à la consommation réelle de tokens de cette exécution, convertie au taux indiqué en bas de page.
Ce que chaque modèle a extrait
| Champ | Valeur correcte | Mistral Small 46 / 7 champs | Gemma 4 31B7 / 7 champs | GPT-6 Luna7 / 7 champs | Qwen3.8 Flash7 / 7 champs | DeepSeek V4.1 Flash7 / 7 champs | Gemini 3.5 Flash Lite7 / 7 champs | Mistral Medium 3.57 / 7 champs | Gemini 3.8 Flash7 / 7 champs | GPT-6 Sol7 / 7 champs | Claude Sonnet 57 / 7 champs |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Noms | Denise Jones; Brian Jackson | Denise Jones; Brian Jackson; Nelson; Guzman; Wangvaleur inventée | Denise Jones; Brian Jackson (correct) | Denise Jones; Brian Jackson (correct) | Denise Jones; Brian Jackson (correct) | Denise Jones; Brian Jackson (correct) | Denise Jones; Brian Jackson (correct) | Denise Jones; Brian Jackson (correct) | Denise Jones; Brian Jackson (correct) | Denise Jones; Brian Jackson (correct) | Denise Jones; Brian Jackson (correct) |
| Adresses e-mail | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Numéros de téléphone | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Adresses | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Dates de naissance | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Numéros d'identification | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Comptes bancaires | — | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) | — (correct) |
| Tokens | entrée / sortie | 321 / 62 | 343 / 52 | 443 / 98 | 643 / 318 | 575 / 245 | 331 / 75 | 321 / 50 | 331 / 343 | 443 / 87 | 1 057 / 82 |
| dont raisonnement caché | facturé comme sortie | 0 | 0 | 52 | 247 | 194 | 0 | 0 | 301 | 41 | 0 |
| dont depuis le cache | entrée facturée à prix réduit | 203 | 251 | 0 | 512 | 370 | 0 | 139 | 0 | 0 | 0 |
| Coût de ce document | cette exécution | 0,0001 € | 0,0001 € | 0,0001 € | 0,0002 € | 0,0002 € | 0,0003 € | 0,0008 € | 0,0014 € | 0,0016 € | 0,0027 € |
| Pour 1 000 documents | pour ce même type de document | 0,05 € | 0,06 € | 0,09 € | 0,16 € | 0,19 € | 0,26 € | 0,79 € | 1,41 € | 1,62 € | 2,70 € |
| Latence | cette exécution | 0,7 s | 1,1 s | 1,8 s | 5,7 s | 3,8 s | 0,6 s | 0,6 s | 1,7 s | 2,4 s | 2,2 s |