Dom/anonymisation
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: Propagation globale sélective v2 - Normalisation dates + Multi-pass

Browse Source 
- Normalisation agressive des dates : génère 4 variations (/, ., -, espaces)
- Remplacement multi-pass : avec/sans contexte 'Né(e) le'
- Amélioration force_term : case-insensitive + word boundaries
- Outil de validation post-anonymisation
- Tests : 162 CRO, 0 fuite dates, 0 fuite CHCB (100% succès)
- Temps: 0.1s/doc

Résout les 36 CRO avec fuites identifiées dans l'audit initial.
This commit is contained in:
Domi31tls
2026-03-02 12:22:58 +01:00
parent 871221ea56
commit f92da4d54e
251 changed files with 4676 additions and 23 deletions
Download Patch File Download Diff File Expand all files Collapse all files

19
tests/ground_truth/pdfs/test_all_cro/CRO 23134370.audit.jsonl Normal file
View File

@@ -0,0 +1,19 @@
{"page": 0, "kind": "NOM", "original": "Françoise LASSERRE", "placeholder": "[NOM]", "bbox_hint": null}
{"page": 0, "kind": "ADRESSE", "original": "31 bis, avenue Salvador Allende", "placeholder": "[ADRESSE]", "bbox_hint": null}
{"page": 0, "kind": "CODE_POSTAL", "original": "40220 TARNOS", "placeholder": "[CODE_POSTAL]", "bbox_hint": null}
{"page": 0, "kind": "NOM", "original": "Franck AUDEMAR", "placeholder": "[NOM]", "bbox_hint": null}
{"page": 0, "kind": "force_term", "original": "CHCB", "placeholder": "[MASK]", "bbox_hint": null}
{"page": 0, "kind": "NOM", "original": "MARIE GELOS", "placeholder": "[NOM]", "bbox_hint": null}
{"page": 0, "kind": "DATE_NAISSANCE", "original": "Née le 23/05/1957", "placeholder": "[DATE_NAISSANCE]", "bbox_hint": null}
{"page": 0, "kind": "NOM", "original": "LACLAU LACROUTS", "placeholder": "[NOM]", "bbox_hint": null}
{"page": 0, "kind": "NOM", "original": "KUHN", "placeholder": "[NOM]", "bbox_hint": null}
{"page": 0, "kind": "ADRESSE", "original": "31 bis, avenue Salvador Allende", "placeholder": "[ADRESSE]", "bbox_hint": null}
{"page": 0, "kind": "NOM", "original": "Françoise LASSERRE", "placeholder": "[NOM]", "bbox_hint": null}
{"page": 0, "kind": "CODE_POSTAL", "original": "40220 TARNOS", "placeholder": "[CODE_POSTAL]", "bbox_hint": null}
{"page": 0, "kind": "NOM", "original": "LACLAU LACROUTS", "placeholder": "[NOM]", "bbox_hint": null}
{"page": 0, "kind": "NOM", "original": "KUHN", "placeholder": "[NOM]", "bbox_hint": null}
{"page": -1, "kind": "force_term_GLOBAL", "original": "CHCB", "placeholder": "[MASK]", "bbox_hint": null}
{"page": -1, "kind": "DATE_NAISSANCE_GLOBAL", "original": "23/05/1957", "placeholder": "[DATE_NAISSANCE]", "bbox_hint": null}
{"page": -1, "kind": "DATE_NAISSANCE_GLOBAL", "original": "23-05-1957", "placeholder": "[DATE_NAISSANCE]", "bbox_hint": null}
{"page": -1, "kind": "DATE_NAISSANCE_GLOBAL", "original": "23.05.1957", "placeholder": "[DATE_NAISSANCE]", "bbox_hint": null}
{"page": -1, "kind": "DATE_NAISSANCE_GLOBAL", "original": "23 05 1957", "placeholder": "[DATE_NAISSANCE]", "bbox_hint": null}