2 Commits

Include renames

Author	SHA1	Message	Date
vh	5aa10bf138	lv-mccarthy D2: entity map + stoplist, both audits green — and audit_stoplist was scanning its own rationale ... Entity map at ~/mccarthy-corpus/entities.json. 123 surfaces after a 107-surface stoplist. entities.py 27/27 controls -- 19 positive (Glanton, Toadvine, Rawlins, Blevins, Alejandra, Chigurh, Moss, Bell, Boyd, Holden, Tobin, Magdalena, Eduardo, Parham, Socorro, Webster, Redbo, Niño, Franklin) and 8 negative audit_stoplist PASS -- no stoplisted surface is ever addressed as a person audit_entity_map PASS -- positive `boy` 0.89, negative band tops out at Riddle 0.17, all 5 remaining flags on the read-and-cleared list ⚠⚠ A DEFECT IN audit_stoplist.py ITSELF, latent for every corpus before this one. It built its surface set from every list value in the stoplist JSON -- including `_why`, which by convention is a LIST OF PROSE LINES. Every sentence of the rationale went into the matcher, and the empty separator line matched the honorific pattern 139 times, printing a flag with no surface name at the top of the report, above the one real catch. It now skips `_`-prefixed metadata keys and empty strings. THE ONE REAL CATCH WAS A CONTRADICTION INSIDE MY OWN FILE. `Franklin` sat in the geography list because it is the old name for El Paso, while the same file's context note recorded 'I'm here to see Mr Franklin' -- a lawyer in All the Pretty Horses. The honorific audit found the contradiction between the two halves of the file. Franklin is now renameable. A SECOND SELF-INFLICTED ONE: the fragments list was a speculative A-Z, which stoplisted `I` and `A` -- ordinary English words -- and `Sir I dont think I can do that` duly tripped the honorific audit. It is now the four letters actually MEASURED as entities (E, H, T, K). Stoplist what the entity map produced, not the alphabet. Everything ambiguous was read in context before placement, and the reasoning is in the file: Socorro is the ranch COOK in Cities of the Plain, not the New Mexico town -- renameable Webster, Jackson, Harlan, Lamar are Glanton's men and lawmen, not places -- renameable Niño, Keno, Redbo are HORSES, the author's inventions -- renameable, the `Inglés` precedent Mangas, Travis, Venada, Moderno are genuinely dual-use -- renamed, the safe direction Santa, Varas, Griffin, Eagle, Avenue, Calle, Terrell are real geography -- stoplisted Yaqui and Gilenos are real peoples; Ford and Hashknives are a brand and a real outfit Ed (Ed Tom Bell) and JC are short but are names, read and kept renameable Sensitivity floor, stated because it is part of the result: the top 170 of 199 surfaces were classified. The bottom 29 were not individually read, so a rare real-world referent may be renamed -- the safe direction, an accepted cost, not an oversight.	2026-09-17 08:43:46 -07:00
vh	8bb7686a16	audit_stoplist: a stoplist entry is an assertion the leak gate cannot check ... Stoplisting a surface removes it from the entity map, so rename never touches it and the gate never scans for it. That is exactly what a stoplist is FOR when the surface is a real-world referent — and exactly how a wrongly stoplisted CHARACTER becomes an undetectable leak. The gate reports 0 of N surviving and is telling the truth about the set it was given. Found by luck on lv-bronte: a generated beat said "Mrs. Leaven", and Leaven had been filed under scripture as the bread noun. Reading it back: "Robert Leaven, the coachman" — Bessie's married surname in Jane Eyre. Running the audit instead of trusting that luck caught two more: Pierrot "Madame Pierrot: she comes from Lisle, in France" — a teacher in The Professor, filed as the commedia dell'arte figure Samuel "Mr. Samuel Wynne" — filed as scripture and correctly CLEARED two: Wellington "that Baal of a Lord Wellington" — the real Duke Moses "the Rev. Moses Barraclough" — the documented dual-use Signal is an honorific in front of the surface: real-world referents are not addressed as Mr/Mrs/Miss/Madame/Lord. It is a heuristic and not a proof, which is why every hit is REPORTED FOR READING and never auto-removed — Wellington and Moses both trip it and both are correct. Exit 1 on anything not on --allow, so it can gate a pipeline. Blast radius of the three errors was 16 of 3781 train pairs and 3 of 80 val — small, but they are the author's characters in training data, which is the one thing this pipeline exists to prevent. Corpus rebuilt rather than dropping the affected pairs: a corpus on disk that disagrees with its committed config is how superseded claims get made. Gate re-passes at 0 of 368 (three more surfaces than before, exactly the restored characters), both controls green.	2026-09-16 21:40:34 -07:00