vh
7b0580dcbe
The gate is new. There was no committed instrument for "does any of the author's own proper nouns survive the rename" -- the Brontë number was produced by hand -- so leak_gate.py is now that instrument, and it runs both directions every time: the same scan over the unrenamed source as a positive control, and a nonce string as a negative one. A detector that only ever sees renamed text cannot distinguish absent from blind. Run against BabyYarros as built it reported 212 surviving entities, not the 86 recorded earlier, because it scans the whole corpus rather than each work separately and it counts the sub-threshold entities rename never looked at. Three findings came out of closing that. The corpus had a typography defect of its own. The D1 notes correctly say no unwrap was needed; a different defect was there instead. The Empyrean books set their chapter epigraphs in small caps and the extractor rendered the run as uppercase while leaving the large initial as a separate token, so the corpus carried "M AJOR A FENDRA'S G UIDE TO THE R IDERS Q UADRANT" -- 106 lines, ~700 splits -- plus 52 drop caps like "T he flight field". That is where the entities called IDERS, UADRANT, NAUTHORIZED and seventeen bare single letters came from. A split initial next to an uppercased run is enough to recover the original mixed case, so the restore is exact rather than approximate: a word with a split initial was capitalised, an all-caps word without one was lowercase. Back matter was inside the prose. The builder splits on chapter headings and nothing follows the last one, so every work carried its acknowledgments, newsletter pitches and cover-artist credits -- 4,555 words naming the author's agent, editors and children, in a corpus whose entire purpose is that no identifiable name survives. And the gate passed at 0 of 314 while Afendra was still in every copy. The name never appears unpossessed, so it keyed as an apostrophe form, and rename and the gate both skip those as contractions -- unrenamed and unreported at once, which is the worst failure shape available. Baxter escaped a different way: wilder renders an in-book news article entirely in lowercase, putting the cap/lowercase ratio at 0.13 against a 0.05 bar. Then a second class the unigram scan structurally cannot see. Riders Quadrant, Flame Section, War Games and Fourth Wing -- the book's own title -- are built from ordinary words the detector correctly refuses to call names. The gate now audits recurring capitalised 2-3grams against an explicit allow list, and rename applies a phrase map after the entity pass. Every new detector flag is opt-in and off by default, and the Brontë entity map was re-derived after each change and confirmed identical in keys, surfaces and every field. The stoplist was built by reading each surface in context, which is why it is short: Violence is Xaden's nickname for Violet, and Continent, Presentation, Barrens, Originals, Montserrat, Athena, Aura, Curator and Sage are all in-world. A plausible-looking guess would have excluded most of them. Final: 0 of 325 entities and 0 of 91 audited phrases survive in any of 30 copy files, both controls passing. The sensitivity floor is stated in the gate's own output -- 3 occurrences for a name, 5 for a phrase -- because a negative without one is unfalsifiable.
56 lines
2.2 KiB
JSON
56 lines
2.2 KiB
JSON
{
|
|
"corpus": "BabyYarros",
|
|
"why": "The unigram rename cannot reach an in-world compound built out of ordinary words. `Riders Quadrant`, `Flame Section`, `War Games` and `Fourth Wing` -- the book's own title -- all survived a gate that read 0 of 324, because every component is a common noun the cap/lowercase ratio correctly refuses to call a name. This is the `Thornfield x 100` case one level up, and it needs a map rather than a detector: substituting a head noun is a choice about register, not a measurement.",
|
|
"how_applied": "rename.py runs this AFTER the entity substitution. Multiword keys first, longest first; then capitalised single tokens, whole-word and case-sensitive, so the lowercase noun (a dragon's `wing`, a `squad` of cadets) is untouched.",
|
|
"phrases": {
|
|
"Silver One": "Argent One",
|
|
"First Six": "First Founders",
|
|
"Great War": "Long War",
|
|
"Unedited History": "Unabridged Record",
|
|
"Recovered Correspondence": "Retrieved Letters",
|
|
"The Fables": "The Legends",
|
|
"The Journal": "The Ledger",
|
|
"Field Guide": "Field Primer",
|
|
"Dreamless Sleep": "Endless Sleep",
|
|
"Conscription Day": "Levy Day"
|
|
},
|
|
"tokens": {
|
|
"Quadrant": "Division",
|
|
"Quadrants": "Divisions",
|
|
"Wing": "Flight",
|
|
"Wings": "Flights",
|
|
"Section": "Cohort",
|
|
"Sections": "Cohorts",
|
|
"Squad": "Unit",
|
|
"Squads": "Units",
|
|
"Games": "Trials",
|
|
"Daggertail": "Spinecrest",
|
|
"Daggertails": "Spinecrests",
|
|
"Swordtail": "Bladecrest",
|
|
"Swordtails": "Bladecrests"
|
|
},
|
|
"allow": [
|
|
"Thank God",
|
|
"Abu Dhabi",
|
|
"Sri Lanka",
|
|
"Los Angeles",
|
|
"Machu Picchu",
|
|
"Taj Mahal",
|
|
"Buenos Aires",
|
|
"World Religion",
|
|
"High Roller",
|
|
"Hong Kong",
|
|
"Oak Moss",
|
|
"Moss Grove",
|
|
"Oak Moss Grove",
|
|
"Fox Motocross",
|
|
"Nitro Circus",
|
|
"Red Bull",
|
|
"Unauthorized Edition",
|
|
"Battle Brief",
|
|
"Pacific Ocean",
|
|
"Las Vegas"
|
|
],
|
|
"allow_why": "Real-world referents and generic English that any novelist could write. `Battle Brief` and `Unauthorized Edition` stay because their distinctive halves -- the class and the in-world author -- are already renamed by the unigram pass, leaving ordinary words behind."
|
|
}
|