Files
esh-pfi-infrastructure/scripts/yarros-corpus/manifest.json
T
vh 6dba912324 BabyYarros: corpus built, gender resolution fixed, rename blocked on leak gate
Located the source: five Rebecca Yarros works in the Kvasir licensed library, with
rights recorded as gated. Built D1 at 208 chapters and 780,744 words, which is 15%
larger than the Brontë corpus. No unwrap step was needed because Kvasir's cleaner
already emits flowing paragraphs, so the hard-wrap defect that cost a re-cut on
Brontë does not exist here. The alphabet was re-derived rather than inherited: 23
non-ASCII letters across three forms, against F02's 4 on a smaller sample. Same
ASCII-fold conclusion from a different measurement, which is the reason to re-derive
per corpus.

The interesting finding is a new pathology. In a rotating first-person POV corpus,
every book's narrator gets the wrong gender. Measured against six names verified in
the text, the pronoun resolver called Violet male, Leah male and Landon female --
three of eighteen wrong, and all three are the narrator of the book where they were
misgendered. A narrator is "I" in her own book, so her name appears mostly inside
the other lead's dialogue surrounded by his pronouns. This is Brontë's "Jane called
male" amplified by rotating POV. Title-first resolution, which fixed it for Brontë,
is nearly blind here because contemporary romance uses given names rather than
honorifics. What works is the POV header: resolve each name from the chapters it
does not narrate. Validated at 9 correct, 9 held, 0 wrong against the previous 7, 8
and 3 wrong, and the instrument refuses to write unless it beats what it replaces.

Re-pointing rename.py surfaced three bugs, two of which would have silently
corrupted the corpus. Gender came only from honorifics and the entities file's
gender field was ignored, so the POV fix had no effect until wired through; that
took wilder from 1 gendered entity to 13. The pool labels were hardcoded in a print
statement, so any non-Brontë preset crashed. And the collision-filter log claimed
it dropped names colliding with Brontë entities regardless of which corpus it
filtered against -- the logic was right but the message named the wrong corpus,
which is how a reader later concludes the filter ran on the wrong thing.

D3 is blocked and nothing has been trained. The leak gate shows 86 of 232
renameable source entities surviving where the Brontë run reached 0 of 203. It
decomposes into detector false positives that need a stopword filter rather than
renaming, genuine misses among worldbuilding proper nouns, and a third class whose
cause is not yet established. Training before the gate passes means fitting
in-copyright text with 86 identifiable source entities intact, in a corpus F02
already flagged as small enough for leak to be a real concern.
2026-09-11 08:46:45 -07:00

61 lines
1.7 KiB
JSON

{
"corpus": "BabyYarros",
"author": "Rebecca Yarros",
"source": "kvasir data/library masters (licensed, rights=gated)",
"built_at": "2026-09-11",
"works": [
{
"slug": "fourth-wing",
"title": "Fourth Wing (Exclusive Holiday Edition)",
"rights": "gated",
"master_sha256": "606420acb827122d700eb47c18b7612399d130fe770787b139b0704673b1b897",
"chapters": 41,
"words": 191289,
"path": "works/fourth-wing.jsonl"
},
{
"slug": "iron-flame",
"title": "Iron Flame",
"rights": "gated",
"master_sha256": "e66db0cd13789bb0d6065888bc117362c8b3c25f8827dcbc6ffcd452a7359af6",
"chapters": 66,
"words": 251949,
"path": "works/iron-flame.jsonl"
},
{
"slug": "nova",
"title": "Nova (The Renegades #2)",
"rights": "gated",
"master_sha256": "ccccf3d64dd5810c5135ac86223e5f3e679fe5d1cdacd88df1eb9ff0164cb61e",
"chapters": 34,
"words": 109571,
"path": "works/nova.jsonl"
},
{
"slug": "rebel",
"title": "Rebel (The Renegades)",
"rights": "gated",
"master_sha256": "ed61fea84eab962cbf4c96870eaaa180d5ea92278241ad54ebd6d9f6ae2c4e7d",
"chapters": 36,
"words": 118270,
"path": "works/rebel.jsonl"
},
{
"slug": "wilder",
"title": "Wilder (The Renegades)",
"rights": "gated",
"master_sha256": "c798c9a5d24595deb870e25c34478172cdfd7758249e41e6ecbfa8240cf51a41",
"chapters": 31,
"words": 109665,
"path": "works/wilder.jsonl"
}
],
"totals": {
"chapters": 208,
"words": 780744,
"distinct_letters": 55,
"non_ascii_letters": 23
},
"total_words": 780744,
"total_chapters": 208
}