vh
5558d9c7d3
Adds the Yarros-side evaluation the training exists to justify: does the adapter move arbitrary prose toward Yarros, and can the instruct arm still expand a beat to a paragraph on direction. Yarros-flavoured voice prompts (modern/neutral/ romantasy tiers so any Yarros voice in the modern tier is adapter-attributable, not prompt-supplied) and a Yarros-register beat SYS on the chat generator. voice_distance.py is the honest slice of adjudication that needs no seat: Burrows's Delta over character bigrams against held-out Yarros. Its first cut mis-framed the noise floor — it used the same-author distance (held-out vs itself) as the between-arm significance threshold, which is the target, not the threshold. Fixed to the measured floor: the within-arm seed spread, which is this metric's sampling variance at this sample size, computed from the two seeds already generated rather than assumed. Result on the built corpus, ordering base-125-tuned < instruct-tuned < base-unadapted, both adapters clearing the 0.046 measured floor (base +0.157, instruct +0.076), and the ordering corroborating the independent held-out loss ordering (Base below Instruct). One seed-pair per arm, so it corroborates rather than settles; the full frozen adjudication still needs a romantasy control panel, a second seed, and the gen seat for the beat-incumbent leg.
12 lines
1.0 KiB
JSON
12 lines
1.0 KiB
JSON
[
|
|
{"id":"a1","tier":"modern","prompt":"The self-checkout machine refused her coupon for the third time."},
|
|
{"id":"a2","tier":"modern","prompt":"He parked the car and sat listening to the engine tick as it cooled."},
|
|
{"id":"a3","tier":"modern","prompt":"The office kitchen smelled of burnt coffee and somebody's reheated fish."},
|
|
{"id":"b1","tier":"neutral","prompt":"She had not slept, and the morning found her at the window."},
|
|
{"id":"b2","tier":"neutral","prompt":"There was a message on her phone, and no one would say who had sent it."},
|
|
{"id":"b3","tier":"neutral","prompt":"The boy would not speak, though she had asked him three times."},
|
|
{"id":"c1","tier":"romantasy","prompt":"The instructor called my name, and the whole cohort turned to watch me step onto the mat."},
|
|
{"id":"c2","tier":"romantasy","prompt":"He was the last person I wanted as a partner, and now his hand was at the small of my back."},
|
|
{"id":"c3","tier":"romantasy","prompt":"The wound at my side had stopped bleeding, but the drop to the canyon floor had not gotten any shorter."}
|
|
]
|