vh
935b35ac2e
Operator: "start the 1.7b training." The 0.6B adapter learned the Gutenberg transcription's ~70-character line breaks along with the prose -- its output wrapped at a mid-length-line ratio of 0.85 against the base model's 0.00. That is typography rather than style, and every further rung would have inherited it, so the corpus is reflowed before rung 2 rather than after the sweep. The reflow joins 57,430 of 85,380 paragraph blocks and keeps 27,950. Verse is the hazard a blind join would destroy, so the decision is per block by median line length: blocks whose lines cluster near the wrap width are flowed prose, blocks of consistently short lines keep their breaks. Every kept multi-line block in the sample was genuinely verse with its lineation intact. No line ended in a lone hyphen, so the space-join could not split a word across lines. The acceptance check is content identity -- " ".join(text.split()) byte-identical before and after -- and it passed on all 852 records, proving only whitespace changed. Concrete cost of the old defect: 5.7% of the training budget was newline tokens. The same words pack to 5,210,112 tokens unwrapped against 5,525,504 wrapped. The 1.7B run is live at 159 steps and roughly 18.7 s/it. Everything but the carrier and the corpus is held from the 0.6B run: seed 4919, rank 32, lr 1e-4, seq 4096, batch 1 by accum 8, one epoch, eval and save every 25 steps so the minimum is located rather than assumed. That corpus change is a second variable and it is named as one. A 0.6B-vs-1.7B comparison is descriptive, not attributable, until the chained 0.6B rerun on the same unwrapped corpus lands behind it -- gated on the 1.7B actually producing an adapter, because a chain that fires on failure turns one lost run into two. "Did sense come back at 1.7B" is a within-arm reading and survives the confound; any between-rung delta does not. The original wrapped corpus is untouched, so the 0.6B run's pinned corpus sha 3959036cf851bf62 stays reproducible.
12 lines
992 B
JSON
12 lines
992 B
JSON
[
|
|
{"id":"a1","tier":"modern","prompt":"The self-checkout machine refused her coupon for the third time."},
|
|
{"id":"a2","tier":"modern","prompt":"He parked the car and sat listening to the engine tick as it cooled."},
|
|
{"id":"a3","tier":"modern","prompt":"The office kitchen smelled of burnt coffee and somebody's reheated fish."},
|
|
{"id":"b1","tier":"neutral","prompt":"She had not slept, and the morning found her at the window."},
|
|
{"id":"b2","tier":"neutral","prompt":"There was a letter on the table, and no one would say who had brought it."},
|
|
{"id":"b3","tier":"neutral","prompt":"The child would not speak, though she had been asked three times."},
|
|
{"id":"c1","tier":"period","prompt":"The new governess arrived on a wet Tuesday and nobody came to meet her."},
|
|
{"id":"c2","tier":"period","prompt":"Rain came on hard after dark, and the road up to the house turned to mud."},
|
|
{"id":"c3","tier":"period","prompt":"He was the sort of man who took up all the air in a small room."}
|
|
]
|