feat(erp-tune): run 7 launched on pfi-gx10 (opening-split slot + mask union) — config, launcher, builder, runbook; erp-seat: pin vLLM nightly 311b3513 (forced tool_choice 1/9 -> 6/9, round trip clean), README on the gemma4-parser design limit

2026-09-08 23:31:09 -07:00
parent 3c54f59878
commit a34a72fc09
8 changed files with 251 additions and 2 deletions
@@ -0,0 +1,57 @@
+# pfi-gx10 — ERP-seat SFT run 7 (opening-split slot)
+
+Launched 2026-09-08 23:06:11 PT on pfi-gx10, pid 599489, under the operator's direct grant
+`operator-2026-09-08-rnd-run7` (in-session `/goal: launch training run 7 on gx10`, 23:03 PT).
+Run 6's CSAM soft trip was adjudicated GO by the operator at 22:45 PT (verbatim in the config's
+`substitute_controls`); run06-gate closed as TRANSFERRED.
+
+## What run 7 is
+
+Run 6 + **one variable**: an opening-split slot and its companion loss mask (brokkr-smithy
+`recipe-erp-seat-sft-r7.json`, `SFT-RECIPE-run7.md`). 293 rows (bluemoon 109 / cwm 179 / c2-logs
+5): the corpus's own first exchanges re-seated into the serving shape — scene in the card, one
+user line, the ≥250-word first bot turn as the only loss turn. The mask (224 entries) removes loss
+from those conversations' ORIGINAL first bot turns in the held dialogue roots: loss moved, not
+doubled. Chosen by brokkr's cue-length probe on the run-6 seat (5-word cue → 54/62 words median;
+221-word → 292). Base, seven held roots, kvasir cut, longdep slot, hyperparameters, stock
+tokenizer + template all unchanged from run 6.
+
+## Build (`build_r7.py` on the box)
+
+- `recipe-r7/survivors-r7.jsonl` = survivors-r5 (8,212) + 293 opening-split ids = 8,505.
+- `recipe-r7/lossmask-r7.jsonl` = lossmask-r3 (5,883) ∪ mask-original-first-turn (224), 1 duplicate
+  → 6,106 entries, sha `ad77f452…`.
+- `datasets/derived/opening-split/{clean-v1,holdout-v1}` relayed NAS → nh3-dev → box (no NFS on
+  the GX10), sha-verified: root jsonl `85a75718…`, mask `dda151fa…`, holdout `7224e049…`.
+- `run-07-gx10.json` = run-06 config with recipe/survivors/mask/output/override swapped and the
+  substitute_controls rewritten (single variable, holdout opening-split/holdout-v1 16 rows, the
+  CSAM adjudication verbatim).
+- ⚠ First launch died in preflight: the recipe JSON had not landed (a zsh quoting error aborted
+  the staging chain silently). `run-07.log.attempt1-missing-recipe` kept.
+
+## Free check — passed with two explained deltas
+
+    [encode] 8,488 samples -> 8,661 records (173 chunked, 30 single+truncated, 59 lost turns);
+             ctx 19,114,072 tok, loss 9,998,300 tok
+    [mix]    kvasir .3348 fireball .3023 c2-logs .1143 bluemoon .0964 cwm .0942
+             govreport .0289 opening-split .0235 qmsum .0055
+
+- Held roots encode identically to run 6 (same chunk/truncate/lost-turn counts).
+- Slot: 293/293 `fit_whole`, 0 chunked, 0 truncated (window_count 1 everywhere) — ctx 522,951 /
+  loss 235,347 vs the recipe's 525,002 / 233,589 (different tokenizer instrument; the harness
+  `[mix]` supersedes).
+- Records 8,661 = 8,370 + 293 − 2: **cwm-2602 and cwm-1826 dropped as unfittable** — lossmask-r3
+  already masked every bot turn but the first, the companion mask masked the first, so no loss
+  turn remained. Their loss now lives in their opening-split rows. Expected under "loss moved".
+- Mask match: 6,106 turns across 567 samples (run 6: 5,883 / 426) → all 224 companion entries
+  landed (+1 duplicate with r3).
+- Sampler padding 17.1% (run 6: 0.0%) — the short slot rows pair badly; a throughput cost, not
+  a correctness one. 542 optimizer steps; first step 155 s (JIT warm-up), expect ~80 s/it after.
+
+## Launch / watch / stop
+
+    ssh infra-ops@10.100.50.60 "tr '\r' '\n' < ~/erp-tune/run-07.log | tail"
+    ssh infra-ops@10.100.50.60 'kill $(cat ~/erp-tune/run-07.pid)'   # by PID — never pkill -f over ssh
+
+Gate choreography after the adapter lands: brokkr-smithy `SFT-RECIPE-run7-SCOPE.md §5` (cells
+LENGTH-FIXED / LENGTH-MOVED / BOUGHT-T4 / FLAT); serve names `erp-seat-base-ara` then `erp-tune-v7`.