lv-bronte: the voice axis passes under the corrected floor rule — amended, not rewritten
lv-bronte shipped 2026-09-17 with a FAILED voice axis written into its compose comment,
its NFS README and its gate record. That verdict no longer stands, and this records the
correction in all three places without deleting what they said.
The floor rule is now pairwise (commit 0bb4938, pre-registered for lv-hemingway before
any Hemingway number existed). Re-scoring the SAME 360 generations, no re-run, no changed
delta_cb:
ckpt475 (shipped) +0.193 vs pairwise floor 0.091 -> PASS, 2.1x
ckpt925 (not shipped) +0.210 vs its own spread 0.251 -> still fails
As run, the floor was 0.251 for every candidate, contributed entirely by ckpt925's single
outlier seed — a candidate nobody was shipping failed the one that was.
Why this is not a threshold chosen to produce a verdict: the previous session found the
defect, wrote it into this very file, and deliberately declined to act on it. The rule was
changed prospectively on an argument independent of the answer — the sampling variability
of a difference A-B depends on A and B, not on a third arm C. voice_distance.py now prints
both floors and flags disagreement so neither can be quoted without the other.
What changes for a reader: the sensitivity floor is 0.091 rather than 0.251, and "do not
cite lv-bronte as evidence pair-SFT works for this author" is withdrawn. What does not
change: NOT-COPIED and NO-DAMAGE as recorded, ckpt475 over ckpt925 for the same reasons,
and the two-epoch recipe still not transferring to Brontë.
Amendments are append-only in all three artifacts. The on-host compose is unchanged so far
— this edit is comment-only and will ride with the next real deploy rather than triggering
a model reload for a comment.
This commit is contained in:
@@ -91,12 +91,26 @@ services:
|
||||
- "${VOICES_MAX_LORA_RANK:-32}"
|
||||
- --lora-modules
|
||||
- lv-yarros=/adapters/lv-yarros-4b-v1
|
||||
# ⚠ lv-bronte did NOT pass its voice gate: +0.193 delta_cb toward held-out
|
||||
# Brontë against a 0.251 measured noise floor. Shipped anyway because it is
|
||||
# additive, reversible, and clean on the safety axis (8-gram overlap 0.00,
|
||||
# identical to the never-saw-it control). The effect is underpowered, not
|
||||
# absent — it closed 48% of the achievable span and beat base on every seed.
|
||||
# Do not cite it as evidence pair-SFT works for this author.
|
||||
# lv-bronte: +0.193 delta_cb toward held-out Brontë, 8-gram overlap 0.00
|
||||
# (identical to the never-saw-it control). Shipped 2026-09-17 as additive,
|
||||
# reversible and safety-clean.
|
||||
#
|
||||
# ⚠ IT WAS SHIPPED AS A VOICE-AXIS FAILURE AND THAT VERDICT NO LONGER STANDS.
|
||||
# As run, the floor was the largest within-arm seed spread across ALL THREE
|
||||
# arms = 0.251, contributed entirely by ckpt925 — a candidate that was NOT
|
||||
# shipped — on one outlier seed. The floor rule was changed to PAIRWISE on
|
||||
# 2026-09-17 (pre-registered for lv-hemingway before any of its numbers
|
||||
# existed, on the grounds that a candidate's verdict must not depend on which
|
||||
# other arms happened to be generated). Re-scored under that rule, on the
|
||||
# SAME generations, with the same delta_cb values:
|
||||
#
|
||||
# ckpt475 (this adapter) +0.193 vs a pairwise floor of 0.091 -> PASSES, 2.1x
|
||||
# ckpt925 (not shipped) +0.210 vs its own spread 0.251 -> still fails
|
||||
#
|
||||
# The previous session found this defect, wrote it down, and deliberately did
|
||||
# NOT exploit it — choosing the floor that passes your preferred answer after
|
||||
# seeing the numbers is the exact failure pre-registration exists to prevent.
|
||||
# The rule was fixed prospectively instead; this follows from it.
|
||||
# See /adapters/lv-bronte-4b-v1/README.md and
|
||||
# persistent-memory.d/2026-09-17-lv-bronte-gate.md
|
||||
- lv-bronte=/adapters/lv-bronte-4b-v1
|
||||
|
||||
Reference in New Issue
Block a user