fix(intern-decision): second rollback to Intern-Decision-4B; h2o staged until the judge's two margins are fixed
The v2 walk on h2o (17:05-17:45) held notes at 0 adult but moved two margins past albok-dev's pre-named rollback line: library/nonfiction adult 0 -> 79 (one textbook chapter at 0.531 on the book profile, INC 0.438, with 77 concepts inheriting) and fleet/memory personal 6 -> 18. rollback-to-inc.sh ran 17:47:46, INC healthy 17:48:11. compose.yaml is INC again.
This commit is contained in:
@@ -1,22 +1,25 @@
|
||||
# intern-decision — the decision seat (fv-ml1 GPU 1, :8033)
|
||||
|
||||
> **LIVE: h2o-lightning-4b since 2026-10-12 1704 PT** (Prime 1640, via albok-dev). `compose.yaml` = `compose.h2o.yaml`
|
||||
> (`switch-to-h2o.sh` copies one over the other). Nemi's judge runs the **re-fitted v2 note question**
|
||||
> (albok-nemi 0.1.18, contract 4.4 rev 1.15) at concurrency 4.
|
||||
> **LIVE: Intern-Decision-4B, since 2026-10-12 1748 PT** (`compose.yaml` = `compose.inc.yaml`). Nemi's judge
|
||||
> runs at concurrency 1 against it (INC is single-threaded, INV-2).
|
||||
> **h2o-lightning-4b is STAGED** (`compose.h2o.yaml`, `switch-to-h2o.sh`). It has been rolled back twice, each time on
|
||||
> albok-dev's word against a rollback line named before the switch.
|
||||
>
|
||||
> **What happened on 2026-10-12:**
|
||||
> 1. **1311–1403, h2o's first stint, rolled back.** Under the judge's v1 question, h2o flagged 242 texts adult
|
||||
> against INC's 88, over 10,841 identical texts.
|
||||
> 2. **1428–1619, the investigation on GPU 3.** The v1 question asked two things at once: INC answered it
|
||||
> inconsistently and h2o answered it as written. The shim's floor was ruled out, with identical verdicts on and
|
||||
> off. Prime ruled "text itself".
|
||||
> 3. **Under v2 the two seats agree:** work notes INC 0/22, h2o 1/22 at 0.52; nulls 0/18 on both. fleet/memory adult
|
||||
> went 86 → 0 on INC.
|
||||
> 4. **Rollback:** `rollback-to-inc.sh`, and set the judge's concurrency back to 1 (see "Switching").
|
||||
> 1. **h2o 1311–1403, judge v1, rolled back.** Adult flags went from INC's 88 to 242 over 10,841 identical texts.
|
||||
> 2. **The GPU 3 investigation, 1428–1619.** The v1 question asked two things at once, and the floor was ruled out.
|
||||
> Prime ruled "text itself", and albok-nemi 0.1.18 shipped the v2 question.
|
||||
> 3. **h2o 1704–1747, judge v2, rolled back.** Adult on notes held at 0 as validated, but two margins moved past
|
||||
> the named line:
|
||||
> - library/nonfiction adult 0 → 79: the Schell game-design chapter at 0.531 on h2o's book profile (INC 0.438),
|
||||
> with its 77 concepts inheriting;
|
||||
> - fleet/memory personal 6 → 18 on an unchanged personal question.
|
||||
>
|
||||
> The section headed "The live seat: Intern-Decision-4B" further down describes INC, the rollback target.
|
||||
> albok-dev calls both fixable offline: a per-profile threshold or a `visibility: public` declaration on published
|
||||
> titles, and a measured look at how h2o reads the personal question. They bring those to Prime before any third
|
||||
> attempt. "The model is not the problem, the two margins are."
|
||||
|
||||
### The h2o seat (`compose.h2o.yaml`, live since 1704)
|
||||
### The staged h2o seat (`compose.h2o.yaml`; live 1311–1403 and 1704–1747 on 2026-10-12)
|
||||
|
||||
| | |
|
||||
|---|---|
|
||||
@@ -109,9 +112,10 @@ Both run ON fv-ml1 and share one `.env`.
|
||||
the judge.
|
||||
- **To INC:** `sudo bash /opt/docker/compose/intern-decision/rollback-to-inc.sh`. It stops h2o, copies `compose.inc.yaml`
|
||||
over `compose.yaml` and waits up to 180 s. Image `intern-decision-serve:0.1.3` and its
|
||||
`intern-decision_triton-cache` volume survive the `down`. Used 2026-10-12, 140328 → healthy 140356.
|
||||
`intern-decision_triton-cache` volume survive the `down`. Used 2026-10-12, 140328 → healthy 140356, and again
|
||||
174746 → healthy 174811.
|
||||
|
||||
After either switch, make `stacks/intern-decision/compose.yaml` match the host again (it is h2o since 1704).
|
||||
After either switch, make `stacks/intern-decision/compose.yaml` match the host again (it is INC since 1748).
|
||||
|
||||
⚠ **Tell albok-dev on either switch: Nemi's judge concurrency depends on the seat.** INC scores on one inference
|
||||
thread (INV-2, ~16 calls/s at most), so the judge runs with concurrency 1 against it (albok's `nemi.yaml`, since
|
||||
@@ -120,7 +124,7 @@ h2o, vLLM batches, so it goes back to 4.
|
||||
|
||||
---
|
||||
|
||||
# The live seat: Intern-Decision-4B (2026-09-30 → 2026-10-12 1308, and 1403–1702; now the rollback target)
|
||||
# The live seat: Intern-Decision-4B (2026-09-30 → 10-12 1308, 1403–1702, and again since 1748)
|
||||
|
||||
> **LIVE from 2026-09-30 0941 PT to 2026-10-12 1308 PT, and again since 2026-10-12 1403 PT** on fv-ml1 GPU 1, with cap 9.0 GiB and `MAX_TOKENS` 7,168.
|
||||
> Acceptance on the live service is below. `semif` is stopped and kept as the rollback.
|
||||
|
||||
Reference in New Issue
Block a user