Files

T

vh f979cca1ea fix(intern-decision): roll the decision seat back to Intern-Decision-4B; h2o staged with inline-images-only

albok-dev withdrew the judge sign-off on fleet-scale evidence and brokkr
concurred: over 10,841 texts judged by both models, h2o flagged 242 adult at
0.5 against INC's 88, and no threshold reproduces INC's set. rollback-to-inc.sh
ran 14:03:28, INC healthy 14:03:56, /decide/shared smoke 200 x3.

compose.yaml is INC again; the h2o compose is kept as compose.h2o.yaml with
switch-to-h2o.sh (GPU 1 free-memory gate, falls back to INC). It now carries
Prime's inline-images-only setting: LIGHTNING_IMAGE_URLS=off on the front
(verified live: an https image URL is refused before any fetch, inline images
still answer) and vLLM --allowed-media-domains media.invalid as a backstop.
rollback-to-inc.sh no longer leaves timestamped compose copies behind.

2026-10-12 14:05:44 -07:00

front.py

feat(h2o): temporary h2o-lightning-4b eval seat on fv-ml1 GPU 3 + the seat front (admission, bearer, /decide/shared translator)

2026-10-12 13:01:53 -07:00

README.md

feat(h2o): temporary h2o-lightning-4b eval seat on fv-ml1 GPU 3 + the seat front (admission, bearer, /decide/shared translator)

2026-10-12 13:01:53 -07:00

run.sh

fix(intern-decision): roll the decision seat back to Intern-Decision-4B; h2o staged with inline-images-only

2026-10-12 14:05:44 -07:00

README.md

h2o decision front

The front of the h2o-lightning-4b decision seat on fv-ml1 (seat swap ordered by Prime 2026-10-12, through brokkr). front.py sits in front of the vendor's unmodified h2o_lightning_shim.py, which sits in front of stock vLLM 0.30.0. It adds what the seat contract needs and the vendor stack lacks:

Admission (infra-hermes's tools/h2o-admission/admission_proxy.py @ 30f36f2, logic unchanged): count every decision request with h2o's own tokenizer over the shim's own renders, and refuse over 32,000 tokens with 422 + the count. The shim would otherwise trim silently.
The seat's bearer token on everything but GET /health, as intern-decision-serve has.
/decide and /decide/shared continuity for albok-nemi's sensitivity judge: intern-decision-serve's own mapping (one Jev choice question per decision, calls of at most 16, fields q/q1..qN), re-keyed into the semif result shape (results[i].native.probabilities[option id]). orderings other than none → 422.
/health with model: {name, source, revision}, which the judge stamps into its cache key.

run.sh runs the shim (loopback) and the front in one container (python:3.12-slim, host network). Stacks copy both files into conf/front/: stacks/h2o-eval (TEMPORARY, GPU 3, :8034) today.

Verified 2026-10-12 1300 on the eval seat: 401 without the token; /decide/shared in the judge's shape; a planted personal record → personal p_yes .911, a neutral note → .056 (n=1 each, smoke test only); 40,088 tokens → 422 with the count; /v1/systemone passthrough with _admission counts; reachable from nh3-dev.