Files

T

vh f979cca1ea fix(intern-decision): roll the decision seat back to Intern-Decision-4B; h2o staged with inline-images-only

albok-dev withdrew the judge sign-off on fleet-scale evidence and brokkr
concurred: over 10,841 texts judged by both models, h2o flagged 242 adult at
0.5 against INC's 88, and no threshold reproduces INC's set. rollback-to-inc.sh
ran 14:03:28, INC healthy 14:03:56, /decide/shared smoke 200 x3.

compose.yaml is INC again; the h2o compose is kept as compose.h2o.yaml with
switch-to-h2o.sh (GPU 1 free-memory gate, falls back to INC). It now carries
Prime's inline-images-only setting: LIGHTNING_IMAGE_URLS=off on the front
(verified live: an https image URL is refused before any fetch, inline images
still answer) and vLLM --allowed-media-domains media.invalid as a backstop.
rollback-to-inc.sh no longer leaves timestamped compose copies behind.

2026-10-12 14:05:44 -07:00

conf/front

fix(intern-decision): roll the decision seat back to Intern-Decision-4B; h2o staged with inline-images-only

2026-10-12 14:05:44 -07:00

compose.yaml

fix(intern-decision): roll the decision seat back to Intern-Decision-4B; h2o staged with inline-images-only

2026-10-12 14:05:44 -07:00

README.md

feat(intern-decision): decision seat swapped to h2o-lightning-4b on fv-ml1 GPU 1; eval seat down

2026-10-12 13:19:46 -07:00

README.md

h2o-eval (TEMPORARY) — fv-ml1 GPU 3, :8034

DOWN since 2026-10-12 1319 PT (docker compose down), once the GPU 1 cutover's post-checks passed. The host keeps /opt/docker/compose/h2o-eval and the weights, so it can come back on GPU 3 for a transient test with docker compose up -d.

h2o-lightning-4b @ b43f759b behind services/h2o-decision-front (copied into conf/front/), for albok-dev's re-validation of Nemi's sensitivity judge before the GPU 1 cutover (Prime 2026-10-12 via brokkr). Remove right after the cutover: GPU 3 is for transient work only (Scriberr and MIA use it).

Weights: /tank/aimodels/h2o-lightning-4b-b43f759b (copied from the bench kit; model.safetensors sha256 2d51561f221e1549d91bd1c38b3512a1435dd32950d454a9f040f1d4d11497b6, tokenizer.json 5f9e4d49…, shim git oid fee7807e…, serve_config 5e6fef1c…: all equal to Hugging Face at b43f759b).
vLLM exactly as benched: --max-model-len 40960 --max-num-seqs 16 --gpu-memory-utilization 0.1506, vision limits as the vendor's serve.sh; healthy ~3 min after up (graph capture), ~14.4 GB on GPU 3.
.env on the host: FRONT_TOKEN = intern-decision's token (= vault albok/judge-token).
Remove: cd /opt/docker/compose/h2o-eval && docker compose down (the weights stay for the GPU 1 seat).