vh/esh-pfi-infrastructure
1
0
Fork 0
Code Issues 7 Pull Requests Actions Packages Projects Releases Wiki Activity

feat(h2o-eval): round 2 eval seat on GPU 3 with floor-on/floor-off fronts for the judge investigation

Browse Source 
Prime (via albok-dev): understand why h2o failed and re-fit the judge. One
vLLM on GPU 3 behind two fronts: :8034 with the shim's yes/no floor at 0.801
exactly as the cutover ran (same judge stamp), :8035 with SHIM_NOUL_FLOOR=0 and
a distinct stamp (h2o-lightning-4b+noul-floor-0). Both refuse image URLs; the
vLLM --allowed-media-domains backstop is now verified (400, no fetch).
This commit is contained in:
vh
2026-10-12 14:29:15 -07:00
parent 501bda078d
commit 2b40805b84
4 changed files with 58 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files
persistent-memory.md
+1 -1
View File
@@ -169,7 +169,7 @@ Every vLLM seat on a shared card (GPU 0, GPU 1) has byte-pinned KV (`--kv-cache-
### The decision seat `intern-decision` :8033 (Intern-Decision-4B; h2o staged)
- **LIVE: Intern-Decision-4B** (`intern-decision-serve:0.1.3`), again since 2026-10-12 1403. The only production caller is albok-nemi's sensitivity judge (`/decide/shared`, threshold 0.5). Run `scripts/intern-decision-warmup` after an IMAGE change. → `persistent-memory.d/2026-09-30-semif-replaced-by-intern-decision.md`
- **h2o-lightning-4b is STAGED** (`stacks/intern-decision/compose.h2o.yaml` + `switch-to-h2o.sh`, with a GPU 1 free-memory gate; weights `/tank/aimodels/h2o-lightning-4b-b43f759b`; front `services/h2o-decision-front`). Inline images only (`LIGHTNING_IMAGE_URLS=off`, verified; vLLM `--allowed-media-domains media.invalid` backstop NOT yet exercised). **It returns only after albok-dev re-fits the judge for it** (a 4.4 contract revision on an eval seat). ⚠ Its seat headroom under 4-way 32k load was 683 MiB.
- **h2o-lightning-4b is STAGED** (`stacks/intern-decision/compose.h2o.yaml` + `switch-to-h2o.sh`, with a GPU 1 free-memory gate; weights `/tank/aimodels/h2o-lightning-4b-b43f759b`; front `services/h2o-decision-front`). Inline images only (`LIGHTNING_IMAGE_URLS=off` and the vLLM `--allowed-media-domains media.invalid` backstop, both verified). **It returns only after albok-dev re-fits the judge for it** (a 4.4 contract revision on an eval seat). **Round 2 eval seat UP since 1428 on GPU 3** (Prime 1420: understand why h2o failed, re-fit): `:8034` floor on (stamp = the cutover's), `:8035` floor off (`h2o-lightning-4b+noul-floor-0`), one vLLM; no load tests while albok-dev runs; down when they're done. Thread `01M4S026GWS354WZGXZ5E34F31`. ⚠ Its seat headroom under 4-way 32k load was 683 MiB.
- **Open:** label ~50 real Wyrd/Cicada turns before trusting INC in production; its card makes no contamination claim.