feat(h2o-eval): round 2 eval seat on GPU 3 with floor-on/floor-off fronts for the judge investigation

Prime (via albok-dev): understand why h2o failed and re-fit the judge. One
vLLM on GPU 3 behind two fronts: :8034 with the shim's yes/no floor at 0.801
exactly as the cutover ran (same judge stamp), :8035 with SHIM_NOUL_FLOOR=0 and
a distinct stamp (h2o-lightning-4b+noul-floor-0). Both refuse image URLs; the
vLLM --allowed-media-domains backstop is now verified (400, no fetch).
This commit is contained in:
vh
2026-10-12 14:29:15 -07:00
parent 501bda078d
commit 2b40805b84
4 changed files with 58 additions and 10 deletions
+3 -3
View File
@@ -91,9 +91,9 @@ The shim switch was verified live at 1402, on the h2o seat with the front recrea
- inline red still answered red at 0.984;
- before the change, inline red/blue/green answered at 0.98+ and no-image came out near-uniform.
The vLLM backstop has **not** been exercised: the seat was rolled back before vLLM was recreated. Verify it on the next
switch, by posting an https image URL straight to vLLM's loopback port and expecting a refusal that names the allowed
domains. INC needs neither setting, because its served checkpoint has no vision tower.
The vLLM backstop was first exercised on the GPU 3 eval seat at 1428 (same image and flag): an https image URL
posted straight to vLLM got 400 "The URL must be from one of the allowed domains: ['media.invalid']", with no fetch.
Repeat that check on this seat's loopback port (`:18299`) on the next switch. INC needs neither setting, because its served checkpoint has no vision tower.
### Switching between the two