feat(h2o-eval): round 2 eval seat on GPU 3 with floor-on/floor-off fronts for the judge investigation
Prime (via albok-dev): understand why h2o failed and re-fit the judge. One vLLM on GPU 3 behind two fronts: :8034 with the shim's yes/no floor at 0.801 exactly as the cutover ran (same judge stamp), :8035 with SHIM_NOUL_FLOOR=0 and a distinct stamp (h2o-lightning-4b+noul-floor-0). Both refuse image URLs; the vLLM --allowed-media-domains backstop is now verified (400, no fetch).
This commit is contained in:
@@ -91,9 +91,9 @@ The shim switch was verified live at 1402, on the h2o seat with the front recrea
|
||||
- inline red still answered red at 0.984;
|
||||
- before the change, inline red/blue/green answered at 0.98+ and no-image came out near-uniform.
|
||||
|
||||
The vLLM backstop has **not** been exercised: the seat was rolled back before vLLM was recreated. Verify it on the next
|
||||
switch, by posting an https image URL straight to vLLM's loopback port and expecting a refusal that names the allowed
|
||||
domains. INC needs neither setting, because its served checkpoint has no vision tower.
|
||||
The vLLM backstop was first exercised on the GPU 3 eval seat at 1428 (same image and flag): an https image URL
|
||||
posted straight to vLLM got 400 "The URL must be from one of the allowed domains: ['media.invalid']", with no fetch.
|
||||
Repeat that check on this seat's loopback port (`:18299`) on the next switch. INC needs neither setting, because its served checkpoint has no vision tower.
|
||||
|
||||
### Switching between the two
|
||||
|
||||
|
||||
Reference in New Issue
Block a user