fix(intern-decision): roll the decision seat back to Intern-Decision-4B; h2o staged with inline-images-only
albok-dev withdrew the judge sign-off on fleet-scale evidence and brokkr concurred: over 10,841 texts judged by both models, h2o flagged 242 adult at 0.5 against INC's 88, and no threshold reproduces INC's set. rollback-to-inc.sh ran 14:03:28, INC healthy 14:03:56, /decide/shared smoke 200 x3. compose.yaml is INC again; the h2o compose is kept as compose.h2o.yaml with switch-to-h2o.sh (GPU 1 free-memory gate, falls back to INC). It now carries Prime's inline-images-only setting: LIGHTNING_IMAGE_URLS=off on the front (verified live: an https image URL is refused before any fetch, inline images still answer) and vLLM --allowed-media-domains media.invalid as a backstop. rollback-to-inc.sh no longer leaves timestamped compose copies behind.
This commit is contained in:
@@ -21,7 +21,8 @@ services:
|
||||
command: ["--model", "/model", "--served-model-name", "h2oai/h2o-lightning-4b",
|
||||
"--max-model-len", "40960", "--max-num-seqs", "16", "--gpu-memory-utilization", "0.1506",
|
||||
"--limit-mm-per-prompt", "{\"image\": 4, \"video\": 0}",
|
||||
"--mm-processor-kwargs", "{\"max_pixels\": 1605632}"]
|
||||
"--mm-processor-kwargs", "{\"max_pixels\": 1605632}",
|
||||
"--allowed-media-domains", "media.invalid"]
|
||||
deploy:
|
||||
resources:
|
||||
reservations:
|
||||
@@ -40,6 +41,7 @@ services:
|
||||
SHIM_VLLM: http://127.0.0.1:18199
|
||||
SHIM_PORT: "18191"
|
||||
SHIM_NOUL_FLOOR: "0.801"
|
||||
LIGHTNING_IMAGE_URLS: "off" # Prime 2026-10-12: inline images only, the seat never fetches an image URL
|
||||
FRONT_SHIM: http://127.0.0.1:18191
|
||||
FRONT_VLLM: http://127.0.0.1:18199
|
||||
FRONT_BIND: 0.0.0.0
|
||||
|
||||
Reference in New Issue
Block a user