albok-dev withdrew the judge sign-off on fleet-scale evidence and brokkr concurred: over 10,841 texts judged by both models, h2o flagged 242 adult at 0.5 against INC's 88, and no threshold reproduces INC's set. rollback-to-inc.sh ran 14:03:28, INC healthy 14:03:56, /decide/shared smoke 200 x3. compose.yaml is INC again; the h2o compose is kept as compose.h2o.yaml with switch-to-h2o.sh (GPU 1 free-memory gate, falls back to INC). It now carries Prime's inline-images-only setting: LIGHTNING_IMAGE_URLS=off on the front (verified live: an https image URL is refused before any fetch, inline images still answer) and vLLM --allowed-media-domains media.invalid as a backstop. rollback-to-inc.sh no longer leaves timestamped compose copies behind.
14 lines
633 B
Bash
Executable File
14 lines
633 B
Bash
Executable File
#!/bin/bash
|
|
# One container: the unmodified vendor shim on loopback, then the front. If either dies, the container exits and
|
|
# Docker restarts it (restart: unless-stopped). Both inherit the container's whole environment, so the shim's own
|
|
# settings (SHIM_*, e.g. SHIM_NOUL_FLOOR, and LIGHTNING_*, e.g. LIGHTNING_IMAGE_URLS=off) set in compose reach it.
|
|
set -eu
|
|
python3 /model/h2o_lightning_shim.py --config /model/serve_config.json --vllm "$SHIM_VLLM" \
|
|
--host 127.0.0.1 --port "$SHIM_PORT" &
|
|
SHIM=$!
|
|
python3 /front/front.py &
|
|
FRONT=$!
|
|
wait -n "$SHIM" "$FRONT" 2>/dev/null || true
|
|
kill "$SHIM" "$FRONT" 2>/dev/null || true
|
|
exit 1
|