vh
f979cca1ea
albok-dev withdrew the judge sign-off on fleet-scale evidence and brokkr concurred: over 10,841 texts judged by both models, h2o flagged 242 adult at 0.5 against INC's 88, and no threshold reproduces INC's set. rollback-to-inc.sh ran 14:03:28, INC healthy 14:03:56, /decide/shared smoke 200 x3. compose.yaml is INC again; the h2o compose is kept as compose.h2o.yaml with switch-to-h2o.sh (GPU 1 free-memory gate, falls back to INC). It now carries Prime's inline-images-only setting: LIGHTNING_IMAGE_URLS=off on the front (verified live: an https image URL is refused before any fetch, inline images still answer) and vLLM --allowed-media-domains media.invalid as a backstop. rollback-to-inc.sh no longer leaves timestamped compose copies behind.
19 lines
1.1 KiB
Bash
Executable File
19 lines
1.1 KiB
Bash
Executable File
#!/bin/bash
|
|
# Switch the decision seat to h2o-lightning-4b (the staged compose.h2o.yaml), run ON fv-ml1:
|
|
# sudo bash /opt/docker/compose/intern-decision/switch-to-h2o.sh
|
|
# Only once albok-dev has re-fitted Nemi's judge for h2o (2026-10-12 rollback; see the stack README).
|
|
# It stops INC, checks GPU 1 has room for h2o's measured peak, and either starts h2o or puts INC back.
|
|
# h2o takes ~3 min to healthy (graph capture). Undo with rollback-to-inc.sh.
|
|
set -euo pipefail
|
|
cd /opt/docker/compose/intern-decision
|
|
NEED_MIB=16900 # h2o seat budget 16,847 MiB (peak 16,164 under 4 x 16q x 32k on 2026-10-12)
|
|
docker compose down
|
|
FREE=$(nvidia-smi -i 1 --query-gpu=memory.free --format=csv,noheader,nounits | tr -d ' ')
|
|
if [ "$FREE" -lt "$NEED_MIB" ]; then
|
|
echo "GPU 1 free ${FREE} MiB < ${NEED_MIB}: not starting h2o; restarting INC"; docker compose up -d; exit 2
|
|
fi
|
|
cp compose.h2o.yaml compose.yaml
|
|
docker compose up -d
|
|
for i in $(seq 1 100); do curl -sf http://127.0.0.1:8033/health >/dev/null && { echo "h2o healthy"; exit 0; }; sleep 3; done
|
|
echo "h2o not healthy after 300 s: run rollback-to-inc.sh"; exit 1
|