vh
c08992f95f
The :8033 seat now serves h2oai/h2o-lightning-4b @ b43f759b on vLLM 0.30.0 with byte-pinned KV (4.48 GiB, 135,558 tokens) behind services/h2o-decision-front: 32k refuse-not-trim admission, the seat's bearer token, and /decide + /decide/shared translated onto /v1/systemone for albok-nemi's judge. URL, port, token and stack name are unchanged. INC down 13:08:18, h2o healthy 13:11:27. Post-checks on the live seat: /health at the pinned revision; JevBench public 205/231 (= bench); 422 over the cap; 16q at the cap warm 2.0-2.16 s; seat peak 16,164 MiB under 4 concurrent 16q x 32k calls against a 16,847 budget. compose.inc.yaml + rollback-to-inc.sh restore Intern-Decision-4B in one step. The temporary GPU 3 eval seat (stacks/h2o-eval) is down.
13 lines
639 B
Bash
Executable File
13 lines
639 B
Bash
Executable File
#!/bin/bash
|
|
# One-command rollback of the decision seat to Intern-Decision-4B (the pre-2026-10-12 seat), run ON fv-ml1:
|
|
# sudo bash /opt/docker/compose/intern-decision/rollback-to-inc.sh
|
|
# It stops the h2o stack, puts the INC compose back (same .env) and starts it (~35 s to healthy).
|
|
set -euo pipefail
|
|
cd /opt/docker/compose/intern-decision
|
|
docker compose down
|
|
cp compose.yaml compose.yaml.h2o-$(date +%Y%m%d-%H%M)
|
|
cp compose.inc.yaml compose.yaml
|
|
docker compose up -d
|
|
for i in $(seq 1 60); do curl -sf http://127.0.0.1:8033/health >/dev/null && { echo "INC healthy"; exit 0; }; sleep 3; done
|
|
echo "INC not healthy after 180 s"; exit 1
|