vh/esh-pfi-infrastructure
1
0
Fork 0
Code Issues 7 Pull Requests Actions Packages Projects Releases Wiki Activity

docs(intern-decision): seat switch checklist — Nemi's judge concurrency is 1 on INC, 4 on h2o

Browse Source
This commit is contained in:
vh
2026-10-12 16:21:25 -07:00
parent 8d9fcd9ffb
commit 014a4fd0ec
1 changed files with 5 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
stacks/intern-decision/README.md
+5
View File
@@ -108,6 +108,11 @@ Both run ON fv-ml1 and share one `.env`.
After either switch, make `stacks/intern-decision/compose.yaml` match the host again (it is INC today). After either switch, make `stacks/intern-decision/compose.yaml` match the host again (it is INC today).
⚠ **Tell albok-dev on either switch: Nemi's judge concurrency depends on the seat.** INC scores on one inference
thread (INV-2, ~16 calls/s at most), so the judge runs with concurrency 1 against it (albok's `nemi.yaml`, since
2026-10-12). With 4 in flight on INC, the 1533–1619 walk queued behind itself and lost 339 calls to 30 s timeouts. On
h2o, vLLM batches, so it goes back to 4.
--- ---
# The live seat: Intern-Decision-4B (2026-09-30 → 2026-10-12 1308, and again since 1403) # The live seat: Intern-Decision-4B (2026-09-30 → 2026-10-12 1308, and again since 1403)