From 014a4fd0ec7849dec5d87629e5c1cb3dd5e01741 Mon Sep 17 00:00:00 2001 From: Vuong Hoang Date: Mon, 12 Oct 2026 16:21:25 -0700 Subject: [PATCH] =?UTF-8?q?docs(intern-decision):=20seat=20switch=20checkl?= =?UTF-8?q?ist=20=E2=80=94=20Nemi's=20judge=20concurrency=20is=201=20on=20?= =?UTF-8?q?INC,=204=20on=20h2o?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- stacks/intern-decision/README.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/stacks/intern-decision/README.md b/stacks/intern-decision/README.md index 996a883..6bbe460 100644 --- a/stacks/intern-decision/README.md +++ b/stacks/intern-decision/README.md @@ -108,6 +108,11 @@ Both run ON fv-ml1 and share one `.env`. After either switch, make `stacks/intern-decision/compose.yaml` match the host again (it is INC today). +⚠ **Tell albok-dev on either switch: Nemi's judge concurrency depends on the seat.** INC scores on one inference +thread (INV-2, ~16 calls/s at most), so the judge runs with concurrency 1 against it (albok's `nemi.yaml`, since +2026-10-12). With 4 in flight on INC, the 1533–1619 walk queued behind itself and lost 339 calls to 30 s timeouts. On +h2o, vLLM batches, so it goes back to 4. + --- # The live seat: Intern-Decision-4B (2026-09-30 → 2026-10-12 1308, and again since 1403)