Full seat rebalance across GPU0/GPU1 (flash on GPU2 and empty GPU3 untouched),
operator-directed. Every target seat now serves native 262,144 context with
concurrency in the requested 1.2-2.5x band, verified from live boot logs:
cyberprev (sec) 262144 @ 1.37x depth-probed CLEAN to 259,722 tokens
flash-next (gen) 262144 @ 1.31x (untouched, already in band)
gen-small (NEW) 262144 @ 2.56x MTP k=3 measured 69.6% accept / 3.09 len
char-rp 262144 @ 1.22x (was 1.02x; util 0.40->0.52)
char-rp-fast 262144 @ 2.04x (util cap 0.30->0.24, pinned KV unchanged)
- gen-small: NEW seat, Qwen3.6-35B-A3B (3B active MoE), llmfan46 Heretic
(MPOA) NVFP4 experts-only, already on disk at qwen36-35b-a3b-heretic-nvfp4.
There is no general Qwen3.8 A3B (3.8 MoEs are Flash-Next and the 2.4T), so
this is the 3.6 fallback the operator specified. GPU0, :8026, MTP k=3, coherent
and MTP-verified before wiring. gen-small / gen-small-reasoning gateway aliases.
- coder: 8192 @ 13.75x -> 16384 @ 4.70x (util 0.06->0.055). Context doubled,
waste cut. Not the exact 2-3x target: the 1.5B weight+overhead floor (~4.2 GiB)
sits just under the util knob's resolution, so hitting <=3x reliably needs a
--kv-cache-memory byte pin (compose change) rather than the util fraction.
- cyberprev raised 163840 -> 262144: depth-probed with non-repeating prompts to
259,722 tokens, clean (no OOM, memory flat). Unlike mog-sec (same base arch,
capped at 163840 for depth crashes), this checkpoint holds native depth.
- Gateway (operator calls): summarizer + classifier -> gen-small; new
classifier-large -> gen-large (flash) for the accuracy tier; summarizer-large
stays on flash. All verified end-to-end.
- GPU1 hit its ceiling raising char-rp; resolved by trimming char-rp-fast's
reservation cap (its KV is pinned, so concurrency held at 2.04x) rather than
moving a utility seat -- the shared GPU_ID on reward/embed/rerank made a
single-seat move messier than the in-GPU rebalance.
Seat inventory regenerated from the live containers.
vh
05f3d3b2a3