docs: gen-small .env.example records util 0.33 + boot-check rule; parakeet-nemo compose note corrected (slack, not KV; steady state 3,582 MiB)

2026-10-01 01:38:42 -07:00
parent cb28d8c951
commit 03826d2029
2 changed files with 9 additions and 4 deletions
@@ -6,9 +6,10 @@
 #
 # HOST: fv-ml1, GPU 0.
 #
-# ⚠ GPU 0 room came from gen-small's KV: its --gpu-memory-utilization dropped 0.48 -> 0.46
-# (measured boot, 2026-09-30: the seat rests ~2.5 GB, served peak ~2.8 GB, load peak ~3.0 GB;
-# the old seat held 1,690 MiB). Do not raise that util back without re-measuring nvidia-smi Free
+# ⚠ GPU 0 room came from gen-small's util SLACK, not its KV: util went 0.48 -> 0.36 (now 0.33 in its .env),
+# and the KV is byte-pinned (unchanged at 670,142 tokens). Plan GPU 0 against this seat's STEADY STATE of
+# 3,582 MiB (the torch cache after a long, windowed request), not its at-rest figure; that leaves Free ~385 MiB
+# (the old seat held 1,690 MiB). Do not raise that util back without re-measuring nvidia-smi Free
 # on GPU 0 — util does not predict resident VRAM (see the 09-15 note in gen-small-seat/.env).
 #
 # ⚠ Weights: /tank/aimodels/huggingface mounted READ-ONLY. nvidia/parakeet-unified-en-0.6b @