vh/esh-pfi-infrastructure
1
0
Fork 0
Code Issues 7 Pull Requests Actions Packages Projects Releases Wiki Activity

docs(chatterbox-fast): Phase 3 deployed — A6000, measured 5.34 GB fp32

Browse Source 
Deployed on irv-ml1 beside live chatterbox (:8196): healthy on :8197, TTFB ~0.5s,
no starvation. Measured VRAM 5.34 GB (fp32) settles the placement: the 3090's
~3.8 GB free does NOT fit, A6000 (device 1) is the only viable card.
This commit is contained in:
vh
2026-06-01 23:37:16 -07:00
parent 5c8d174f8e
commit e3ff4cd40d
2 changed files with 9 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
stacks/chatterbox-fast/.env.example
+4 -4
View File
@@ -22,10 +22,10 @@ CBF_BIND=0.0.0.0
# ── runtime / GPU ────────────────────────────────────────────────────
# Device visible inside the container.
# 1 = RTX A6000 (~12 GB free; the safe default).
# 0 = RTX 3090 — TIGHT: turbo loads FP32 (not fp16), and the 3090 idles
# ~20.5 GB used (shared dev stack), leaving ~3.8 GB free. Measure the
# actual footprint before pinning here; it likely will NOT fit in fp32.
# 1 = RTX A6000 (the only viable placement; ~7 GB free after this stack).
# 0 = RTX 3090 — DOES NOT FIT: measured footprint is 5.34 GB (turbo loads
# FP32, not the fp16 old notes assumed), and the 3090 idles ~20.5 GB used
# (shared dev stack) leaving only ~3.8 GB free. Don't pin device 0.
CBF_GPU_DEVICES=1
# Default reference voice (a *.wav stem in CBF_REFERENCE_DIR, or an absolute