docs(chatterbox-fast): Phase 3 deployed — A6000, measured 5.34 GB fp32

Deployed on irv-ml1 beside live chatterbox (:8196): healthy on :8197, TTFB ~0.5s,
no starvation. Measured VRAM 5.34 GB (fp32) settles the placement: the 3090's
~3.8 GB free does NOT fit, A6000 (device 1) is the only viable card.
This commit is contained in:
2026-06-01 23:37:16 -07:00
parent 5c8d174f8e
commit e3ff4cd40d
2 changed files with 9 additions and 6 deletions
+4 -4
View File
@@ -22,10 +22,10 @@ CBF_BIND=0.0.0.0
# ── runtime / GPU ────────────────────────────────────────────────────
# Device visible inside the container.
# 1 = RTX A6000 (~12 GB free; the safe default).
# 0 = RTX 3090 — TIGHT: turbo loads FP32 (not fp16), and the 3090 idles
# ~20.5 GB used (shared dev stack), leaving ~3.8 GB free. Measure the
# actual footprint before pinning here; it likely will NOT fit in fp32.
# 1 = RTX A6000 (the only viable placement; ~7 GB free after this stack).
# 0 = RTX 3090 — DOES NOT FIT: measured footprint is 5.34 GB (turbo loads
# FP32, not the fp16 old notes assumed), and the 3090 idles ~20.5 GB used
# (shared dev stack) leaving only ~3.8 GB free. Don't pin device 0.
CBF_GPU_DEVICES=1
# Default reference voice (a *.wav stem in CBF_REFERENCE_DIR, or an absolute
+5 -2
View File
@@ -52,8 +52,11 @@ docker compose build && docker compose up -d
`Dockerfile` is `FROM local/chatterbox:v1` (the sibling stack's image — must exist
on irv-ml1) + `COPY scheduler.py app.py`. GPU pin and voices/cache paths come from
`.env` (see `.env.example`). Default GPU is **device 1 (A6000)**turbo loads fp32,
so the 3090's tight free VRAM likely won't fit; measure before pinning device 0.
`.env` (see `.env.example`). GPU is **device 1 (A6000)**measured footprint is
**5.34 GB** (turbo loads fp32), so the 3090's ~3.8 GB free does **not** fit it.
**Deployed 2026-06-02** alongside the live `chatterbox` (:8196): healthy on
:8197, TTFB ~0.5s, no starvation, ~7 GB free left on the A6000.
## API