vh/esh-pfi-infrastructure
1
0
Fork 0
Code Issues 7 Pull Requests Actions Packages Projects Releases Wiki Activity

docs(chatterbox-fast): Phase 3 deployed — A6000, measured 5.34 GB fp32

Browse Source 
Deployed on irv-ml1 beside live chatterbox (:8196): healthy on :8197, TTFB ~0.5s,
no starvation. Measured VRAM 5.34 GB (fp32) settles the placement: the 3090's
~3.8 GB free does NOT fit, A6000 (device 1) is the only viable card.
This commit is contained in:
vh
2026-06-01 23:37:16 -07:00
parent 5c8d174f8e
commit e3ff4cd40d
2 changed files with 9 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
stacks/chatterbox-fast/README.md
+5 -2
View File
@@ -52,8 +52,11 @@ docker compose build && docker compose up -d
`Dockerfile` is `FROM local/chatterbox:v1` (the sibling stack's image — must exist
on irv-ml1) + `COPY scheduler.py app.py`. GPU pin and voices/cache paths come from
`.env` (see `.env.example`). Default GPU is **device 1 (A6000)** — turbo loads fp32,
so the 3090's tight free VRAM likely won't fit; measure before pinning device 0.
`.env` (see `.env.example`). GPU is **device 1 (A6000)** — measured footprint is
**5.34 GB** (turbo loads fp32), so the 3090's ~3.8 GB free does **not** fit it.
**Deployed 2026-06-02** alongside the live `chatterbox` (:8196): healthy on
:8197, TTFB ~0.5s, no starvation, ~7 GB free left on the A6000.
## API