vh
e3ff4cd40d
Deployed on irv-ml1 beside live chatterbox (:8196): healthy on :8197, TTFB ~0.5s, no starvation. Measured VRAM 5.34 GB (fp32) settles the placement: the 3090's ~3.8 GB free does NOT fit, A6000 (device 1) is the only viable card.
48 lines
2.5 KiB
Bash
48 lines
2.5 KiB
Bash
# chatterbox-fast stack tunables. Copy to `.env` on irv-ml1 before deploying.
|
|
|
|
# ── image / build ────────────────────────────────────────────────────
|
|
# Local image tag for this stack. Bump to force a fresh layer build.
|
|
CBF_TAG=v1
|
|
|
|
# Base image tag — the sibling `chatterbox` stack's local image, which
|
|
# carries the chatterbox lib + torch + fastapi. Must exist on irv-ml1
|
|
# (built by the `chatterbox` stack). Bump in lockstep if that rebuilds.
|
|
CBF_BASE_TAG=v1
|
|
|
|
# ── network ──────────────────────────────────────────────────────────
|
|
# Host port. Container listens on 8197 internally.
|
|
# Reserved on irv-ml1: 8188 ComfyUI, 8190 CosyVoice, 8191 Qwen3-TTS,
|
|
# 8192 IndexTTS-2, 8193 Kokoro, 8194 VibeVoice, 8196 Chatterbox,
|
|
# 8765 Parakeet. 8197 picked here.
|
|
CBF_PORT=8197
|
|
|
|
# Bind address. 0.0.0.0 exposes on all interfaces (incl. the WG tunnel
|
|
# interface 10.100.79.3); 127.0.0.1 restricts to local-only.
|
|
CBF_BIND=0.0.0.0
|
|
|
|
# ── runtime / GPU ────────────────────────────────────────────────────
|
|
# Device visible inside the container.
|
|
# 1 = RTX A6000 (the only viable placement; ~7 GB free after this stack).
|
|
# 0 = RTX 3090 — DOES NOT FIT: measured footprint is 5.34 GB (turbo loads
|
|
# FP32, not the fp16 old notes assumed), and the 3090 idles ~20.5 GB used
|
|
# (shared dev stack) leaving only ~3.8 GB free. Don't pin device 0.
|
|
CBF_GPU_DEVICES=1
|
|
|
|
# Default reference voice (a *.wav stem in CBF_REFERENCE_DIR, or an absolute
|
|
# path). The server prepares this at startup so first request is warm.
|
|
CBF_DEFAULT_VOICE=glados_25s
|
|
|
|
# Perf levers (Ampere-safe, free). Off with 0. Measured: they don't move TTFA
|
|
# (AR-decode-bound) but don't hurt; bf16 is deferred (fp32 model, no clean cast).
|
|
CBF_TF32=1
|
|
CBF_SDPA_FLASH=1
|
|
|
|
# ── persistent storage on the host ───────────────────────────────────
|
|
# Reference / predefined voice wavs (mounted at /refs). Shared with the
|
|
# `chatterbox` stack. `_`-prefixed files (bench/A-B scratch) are ignored.
|
|
CBF_REFERENCE_DIR=/worktank/chatterbox/reference_audio
|
|
|
|
# HuggingFace cache — Chatterbox-Turbo weights. Reused from the `chatterbox`
|
|
# stack (already populated, ~3.8 GB); no re-download. Excluded from restic.
|
|
CBF_CACHE_DIR=/worktank/chatterbox/cache
|