vh
4549d241a7
Three TTS additions to round out coverage on irv-ml1, each filling a
distinct niche the existing slate doesn't own.
Final coverage matrix (all on irv-ml1):
Kokoro — low-latency English, fixed voice library, ~300ms TTFA
Chatterbox Turbo — low-latency English w/ voice cloning + paralinguistic tags
IndexTTS-2 — English voice cloning + emotion vector / text control
Qwen3-TTS-1.7B-Base — high-quality English voice cloning
CosyVoice 3 — multilingual (Chinese-leaning)
VibeVoice 1.5B — long-form / multi-speaker dialogue
stacks/kokoro:
- port 8193, GPU device 0 (3090)
- pulls ghcr.io/remsky/kokoro-fastapi-gpu:v0.2.4-master (no Dockerfile,
no first-run model download — models baked in)
- 60+ built-in voices, OpenAI-compat with stream=true over chunked HTTP
- Apache-2.0 weights + code, ~1 GB VRAM
stacks/vibevoice:
- port 8194, GPU device 1 (A6000 — for 7B headroom)
- builds groxaxo/VibeVoice-FastAPI1 (more current fork of ncoder-ai)
pinned to 7614c469a145
- default model microsoft/VibeVoice-1.5B (~7 GB bf16 VRAM); env var
swap to rsxdalv/VibeVoice-Large (7B) or FabioSarracino/VibeVoice-Large-Q8
- multi-speaker dialogue via /v1/vibevoice/generate with Speaker N: format
- long-form niche only — not low-latency
stacks/chatterbox:
- port 8196, GPU device 0 (3090)
- builds devnen/Chatterbox-TTS-Server (most active Turbo-supporting wrapper)
- default model ResembleAI/chatterbox-turbo (~2.5 GB fp16, ~75ms latency)
- paralinguistic tags inline ([laugh] [whisper] etc) — different shape
from IndexTTS-2's emotion vector; fills the speed+cloning niche
Kokoro/IndexTTS don't cover together
- mandatory PerTh watermark on outputs (Resemble policy)
Three matching playbooks under playbooks/deploy-{kokoro,vibevoice,
chatterbox}.yaml. All idempotent, creates-/when-gated.
Cold-deploy disk on /worktank/: ~7 GB Kokoro + ~19 GB VibeVoice 1.5B
+ ~12 GB Chatterbox = ~38 GB total. VRAM concurrent: ~10-11 GB across
both GPUs.
Skipped from the original four-stack proposal: VibeVoice Realtime
(overlaps Kokoro's niche; Kokoro wins on latency, license, and not
needing a build).
38 lines
2.0 KiB
Bash
38 lines
2.0 KiB
Bash
# Kokoro-FastAPI stack tunables. Copy to `.env` on irv-ml1 before deploying.
|
|
|
|
# ── image pin ────────────────────────────────────────────────────────
|
|
# Tagged release on GHCR. Avoid `latest` — upstream warns it can move
|
|
# without notice. v0.2.4-master = 2025-12-13 release with Kokoro-82M v1.0
|
|
# baked in (commit 9901c2b).
|
|
KOKORO_TAG=v0.2.4-master
|
|
|
|
# ── network ──────────────────────────────────────────────────────────
|
|
# Host port. Container listens on 8880 internally.
|
|
# Reserved on irv-ml1: 8188 ComfyUI, 8190 CosyVoice, 8191 Qwen3-TTS,
|
|
# 8192 IndexTTS-2, 8765 Parakeet. 8193 picked here.
|
|
KOKORO_PORT=8193
|
|
|
|
# Bind address. 0.0.0.0 exposes on all interfaces (incl. WG tunnel
|
|
# interface 10.100.79.3); 127.0.0.1 restricts to local-only.
|
|
KOKORO_BIND=0.0.0.0
|
|
|
|
# ── runtime / GPU ────────────────────────────────────────────────────
|
|
# Devices visible inside the container. "0" pins to the RTX 3090
|
|
# (Kokoro is tiny — ~1 GB VRAM — and doesn't need the A6000). Use
|
|
# "all" if you want the model swap to either GPU.
|
|
KOKORO_GPU_DEVICES=0
|
|
|
|
# Logging level for the FastAPI app. INFO is the upstream default.
|
|
KOKORO_LOG_LEVEL=INFO
|
|
|
|
# ── persistent storage on the host ───────────────────────────────────
|
|
# Voicepacks dir — bind-mount target IF the (commented-out) override
|
|
# is enabled in compose.yaml. Default: leave empty and use the
|
|
# in-image voicepacks.
|
|
KOKORO_VOICES_DIR=/worktank/kokoro/voices
|
|
|
|
# User-voices dir — a parallel directory the wrapper *also* scans for
|
|
# voicepacks alongside the in-image ones. Always mounted (cheap, empty
|
|
# by default). Drop your own .pt files here if you train Kokoro voices.
|
|
KOKORO_USER_VOICES_DIR=/worktank/kokoro/user_voices
|