fix(morpheus): raise TTS max_tokens 1200->2400 (long lines clipped at ~14.6s)

Cut-offs were the max_tokens=1200 ceiling (~14.6s of audio), not memory (~1250 tokens
<< 4096 context). Diagnosis: the repetition penalty is load-bearing for clean stops —
rep 1.0 => the model never emits end-of-speech and rambles to the cap; rep 1.1 (the
wrapper default) => clean natural stop. So normal lines already complete; only genuinely
long dialogue (>~14.6s, ~25+ words) hit the cap. Raised default + client max_tokens to
2400 (~29s), still within the 4096 context (no memory cost). Verified: a 49-word line
now finishes at 16.73s (was clipped at 14.6s).
This commit is contained in:
vh
2026-07-09 01:25:56 -07:00
parent da7682969b
commit f363fe6c84
3 changed files with 6 additions and 4 deletions
+4 -2
View File
@@ -45,8 +45,10 @@ class TTSReq(BaseModel):
voice: str = DEFAULT_VOICE
temperature: float = 0.6
top_p: float = 0.95
max_tokens: int = 1200
repetition_penalty: float = 1.1 # keep <=1.1 for cloning (higher penalizes ref audio tokens)
max_tokens: int = 2400 # ~29s of audio; long lines were clipping at 1200 (~14.6s)
repetition_penalty: float = 1.1 # LOAD-BEARING: rep 1.0 => model never stops (rambles to
# the cap); rep 1.1 => clean end-of-speech. Keep <=1.1 for
# cloning (higher penalizes the in-context ref audio tokens).
reference_audio_b64: str | None = None # optional zero-shot clone: base64 WAV
reference_text: str | None = None # transcript of the reference