feat(vibevoice-asr-seat): switch to Q8_0 (Prime); WER 2/69 vs 3/69 on the bundled clips, +1.1 GB VRAM

2026-09-26 16:16:32 -07:00
parent 8e7ae0675d
commit 2fdbac63d5
4 changed files with 11 additions and 6 deletions
@@ -56,7 +56,7 @@ VRAM ~2.7 GB for both, so ~13 GB is free.
 - `stacks/lfm-vl-uncensored-seat`: an abliterated LFM2.5-VL-3B running in
  parallel for brokkr's NSFW-caption A/B, `:8032`, direct only.

-GPU total with TEI is ~10.2 of 16 GB. All of these are batch workloads, which
+GPU total with TEI is ~11.3 of 16 GB (the ASR seat moved to Q8_0 on 2026-09-26). All of these are batch workloads, which
 suits this card.

 **Tried and removed (2026-09-25):** a copy of the code-completion seat