feat(nh3-ml1): abliterated LFM2.5-VL-3B parallel seat :8032 for brokkr's NSFW-caption A/B (direct only)

2026-09-26 00:57:04 -07:00
parent 50c85e0e8a
commit 9cc3824aec
4 changed files with 93 additions and 2 deletions
@@ -53,8 +53,11 @@ VRAM ~2.7 GB for both, so ~13 GB is free.
 - `stacks/vibevoice-asr-seat`: VibeVoice-ASR-Streaming-1.5B on audio.cpp,
  `:8031`, direct only.

-GPU total with TEI is ~7.5 of 16 GB. Both are batch workloads, which suits this
-card.
+- `stacks/lfm-vl-uncensored-seat`: an abliterated LFM2.5-VL-3B running in
+  parallel for brokkr's NSFW-caption A/B, `:8032`, direct only.
+
+GPU total with TEI is ~10.2 of 16 GB. All of these are batch workloads, which
+suits this card.

 **Tried and removed (2026-09-25):** a copy of the code-completion seat
 (Qwen2.5-Coder-1.5B). It gave the same quality but ran about 5× slower than on