feat(nh3-ml1): LFM2.5-VL-3B (llama.cpp) + VibeVoice-ASR-Streaming-1.5B (audio.cpp) utility seats
For brokkr's dataset foundry (operator-approved 2026-09-26, relayed). - stacks/lfm-vl-seat: llama.cpp server-cuda b11176 (digest-pinned), Q5_K_M + mmproj Q8_0, :8030; gateway alias lfm25-vl-3b (LiteLLM restarted, 36 s). Positive control exact; null control shows it describes a missing image. - stacks/vibevoice-asr-seat: audio.cpp v0.8.2-audio8-perf-hotfix (the GGUF's own runtime, not vibevoice.cpp) on cuda 12.8 runtime + libgomp + libsoxr, sha256-pinned; :8031 direct. LibriSpeech WER 3/69, RTF 0.07-0.14; ~31 s cold first request.
This commit is contained in:
@@ -33,6 +33,14 @@ Prime's call (recommendation: load-share; see below).
|
||||
|
||||
VRAM ~2.7 GB for both, so ~13 GB is free.
|
||||
|
||||
**Dataset-foundry utility seats (2026-09-26, brokkr; operator-approved):**
|
||||
- `stacks/lfm-vl-seat`: LFM2.5-VL-3B on llama.cpp, `:8030`, gateway `lfm25-vl-3b`.
|
||||
- `stacks/vibevoice-asr-seat`: VibeVoice-ASR-Streaming-1.5B on audio.cpp,
|
||||
`:8031`, direct only.
|
||||
|
||||
GPU total with TEI is ~7.5 of 16 GB. Both are batch workloads, which suits this
|
||||
card.
|
||||
|
||||
**Tried and removed (2026-09-25):** a copy of the code-completion seat
|
||||
(Qwen2.5-Coder-1.5B). It gave the same quality but ran about 5× slower than on
|
||||
fv-ml1 (a 64-token FIM completion took ~1.0 s vs ~0.2 s), so it stays on fv-ml1
|
||||
|
||||
Reference in New Issue
Block a user