feat(tei-bakeoff): TEI 1.9.4 vs vLLM on esh-ml1 — parity holds, not faster, much lighter

2026-09-25 08:05:17 -07:00
parent a1885718e9
commit 582b150131
4 changed files with 178 additions and 0 deletions
@@ -117,6 +117,15 @@ no longer deployed sidecars here. See Recent decisions.)

 _As of 2026-09-24 ~2245 PT._

+### ⭐ esh-ml1: TEI vs vLLM decision pending (Prime), then "what else moves"
+
+Prime's direction 2026-09-25: move the utility seats off fv-ml1 to esh-ml1
+(accepting slower); **parakeet STAYS on fv-ml1** (real-time chat path). TEI
+bake-off done — results `stacks/tei-bakeoff/README.md`; tei-embed :8081 +
+tei-rerank :8083 running beside vLLM, NOT gateway-wired. Next: Prime picks the
+engine, then the rest of the move (reward model is the open candidate; it needs
+vLLM — TEI can't serve a Llama classifier).
+
 ### ✅ esh-ml1 built (2026-09-24) — two follow-ups

 The RTX 2000E Ada now serves `qwen3-embedding` + `reranker` from **CT 110