esh-pfi-infrastructure/persistent-memory.d/2026-09-26-embed-rerank-load-shared-across-esh-ml1-nh3-ml1-prime.md

[2026-09-26] Embed/rerank LOAD-SHARED across esh-ml1 + nh3-ml1 (Prime).

Embed/rerank LOAD-SHARED across esh-ml1 + nh3-ml1 (Prime). Second deployments were added for qwen3-embedding and reranker (config) and for reranker-a3-bge-v2-m3 (DB, /model/new). Without failover, a dead backend failed 7/40 embeds; router_settings.enable_weighted_failover: true (affects only multi-deployment groups) brought it to rerank 80/80 and embed 38/40 at onset, 60/60 sustained. In LiteLLM 1.97 the embedding path does not stamp the failed deployment, so it relies on cooldown. LiteLLM restarted 3× tonight, ~36 s each.