vh 50c85e0e8a
feat(litellm): load-share embed/rerank across esh-ml1 + nh3-ml1 with intra-group failover ...
- qwen3-embedding and reranker: second deployment on nh3-ml1 (config);
reranker-a3-bge-v2-m3: second DB deployment via /model/new.
- router_settings.enable_weighted_failover: true. Only the three
multi-deployment groups are affected.
- Measured by stopping nh3-ml1 TEI: without failover 7/40 embeds 500'd;
with it rerank 80/80, embed 38/40 at onset and 60/60 over a 34 s outage;
nh3 rejoins rotation after restart. Split 12/28 embed, 22/18 rerank.
2026-09-26 00:54:23 -07:00
2026-09-07 15:08:56 -07:00
2026-08-24 08:54:06 -07:00
2026-09-19 06:49:11 -07:00
2026-09-07 15:08:56 -07:00
2026-09-15 08:41:44 -07:00
2026-04-20 22:14:00 -07:00
2026-09-25 21:13:08 -07:00
2026-04-20 22:28:30 -07:00
2026-09-12 23:05:29 -07:00
2026-09-07 15:08:56 -07:00
2026-06-02 10:52:04 -07:00
2026-09-25 23:58:08 -07:00
2026-09-07 15:08:56 -07:00
2026-09-07 15:08:56 -07:00
2026-09-14 07:28:26 -07:00
2026-09-12 23:05:29 -07:00
2026-09-07 15:08:56 -07:00
2026-09-12 23:05:29 -07:00
2026-08-11 07:46:11 -07:00
2026-09-25 15:55:33 -07:00
2026-09-26 00:54:23 -07:00
2026-09-12 22:00:50 -07:00
2026-09-14 19:09:27 -07:00
2026-09-12 23:05:29 -07:00
2026-08-22 09:50:51 -07:00
2026-09-07 15:08:56 -07:00
2026-09-26 00:07:50 -07:00
2026-08-16 15:15:02 -07:00
2026-09-12 22:00:50 -07:00
2026-08-24 14:19:49 -07:00
2026-09-12 23:05:29 -07:00
2026-09-14 10:25:10 -07:00
2026-09-02 09:26:19 -07:00
2026-09-12 23:05:29 -07:00
2026-09-25 22:59:42 -07:00
2026-08-23 02:55:02 -07:00
2026-09-07 15:08:56 -07:00
2026-09-07 15:08:56 -07:00
2026-09-07 15:08:56 -07:00
2026-06-05 11:35:01 -07:00
2026-09-26 00:41:01 -07:00
2026-09-26 00:54:23 -07:00
2026-09-12 22:00:50 -07:00
2026-08-24 08:54:06 -07:00
2026-08-24 08:54:06 -07:00
2026-09-12 22:00:50 -07:00
2026-08-01 14:31:14 -07:00
2026-08-24 08:54:06 -07:00
2026-09-12 23:05:29 -07:00
2026-09-12 23:05:29 -07:00
2026-09-12 23:05:29 -07:00
2026-09-07 15:08:56 -07:00
2026-08-01 17:27:14 -07:00
2026-09-07 15:08:56 -07:00
2026-09-15 08:41:44 -07:00
2026-09-15 01:50:25 -07:00
2026-08-18 05:49:10 -07:00
2026-08-29 23:02:49 -07:00
2026-09-07 15:08:56 -07:00
2026-09-12 23:05:29 -07:00
2026-09-12 23:05:29 -07:00
2026-09-12 23:05:29 -07:00
2026-09-12 23:05:29 -07:00
2026-08-24 08:54:06 -07:00
2026-04-20 22:14:00 -07:00
2026-09-25 09:09:48 -07:00
2026-09-12 23:05:29 -07:00
2026-08-18 22:27:15 -07:00
2026-09-18 14:11:58 -07:00
2026-09-12 23:05:29 -07:00
2026-09-14 07:31:23 -07:00
2026-09-12 23:05:29 -07:00
2026-09-15 08:41:44 -07:00
2026-09-07 15:08:56 -07:00
2026-09-07 15:08:56 -07:00
2026-09-01 16:09:42 -07:00
2026-09-24 09:22:50 -07:00
2026-09-26 00:54:23 -07:00
2026-09-07 15:08:56 -07:00
2026-09-26 00:41:01 -07:00
2026-09-25 09:09:48 -07:00
2026-09-21 18:02:56 -07:00
2026-05-12 00:00:31 -07:00
2026-09-07 15:08:56 -07:00
2026-09-07 15:08:56 -07:00
2026-08-12 10:01:46 -07:00
2026-08-24 08:54:06 -07:00
2026-09-07 15:08:56 -07:00
2026-07-17 09:03:05 -07:00
2026-09-07 15:08:56 -07:00
vh
50c85e0e8a