vh edc9f42da1 feat(vllm,litellm): lfm2.5-2.6b non-prod bake-off alias for brokkr ...

vllm-lfm25 on ana-ml2 GPU1 :8021 (LiquidAI/LFM2.5-2.6B, util 0.09 into
unreserved slack, max-len 16384, no reasoning-parser so content is non-empty).
LiteLLM alias lfm2.5-2.6b with vendor sampling baked as default (temp 0.1;
top_k 50 + repetition_penalty 1.1 via extra_body). Eval-only, not in any
routing chain, pending operator ruling on LFM Open License production use.

2026-08-10 07:13:37 -07:00

..

config.yaml

feat(vllm,litellm): lfm2.5-2.6b non-prod bake-off alias for brokkr

2026-08-10 07:13:37 -07:00

strip_empty_tools.py

fix(litellm): strip empty tools:[] before forwarding to vLLM

2026-06-16 00:43:57 -07:00