 vh
|
a300cdcd26
|
feat: Zed edit-predictions keyless FIM route (Qwen2.5-Coder-1.5B / coder-fast)
Deep-research-picked Qwen2.5-Coder-1.5B (BASE, Apache-2.0, native FIM) as a
low-latency inline-completion seat:
- stacks/vllm: vllm-coder service (ana-ml2 GPU1 :8020) + granite shrunk
(util 0.27->0.13, max-len 131072->16384, seqs 1024->256; granite phasing out)
to free GPU1 room.
- stacks/litellm: coder-fast alias -> :8020 (mode: completion, /v1/completions).
- stacks/zed-fim-proxy (NEW): keyless /v1/completions front door on ana-docker
:4141 for Zed (which can't send an auth header) — POST + path + model
allowlist, injects a coder-fast-scoped virtual key -> LiteLLM :4000. Anon
/ping liveness. Verified keyless FIM end-to-end.
Zed api_url = http://10.250.50.70:4141/v1, model coder-fast, prompt_format qwen.
Source-IP allowlist off pending the Mac's observed source IP.
|
2026-07-27 22:55:21 -07:00 |
|