feat(litellm): front Kimi K3 (Moonshot) as a paid gateway passthrough
Adds model_name kimi-k3 → openai/kimi-k3 @ https://api.moonshot.ai/v1 (OpenAI-compatible), keyed by MOONSHOT_API_KEY (compose env + .env.example placeholder; real key on server only). Verified live through the gateway. Two Moonshot constraints captured in the config comment + pinned: K3 accepts ONLY temperature=1 (else 400), and it is a reasoning model (CoT in reasoning_content, answer in content — needs adequate max_tokens or content returns empty). Model id confirmed via /v1/models.
This commit is contained in:
@@ -362,6 +362,30 @@ model_list:
|
||||
temperature: 0.6
|
||||
top_p: 0.95
|
||||
|
||||
# --- Kimi K3 (Moonshot AI, cloud API) — paid passthrough fronted for unified
|
||||
# logging alongside the local + z.ai inference. OpenAI-compatible endpoint
|
||||
# (https://api.moonshot.ai/v1) → openai/ provider. Flagship long-horizon
|
||||
# coding + knowledge model, 1M-token context (platform.kimi.ai docs). Model
|
||||
# id `kimi-k3` confirmed live via /v1/models 2026-07-25 (siblings kimi-k2.6,
|
||||
# kimi-k2.7-code, kimi-k2.7-code-highspeed — add explicit entries if wanted).
|
||||
# PAID — spends Moonshot credits; reachable by any gateway key scoped to it
|
||||
# (the shared all-agents key spans all proxy models). Key in .env
|
||||
# (MOONSHOT_API_KEY). CONSTRAINT (Moonshot, verified live 2026-07-25): K3
|
||||
# ONLY accepts temperature=1 — any other value 400s ("only 1 is allowed for
|
||||
# this model"). So temperature is pinned to 1 here as the default; callers
|
||||
# must NOT override it with another value. K3 is also a REASONING model:
|
||||
# the CoT comes back in `reasoning_content`, the answer in `content` — give
|
||||
# it adequate max_tokens or content returns EMPTY (reasoning eats a tiny
|
||||
# budget). Verified live through the gateway 2026-07-25 (17+25→"42"). ---
|
||||
- model_name: kimi-k3
|
||||
litellm_params:
|
||||
model: openai/kimi-k3
|
||||
api_base: https://api.moonshot.ai/v1
|
||||
api_key: os.environ/MOONSHOT_API_KEY
|
||||
temperature: 1
|
||||
model_info:
|
||||
mode: chat
|
||||
|
||||
# --- (removed 2026-06-20, operator call) the `*` wildcard → llama-swap
|
||||
# (ana-ml2:9292). llama-swap is decommissioned (:9292 confirmed down), so
|
||||
# the wildcard routed every unmatched / typo'd / stale model name to a DEAD
|
||||
|
||||
Reference in New Issue
Block a user