vh
9e2f787567
The Heid panel plan uses Kimi's coding endpoint, not the general Moonshot API. kimi-k3 now → openai/k3 @ https://api.kimi.com/coding/v1 (KIMI_CODE_API_KEY, Vivace); the original general-endpoint entry is kept as kimi-k3-gen-api (api.moonshot.ai, MOONSHOT_API_KEY). Both verified live through the gateway. Same k3 constraints on both: temperature MUST be 1 (else 400), reasoning model (reasoning_content vs content, needs adequate max_tokens).
52 lines
1.9 KiB
Bash
52 lines
1.9 KiB
Bash
# LiteLLM gateway — copy to .env on ana-docker and fill the secrets.
|
|
# Real .env lives on the server only (gitignored); never commit it.
|
|
|
|
# Image tag. main-stable is the rolling stable; pin to a dated/SHA tag
|
|
# (e.g. main-v1.74.0-stable) once a known-good build is confirmed.
|
|
LITELLM_TAG=main-stable
|
|
|
|
# Publish. Bind to all interfaces on the LAN; 4000 is the LiteLLM default
|
|
# (proxy API + admin/Logs UI at /ui).
|
|
LITELLM_BIND=0.0.0.0
|
|
LITELLM_PORT=4000
|
|
|
|
# Proxy + admin-UI master key. MUST start with "sk-". Generate one:
|
|
# openssl rand -hex 24 | sed 's/^/sk-/'
|
|
LITELLM_MASTER_KEY=
|
|
|
|
# Salt for encrypting any virtual/model keys stored in Postgres. Generate:
|
|
# openssl rand -hex 32
|
|
# Changing this after keys are stored makes them undecryptable — set once.
|
|
LITELLM_SALT_KEY=
|
|
|
|
# Postgres (backing store for spend logs + keys). Password is required;
|
|
# user/db default to "litellm".
|
|
POSTGRES_USER=litellm
|
|
POSTGRES_DB=litellm
|
|
POSTGRES_PASSWORD=
|
|
|
|
# Upstream vLLM API key. The vllm stack on ana-ml2 ships API_KEY= (empty)
|
|
# by default → leave this blank. Set it ONLY if you set API_KEY in the
|
|
# vllm stack's .env.
|
|
VLLM_API_KEY=
|
|
|
|
# Cloud-provider API keys fronted by the gateway (PAID — spend on use; only
|
|
# gateway-keyed callers can reach them). z.ai GLM models
|
|
# (glm-5.1 / glm-5-turbo / glm-4.7 / glm-4.5-air).
|
|
Z_AI_API_KEY=
|
|
|
|
# Kimi (Moonshot) keys — PAID.
|
|
# KIMI_CODE_API_KEY — the CODING endpoint (https://api.kimi.com/coding/v1),
|
|
# Vivace membership; fronts the primary `kimi-k3` arm (upstream model `k3`).
|
|
# MOONSHOT_API_KEY — the general endpoint (https://api.moonshot.ai/v1);
|
|
# fronts the `kimi-k3-gen-api` variant.
|
|
KIMI_CODE_API_KEY=
|
|
MOONSHOT_API_KEY=
|
|
|
|
# --- Langfuse-ready (leave blank for the lean first cut) ---
|
|
# Fill these AND uncomment success/failure_callback in conf/config.yaml
|
|
# to ship full traces to a Langfuse instance. That is the whole upgrade.
|
|
LANGFUSE_PUBLIC_KEY=
|
|
LANGFUSE_SECRET_KEY=
|
|
LANGFUSE_HOST=
|