docs(litellm): gen records now describe Qwopus3.5-122B (vision-intact), not bjk110 text-only

Comment-only — routing records (served-name qwen3.5-122-a10b @ :8013) unchanged,
so the live gateway is functionally identical; no reload needed.
This commit is contained in:
2026-06-19 10:25:45 -07:00
parent 20e796cf6b
commit 5b06514020
+9 -7
View File
@@ -63,13 +63,15 @@ model_list:
model_info:
mode: chat
# --- Qwen3.5-122B-A10B (abliterated NVFP4, text-only) — the general / `gen` model.
# REPLACED mistral-small-4 on ana-ml2 GPU 0 (operator 2026-06-19; heretic downed,
# mistral entries REMOVED). bjk110 NVFP4 served on :8013 via vLLM + the text-only
# patch, served-name qwen3.5-122-a10b. Thinking split = chat_template_kwargs.
# enable_thinking + --reasoning-parser qwen3 (mirrors qwen3.6-35b-a3b). One upstream
# fanned out under qwen3.5-122-a10b[-reasoning] + aliases qwen-large[-reasoning] +
# gen[-reasoning]; the -reasoning variants enable thinking. Keep api_base in sync.
# --- Qwopus3.5-122B-A10B (Kimi-distilled, abliterated, NVFP4, VISION-INTACT) — the
# general / `gen` model on ana-ml2 GPU 0. Replaced the bjk110 text-only qwen3.5-122b
# 2026-06-19 (which had replaced mistral-small-4). Served on :8013 via vLLM as plain
# multimodal (no text-only patch), served-name qwen3.5-122-a10b — so these records
# route UNCHANGED. Full 256K (262144) @ fp8 KV + CUDA graphs (92.7 tok/s warm);
# tool-calling via qwen3_coder. Thinking split = chat_template_kwargs.enable_thinking
# + --reasoning-parser qwen3. One upstream fanned out under qwen3.5-122-a10b[-reasoning]
# + aliases qwen-large[-reasoning] + gen[-reasoning]; -reasoning variants enable
# thinking. Keep api_base in sync.
# ⚠️ Worldtree CHARACTER backend (was bound to mistral-small-4) is dark until
# repointed — operator-acknowledged. ---
- model_name: qwen3.5-122-a10b