CLAUDE.md: gen/summarizer seat is now qwen3.8-27b-uncensored (gen-seat/vllm-gen)
This commit is contained in:
@@ -487,11 +487,12 @@ note says otherwise. On other boxes, check first.)
|
||||
plus paid passthroughs. Essentially-**free local compute** for low-caliber, high-volume,
|
||||
parallelizable LLM work. The **always-available summarizer / classifier endpoint** is the
|
||||
`summarizer` (+ `summarizer-large`) / `classifier` alias — the go-to for summarization,
|
||||
naming/labeling, classification, and triage. Since the 2026-07 GPU re-org it's backed by
|
||||
**`qwen3.6-35b-a3b-heretic`** (efficient MoE, ~3B active) on ana-ml2 `:8015` — the same "gen"
|
||||
seat that also serves `gen` (general chat), `gen-reasoning` (thinking variant), `image-judge`,
|
||||
and `qwen-image-bench`. (`granite-4.1-8b` and the old `qwen3.5-9b-fp8` vision seat are retired
|
||||
from the roster.) Treat the summarizer as a standing dependency you can reach any time. The
|
||||
naming/labeling, classification, and triage. Since 2026-08-15 it's backed by
|
||||
**`qwen3.8-27b-uncensored`** (JonathanColetti Heretic-abliterated Qwen3.8-27B, quantized
|
||||
in-house to NVFP4 W4A16 + grafted MTP head, vision-intact, 262K ctx) on ana-ml2 `:8015` —
|
||||
compose project `gen-seat` / container `vllm-gen` — the same "gen" seat that also serves
|
||||
`gen` (general chat), `gen-reasoning` (thinking variant), `image-judge`, and `qwen-image-bench`.
|
||||
(Prior `qwen3.6-35b-a3b-heretic` MoE and `granite-4.1-8b` are retired from the roster.) Treat the summarizer as a standing dependency you can reach any time. The
|
||||
roster drifts — query the live list at `:4000/v1/models` (~30 entries as of 2026-08-14); the
|
||||
current tool-relevant set:
|
||||
- **Embeddings / rerankers (local, free):** `qwen3-embedding`, `qwen3-reranker`, `reranker`
|
||||
|
||||
Reference in New Issue
Block a user