feat(char-rp-gguf): swap reasoning seat to custom llama.cpp (master 6eddde0 + PR #25544)
The char-rp-reasoning (Deckard) seat now runs llamacpp-charrp:custom-latest via a new LLAMA_REASONING_IMAGE var (Magidonia char-rp stays on stock — no reasoning bug). Fixes Worldtree #355 at the source (budget multi-terminator handles Qwen3.5's <tool_call> reasoning end-tag). Live 2026-07-13: Deckard loads on Blackwell, serves coherent, reasoning bounds at the 400 budget. Rollback via .env LLAMA_REASONING_IMAGE.
This commit is contained in:
@@ -96,7 +96,13 @@ services:
|
||||
|
||||
# ── REASONING seat — Deckard-PKD (Qwen3.5) managed thinking + DRY. gateway char-rp-reasoning. ──
|
||||
llama-charrp-reasoning:
|
||||
image: ${LLAMA_IMAGE:-ghcr.io/mostlygeek/llama-swap:cuda}
|
||||
# ⚠️ CUSTOM llama.cpp build (master 6eddde0 + unmerged PR #25544) — the Worldtree
|
||||
# #355 reasoning-budget-forcing fix (multi-terminator: handles Qwen3.5's <tool_call>
|
||||
# reasoning end-tag, which stock b8840's single-</think> budget can't match → the seat
|
||||
# loops in reasoning to max_tokens ≈ 22 min). DO NOT revert to a stock image until
|
||||
# #25544 merges upstream. Build recipe + why + rollback: ./llamacpp-custom/README.md.
|
||||
# Rollback: set LLAMA_REASONING_IMAGE=ghcr.io/mostlygeek/llama-swap:cuda in .env + recreate.
|
||||
image: ${LLAMA_REASONING_IMAGE:-llamacpp-charrp:custom-latest}
|
||||
container_name: ${CHARRP_REASONING_CONTAINER:-llama-charrp-reasoning}
|
||||
restart: unless-stopped
|
||||
runtime: nvidia
|
||||
|
||||
@@ -2,9 +2,11 @@
|
||||
|
||||
> **STATUS (2026-07-13):** image `llamacpp-charrp:6eddde0-pr25544` (+ `:custom-latest`)
|
||||
> BUILT on ana-ml2 (reports `version: 10001 (6ce128d0b)`, CUDA 12.8.1, sm_120) and
|
||||
> binary-smoke-tested OK. **Seat swap PENDING** — the live `char-rp-gguf` compose
|
||||
> still points the reasoning seat at stock 8840 until the swap + on-seat forced-close
|
||||
> validation. Once swapped, update this line to DEPLOYED.
|
||||
> binary-smoke-tested OK. **DEPLOYED 2026-07-13** — the live `char-rp-gguf`
|
||||
> reasoning seat runs `llamacpp-charrp:custom-latest` (via `LLAMA_REASONING_IMAGE`);
|
||||
> Deckard loads + serves coherent output + reasoning bounds at the 400 budget.
|
||||
> Definitive tool-path proof = production monitoring (spend_logs `completion_tokens=32768`
|
||||
> runaways should stop; baseline was ~13%/~4 today pre-swap). b61's 300s wall-clock backstops meanwhile.
|
||||
|
||||
**The `llama-charrp-reasoning` seat (Deckard-PKD, ana-ml2:8018) runs a
|
||||
CUSTOM-BUILT llama.cpp, NOT a stock upstream image.** If you are upgrading,
|
||||
|
||||
Reference in New Issue
Block a user