vh/esh-pfi-infrastructure
1
0
Fork 0
Code Issues 7 Pull Requests Actions Packages Projects Releases Wiki Activity

feat(char-rp-gguf): swap reasoning seat to custom llama.cpp (master 6eddde0 + PR #25544)

Browse Source 
The char-rp-reasoning (Deckard) seat now runs llamacpp-charrp:custom-latest via a
new LLAMA_REASONING_IMAGE var (Magidonia char-rp stays on stock — no reasoning bug).
Fixes Worldtree #355 at the source (budget multi-terminator handles Qwen3.5's
<tool_call> reasoning end-tag). Live 2026-07-13: Deckard loads on Blackwell, serves
coherent, reasoning bounds at the 400 budget. Rollback via .env LLAMA_REASONING_IMAGE.
This commit is contained in:
vh
2026-07-13 13:47:42 -07:00
parent 6cf3e78973
commit 85792f4b55
3 changed files with 13 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files
stacks/char-rp-gguf/llamacpp-custom/README.md
+5 -3
View File
@@ -2,9 +2,11 @@
> **STATUS (2026-07-13):** image `llamacpp-charrp:6eddde0-pr25544` (+ `:custom-latest`)
> BUILT on ana-ml2 (reports `version: 10001 (6ce128d0b)`, CUDA 12.8.1, sm_120) and
> binary-smoke-tested OK. **Seat swap PENDING** — the live `char-rp-gguf` compose
> still points the reasoning seat at stock 8840 until the swap + on-seat forced-close
> validation. Once swapped, update this line to DEPLOYED.
> binary-smoke-tested OK. **DEPLOYED 2026-07-13** — the live `char-rp-gguf`
> reasoning seat runs `llamacpp-charrp:custom-latest` (via `LLAMA_REASONING_IMAGE`);
> Deckard loads + serves coherent output + reasoning bounds at the 400 budget.
> Definitive tool-path proof = production monitoring (spend_logs `completion_tokens=32768`
> runaways should stop; baseline was ~13%/~4 today pre-swap). b61's 300s wall-clock backstops meanwhile.
**The `llama-charrp-reasoning` seat (Deckard-PKD, ana-ml2:8018) runs a
CUSTOM-BUILT llama.cpp, NOT a stock upstream image.** If you are upgrading,