feat(char-rp-reasoning): Deckard-PKD (Qwen3.5) replaces RpR-v4 after autonomous A/B

Operator wanted a reasoning-RP model that tolerates DRY (RpR-v4 forbids rep/DRY -> a
1/30 loop tail). Ran the full A/B on brokkr's 30-prompt D1 suite (content-only, slop-scored):

- Deckard-PKD (Qwen3.5-27B, DavidAU creative tune) WON: 0/30 loops, 0/30 refusals, clean
  managed reasoning (native Qwen3.5 <think>/enable_thinking), DRY-tolerant, ~57 tok/s,
  runs on the base llama-swap b8840 image. -> now the char-rp-reasoning seat (:8018).
- RpR-v4: 0 refusals but 1/30 loop (no-DRY). Pantheon-27B: clean slop but 7/30 explicit
  refusals + needs the newer ggml-org/llama.cpp image (Qwen3.6 won't load on b8840).
  Snowdrop + Gembrain (Gemma-4): floored (llama.cpp can't manage their reasoning without
  the vetoed template hacks). Losers kept on disk as alternates.
- char-rp (Magidonia) unchanged; gen unchanged. gateway char-rp-reasoning -> Deckard
  sampler (temp 1.0/top_p 0.95/top_k 40/min_p 0.05; DRY server-side).
This commit is contained in:
vh
2026-07-08 15:07:04 -07:00
parent f49c4e40a3
commit 5f79b40982
4 changed files with 62 additions and 36 deletions
+9 -9
View File
@@ -173,23 +173,23 @@ model_list:
model_info:
mode: chat
# char-rp-reasoning -> GGUF managed-REASONING seat (:8018, llama.cpp, char-rp-gguf stack).
# ArliAI QwQ-32B-ArliAI-RpR-v4 Q5_K_M — QwQ reasoning RP tune. Reasoning is ON server-side
# (--reasoning on): the CoT SURFACES in reasoning_content and content stays clean prose
# (fixes the old trace-not-surfacing gap), CoT budget-capped so it can't starve the prose.
# Its reasoning data is QwQ-ABLITERATED → no re-censor inside <think> (the failure mode
# that disqualified Pantheon-Reasoning-27B). ~52 tok/s @ Q5_K_M. RpR card: temp 1.0,
# top_k 40, min_p 0.02, and NO repetition / DRY / XTC penalties. NOT the same model as
# char-rp (best-of-breed per seat) — see stacks/char-rp-gguf/README.md.
# Qwen3.5-27B-Deckard-PKD-Heretic-Uncensored-Thinking i1-Q5_K_M — DavidAU creative tune.
# Reasoning ON server-side (--reasoning on): CoT surfaces in reasoning_content, content stays
# clean prose, budget-capped. DRY server-side (sampler order = dry after temperature) tames looping.
# A/B WINNER 2026-07-08: 0/30 loops + 0/30 refusals; beat RpR-v4 (1/30 loop, forbids DRY),
# Pantheon-27B (7/30 explicit refusals), Snowdrop + Gembrain (llama.cpp template-incompat).
# Deckard decode: temp 1.0, top_p 0.95, top_k 40, min_p 0.05. NOT the same model as char-rp
# (best-of-breed per seat) — see stacks/char-rp-gguf/README.md.
- model_name: char-rp-reasoning
litellm_params:
model: hosted_vllm/qwq-32b-rpr-v4
model: hosted_vllm/deckard-pkd-27b
api_base: http://10.250.50.54:8018/v1
api_key: os.environ/VLLM_API_KEY
temperature: 1.0
top_p: 0.95
extra_body:
top_k: 40
min_p: 0.02
min_p: 0.05
model_info:
mode: chat