feat(char-rp-reasoning): Deckard-PKD (Qwen3.5) replaces RpR-v4 after autonomous A/B
Operator wanted a reasoning-RP model that tolerates DRY (RpR-v4 forbids rep/DRY -> a 1/30 loop tail). Ran the full A/B on brokkr's 30-prompt D1 suite (content-only, slop-scored): - Deckard-PKD (Qwen3.5-27B, DavidAU creative tune) WON: 0/30 loops, 0/30 refusals, clean managed reasoning (native Qwen3.5 <think>/enable_thinking), DRY-tolerant, ~57 tok/s, runs on the base llama-swap b8840 image. -> now the char-rp-reasoning seat (:8018). - RpR-v4: 0 refusals but 1/30 loop (no-DRY). Pantheon-27B: clean slop but 7/30 explicit refusals + needs the newer ggml-org/llama.cpp image (Qwen3.6 won't load on b8840). Snowdrop + Gembrain (Gemma-4): floored (llama.cpp can't manage their reasoning without the vetoed template hacks). Losers kept on disk as alternates. - char-rp (Magidonia) unchanged; gen unchanged. gateway char-rp-reasoning -> Deckard sampler (temp 1.0/top_p 0.95/top_k 40/min_p 0.05; DRY server-side).
This commit is contained in:
@@ -173,23 +173,23 @@ model_list:
|
||||
model_info:
|
||||
mode: chat
|
||||
# char-rp-reasoning -> GGUF managed-REASONING seat (:8018, llama.cpp, char-rp-gguf stack).
|
||||
# ArliAI QwQ-32B-ArliAI-RpR-v4 Q5_K_M — QwQ reasoning RP tune. Reasoning is ON server-side
|
||||
# (--reasoning on): the CoT SURFACES in reasoning_content and content stays clean prose
|
||||
# (fixes the old trace-not-surfacing gap), CoT budget-capped so it can't starve the prose.
|
||||
# Its reasoning data is QwQ-ABLITERATED → no re-censor inside <think> (the failure mode
|
||||
# that disqualified Pantheon-Reasoning-27B). ~52 tok/s @ Q5_K_M. RpR card: temp 1.0,
|
||||
# top_k 40, min_p 0.02, and NO repetition / DRY / XTC penalties. NOT the same model as
|
||||
# char-rp (best-of-breed per seat) — see stacks/char-rp-gguf/README.md.
|
||||
# Qwen3.5-27B-Deckard-PKD-Heretic-Uncensored-Thinking i1-Q5_K_M — DavidAU creative tune.
|
||||
# Reasoning ON server-side (--reasoning on): CoT surfaces in reasoning_content, content stays
|
||||
# clean prose, budget-capped. DRY server-side (sampler order = dry after temperature) tames looping.
|
||||
# A/B WINNER 2026-07-08: 0/30 loops + 0/30 refusals; beat RpR-v4 (1/30 loop, forbids DRY),
|
||||
# Pantheon-27B (7/30 explicit refusals), Snowdrop + Gembrain (llama.cpp template-incompat).
|
||||
# Deckard decode: temp 1.0, top_p 0.95, top_k 40, min_p 0.05. NOT the same model as char-rp
|
||||
# (best-of-breed per seat) — see stacks/char-rp-gguf/README.md.
|
||||
- model_name: char-rp-reasoning
|
||||
litellm_params:
|
||||
model: hosted_vllm/qwq-32b-rpr-v4
|
||||
model: hosted_vllm/deckard-pkd-27b
|
||||
api_base: http://10.250.50.54:8018/v1
|
||||
api_key: os.environ/VLLM_API_KEY
|
||||
temperature: 1.0
|
||||
top_p: 0.95
|
||||
extra_body:
|
||||
top_k: 40
|
||||
min_p: 0.02
|
||||
min_p: 0.05
|
||||
model_info:
|
||||
mode: chat
|
||||
|
||||
|
||||
Reference in New Issue
Block a user