llama-swap: artemis-31b-v1i — add --reasoning on + deepseek format

Worldtree-dev's --reasoning-format gemma suggestion isn't supported in
the deployed llama.cpp build (accepts only none|deepseek|deepseek-legacy).
Falling back to deepseek, which also populates reasoning_content — the
field Worldtree's GemmaProvider fallback path checks. Verified via test
inference: 608 reasoning_content deltas + 199 content deltas + 0 raw
<|channel> marker leaks.
This commit is contained in:
2026-05-27 00:03:03 -07:00
parent 7f918271ac
commit 4a4a6fc803
+4 -2
View File
@@ -320,7 +320,7 @@ models:
"artemis-31b-v1i":
name: "Artemis 31B v1i Q6_K"
description: "BeaverAI Artemis-31B-v1i — Gemma 4 31B dense fine-tune, Q6_K (~28.6GB). 256K context."
description: "BeaverAI Artemis-31B-v1i — Gemma 4 31B dense fine-tune, Q6_K (~28.6GB). 256K context native; served at 128K."
ttl: 600
cmd: |
/app/llama-server
@@ -328,13 +328,15 @@ models:
-hf BeaverAI/Artemis-31B-v1i-GGUF:Q6_K
--port ${PORT}
--n-gpu-layers 999
--ctx-size 32768
--ctx-size 131072
--flash-attn on
--temp 1.0
--top-p 0.95
--top-k 64
--repeat-penalty 1.0
--chat-template-kwargs '{"enable_thinking":true}'
--reasoning on
--reasoning-format deepseek
# ==========================================================================
# GLM MODELS