From 2bc565ea78fd77d7e5ece2a25e03378f43186fc2 Mon Sep 17 00:00:00 2001 From: Vuong Hoang Date: Wed, 8 Jul 2026 15:49:17 -0700 Subject: [PATCH] =?UTF-8?q?memory:=20snapshot=20=E2=80=94=20RP-seat=20camp?= =?UTF-8?q?aign=20closed=20(char-rp=3DMagidonia=20128K,=20char-rp-reasonin?= =?UTF-8?q?g=3DDeckard-PKD=20256K,=20gen@0.37);=20worldtree=20Mimir=20enve?= =?UTF-8?q?lopes=20synced?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- persistent-memory.md | 17 ++++++++++++++++- 1 file changed, 16 insertions(+), 1 deletion(-) diff --git a/persistent-memory.md b/persistent-memory.md index 6a72b68..325f747 100644 --- a/persistent-memory.md +++ b/persistent-memory.md @@ -102,7 +102,7 @@ no longer deployed sidecars here. See Recent decisions.) ## Current state / in-flight -_As of 2026-07-08 — OFF-THE-SHELF INFERENCE STACK is the active work (home-training pivoted away):_ +_As of 2026-07-08 — 3-SEAT OFF-THE-SHELF INFERENCE STACK COMPLETE + SETTLED (gen + char-rp + char-rp-reasoning all LIVE + canonical; RP-seat build campaign closed this session). Home-training dormant. Serving-topology detail below is the live state:_ - **SERVING TOPOLOGY, ana-ml2 GPU0 (co-resident), served via the `qwen36-27b-aeon` + `ms32-24b-angel` compose stacks:** - **gen (:8015) = `qwen36-35b-a3b-heretic-nvfp4` — LIVE + GOOD.** Off-the-shelf NVFP4 of @@ -280,6 +280,21 @@ _Earlier (2026-07-07):_ ## Recent decisions +- `[2026-07-08]` **RP-SEAT CAMPAIGN CLOSED — char-rp = Magidonia-24B-v4.3 (128K), char-rp-reasoning = Deckard-PKD + Qwen3.5-27B (256K); both GGUF/llama.cpp on ana-ml2 GPU0 alongside gen (35B-A3B, util 0.37), ~4G GPU0 margin.** + Arc: (1) replaced broken Angel NVFP4 with Magidonia prose + QwQ-RpR-v4 reasoning (b268f93); (2) max-context via q8_0 + KV (f570604); (3) canonical samplers for all 4 gateway seats, dvalin-derived + char-rp A/B-tuned (aac4bcf); + (4) rebalanced gen 0.40→0.37 to fund char-rp 128K (f49c4e4); (5) RE-A/B'd the reasoning seat (operator wanted a + DRY-tolerant model): **Deckard WON** on brokkr's frozen scorer (composite 2.176, 0/30 loops, 0/30 refusals) over + RpR-v4 (3.716, 1/30 loop), Pantheon-Reasoning (1.383 but 7/30 refusals), Snowdrop+Gembrain (llama.cpp + template-incompat) — deployed (5f79b40); (6) Deckard→256K (41305bf); (7) dvalin CONFIRMED Deckard samplers = the + live A/B set is canonical (4954ca0). **GATE LESSON: a llama.cpp reasoning seat needs a STOCK template that natively + opens ``/`enable_thinking` (Qwen3.x/QwQ pass; ChatML + Gemma-4 fail) — no monkeypatching. INFRA: llama-swap + b8840 can't load Qwen3.6/Gemma-4 archs → `ghcr.io/ggml-org/llama.cpp:server-cuda` (pulled on ana-ml2).** +- `[2026-07-08]` **worldtree Mimir deploy-blocker resolved (mid-session):** synced `persona.envelopes.assistant` + + `envelope_grants:[]` verbatim from the baked canonical into BOTH corviduo-dev instances (demo+personal), + YAML-validated via each container's own parser; worldtree-dev cleared to push the Mimir-bound image. (Was my + parked R32 1C envelope-mirror come due — see [[reference_corviduo_dev_emergency_ops]] config-sync recipe.) - `[2026-07-08]` **OFF-THE-SHELF INFERENCE PIVOT executed — serve curated abliterated models, stop home-training.** Final topology: **gen = `llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-NVFP4-Experts-Only`** (LIVE, modelopt, vision, util 0.40), **char-rp = an RP unicorn to be found on fresh context** (see Current state). Intermediate steps