vh/ratatoskr
1
0
Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity

memory: capture brokkr's pinned scoring rubric for the referential-frame probe (vocab-adherence manipulation check load-bearing)

Browse Source
This commit is contained in:
vh
2026-07-17 01:36:01 -07:00
parent 0e7a04331a
commit bf421f1203
1 changed files with 6 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
persistent-memory.md
+6 -1
View File
@@ -110,7 +110,12 @@ cause is WORLDTREE-side ranking/hygiene (WT #364), NOT our wire. Full arc:
Zero config delta (existing probe key + :8081). **FIXTURE-build (deferrable pre-work): pull ~15-25 Zero config delta (existing probe key + :8081). **FIXTURE-build (deferrable pre-work): pull ~15-25
char-self + balancing (genuine-user/both/other) per seat from the P06 battery** (manifest_memory.jsonl + char-self + balancing (genuine-user/both/other) per seat from the P06 battery** (manifest_memory.jsonl +
eval_profiles), construction-known gold, WT hand-labels ambiguous, brokkr adjudicates. Run fires when eval_profiles), construction-known gold, WT hand-labels ambiguous, brokkr adjudicates. Run fires when
b122 lands on :8081. b122 lands on :8081. **PINNED SCORING RUBRIC (brokkr, binding):** (1) map `subject_raw`→canonical via
the ARM'S OWN vocab (response-meta echo), compare to gold; (2) 3 token cases — arm-token→arm-map /
canonical-under-B-C = swap-didn't-take→map+COUNT / off-menu→UNSCORABLE-ERROR row in n_actual (never
silent→self); (3) **report VOCAB-ADHERENCE rate (offered/reverted/off-menu) per arm per seat ALONGSIDE
every accuracy number — the load-bearing manipulation check; interpret recall deltas ONLY where
adherence adequate**; (4) char-self fixtures carry per-item construction-provenance.
**Open operator-sequenced task (NOT urgent):** adopt the bifrost snapshot-cursor (bifrost-dev **Open operator-sequenced task (NOT urgent):** adopt the bifrost snapshot-cursor (bifrost-dev
ruled it NORMATIVE, offset not blessed; conformance harness shipped in bifrost 1.1.3). Single-page ruled it NORMATIVE, offset not blessed; conformance harness shipped in bifrost 1.1.3). Single-page