Files
esh-pfi-infrastructure/services/gen-seat-mixed-quant/bench
vh f85d102813 test(gen-seat): orcarouter passes every gate — in-band MTP head delivers +11 points
Gates run against the live seat while the operator tested in parallel.

  <think> leak (n=30, 4 prompt types + multi-turn)   0/30, 0 empty
  MTP acceptance                                     58.4% @ 117.11 tok/s median
  surface                                            6/6
  abliteration survival                              4/4 compliance
  deterministic quality gens                         coherent and correct
  PPL                                                still blocked

For scale on the leak gate, the abandoned h300 build scored 8/30 on this exact
instrument, and its abliteration-survival samples had 2 of 4 open with
"<think>Ok, let's figure this out:". Orcarouter has none.

The headline is MTP acceptance. 58.4% against heresy's byte-identical base head
at 47.2% is +11 points, and it sits level with our own in-band L35 at 59.1%. That
is the additive in-band-vs-graft delta the entire Cold-Fusion experiment was built
to measure and never cleanly delivered -- orcarouter handed it over for free
because the author had already done the Robinson edit on the head.

Surface 6/6 covers plain chat, vision, tool calling, the thinking split, a
36,042-token long-context retrieval, and streaming.

PPL remains blocked on a spec-decode-free probe seat: it needs ~22 GB and GPU1 has
~16 GB free. Comparison target is heresy at 6.910.
2026-08-21 01:48:09 -07:00
..