vh
11b688ff68
MuXodious/Qwen3.8-27B-absolute-heresy (Heretic v1.4.0 + SOMPOA, trial T377, pin c2374593) quantized through our mixed NVFP4+FP8 recipe and promoted after passing the full gate on the probe port. Gate vs incumbent -- MTP acceptance 47.2% (48.2%), decode 103.5 tok/s (96.4), prefill 6618/5403 at 6.7k/27k (6334/5085), TTFT 27k 5.00s (5.31s), perplexity 6.910 (7.059, 2.1% better), surface 6/6, abliteration compliance 4/4. On our battery-instruct arm -- the framing that actually elicits refusals -- 0/55 with zero EMPTY, so no catatonia at the hard edge. Speed deltas are image-confounded: the probe ran the seat's pinned nightly while the incumbent's stored numbers came from an earlier image. Read as not worse. Acceptance, perplexity, surface and refusal are apples-to-apples. All 7 LiteLLM aliases verified end-to-end. GPU0 at 91.3/97.9 GB with meromero healthy -- more headroom than the previous build. Incumbent weights untouched and .env.bak-heresy-20260817 in place for rollback. Candidate is a 2-day-old RC1 with ~348 downloads; watch real multi-turn use.
13 lines
284 B
JSON
13 lines
284 B
JSON
{
|
|
"tag": "heresy",
|
|
"~6.5k": {
|
|
"approx_prompt_tokens": 6743,
|
|
"ttft_median_s": 1.0188992200419307,
|
|
"prefill_tok_s": 6617.926353621613
|
|
},
|
|
"~26k": {
|
|
"approx_prompt_tokens": 26993,
|
|
"ttft_median_s": 4.995705442503095,
|
|
"prefill_tok_s": 5403.240905747873
|
|
}
|
|
} |