diff --git a/docs/pfi/training-throughput-playbook.md b/docs/pfi/training-throughput-playbook.md index c96ff58..76ce5bb 100644 --- a/docs/pfi/training-throughput-playbook.md +++ b/docs/pfi/training-throughput-playbook.md @@ -372,6 +372,39 @@ means flash AND cuDNN are both reachable and §3.1/§3.3 simply do not apply. Mixed head dims plus a sliding window — Gemma-4's shape — is what forces dense O(n²) attention on Ampere-generation kernels and costs 65% of the step. +## 3.12 ⭐⭐ Merging a tune "back toward the base" can UNDO an abliteration + +A common community remedy for an overfit tune is a partial merge back toward +the base — 50/50 or similar — to recover general capability. **On an +abliterated base that remedy is an undo, not a heal, and it is silent.** + +The published recipes that recommend it merge back into the **stock instruct** +checkpoint (e.g. `google/gemma-4-*-it`). If you follow them literally on a +project whose base was abliterated, you re-introduce exactly the refusal +directions the abliteration was run to remove. The tune still looks "healthier" +on general benchmarks while the property the seat exists for quietly returns. + +**Rule: any merge-back must target the SAME base the LoRA was trained against.** +Never the upstream stock weights, however similar the name. + +⚠ **The generalisation is wider than merge-back.** Community recipe cards are +per-checkpoint artifacts and their findings do not transfer across: + +- **dense vs MoE** — different training dynamics, different memory profile, + different everything +- **stock vs abliterated/uncensored** — different alignment surface +- **size variants of the same family** — different optima + +Real 2026-08-25 example: a recommendation was carried across from a recipe card +for a **dense, stock** 31B onto a **MoE, abliterated** 26B-A4B, on the strength +of the shared model family name. The *overfitting warning* on that card came +from the right architecture; the *five-stage pipeline, reward stacks and +merge-back* came from the wrong one. Same family, three axes apart. + +**Before quoting any recipe card at a decision, state which checkpoint it was +written for and which axes differ from yours.** If the answer is "same family" +that is not an answer. + ## 4. Panel / consult discipline for perf work Perf investigations are unusually good at generating confident wrong answers,