docs(flash-next-seat): dealignai weights deleted — record that no local rollback exists
Operator instruction: delete the displaced dealignai checkpoint. 125 GiB reclaimed from /tank (59% -> 57% used). Verified before removing: not mounted by any running or exited container, no symlinks, no inodes shared with the converted orcarouter directory. Every "rollback is two .env keys" statement across the stack README, the .env.example, persistent-memory and its detail file was true when written and is false now -- the .env backup still names paths that no longer exist. Corrected in place rather than left as false reassurance, since a stale rollback instruction is discovered precisely when it is needed. Reverting this seat now costs a 126 GiB re-download. The quality A/B against dealignai is likewise no longer runnable locally: its reference arm is gone. The pristine 170 GiB orcarouter download is retained deliberately -- it is what makes the PLE bf16->FP8 conversion reproducible without re-fetching -- and that is now recorded so a future session does not reclaim it as an obvious duplicate. Also notes that ~75 GiB of non-PLE shards are duplicated between the pristine and converted orca directories (the convert's hardlinks hit EXDEV across two container bind mounts); both now sit directly on /tank, so relinking would reclaim it if /tank ever tightens.
This commit is contained in:
@@ -27,8 +27,11 @@ FN_CONTAINER_NAME=vllm-flash-next
|
||||
# in-house (2026-09-14) so vLLM's from_quant_config branch 1 selects the FP8 PLE method.
|
||||
# ⚠ compressed-tensors, NOT modelopt_fp4 — this checkpoint is weight-only on BOTH axes
|
||||
# (W8 float attn / W4 float experts, input_activations: null), which is why it was chosen
|
||||
# over the dealignai W4A4 build. Rollback: the dealignai pair below, both still on disk.
|
||||
# FN_MODEL=/tank/aimodels/qwen38-flash-next-abliterated-nvfp4 FN_QUANT=modelopt_fp4
|
||||
# over the dealignai W4A4 build.
|
||||
# ⚠⚠ NO LOCAL ROLLBACK: the dealignai weights were DELETED 2026-09-14 (operator instruction).
|
||||
# Reverting means re-downloading 126 GiB of dealignai/Qwen3.8-Flash-Next-ABLITERATED-NVFP4.
|
||||
# The pristine 170 GiB orcarouter source is kept at qwen38-flash-next-orcarouter-nvfp4 so the
|
||||
# PLE bf16→FP8 conversion can be redone without re-fetching.
|
||||
FN_MODEL=/tank/aimodels/qwen38-flash-next-orcarouter-nvfp4-plefp8
|
||||
FN_QUANT=compressed-tensors
|
||||
FN_SERVED_NAME=qwen3.8-flash-next-uncensored
|
||||
|
||||
@@ -99,9 +99,16 @@ zero saturation — and the same FP8-PLE treatment dealignai already shipped, so
|
||||
regression against the seat it replaced. `weight_scale` is written BF16 [1] to match the
|
||||
published format. MTP head (31 tensors) and the vision tower carry through untouched.
|
||||
|
||||
⚠ Still unmeasured: a controlled quality A/B against dealignai — which is the entire reason
|
||||
for the swap — and a deep-prefill probe at 262K on this checkpoint. Rollback is two `.env`
|
||||
keys; the dealignai checkpoint is still on disk.
|
||||
⚠⚠ **THERE IS NO LOCAL ROLLBACK.** The dealignai checkpoint was deleted on operator
|
||||
instruction 2026-09-14 (125 GiB reclaimed). Reverting this seat now means **re-downloading
|
||||
126 GiB** from `dealignai/Qwen3.8-Flash-Next-ABLITERATED-NVFP4`, not flipping two `.env`
|
||||
keys. The `.env` backup (`.env.bak-preorca-20260914-023408`) still names the old paths, but
|
||||
those paths no longer exist — treat it as a record of the old settings, not a working revert.
|
||||
|
||||
⚠ Still unmeasured, and now unbacked: a controlled quality A/B against dealignai — which was
|
||||
the entire reason for the swap, and whose reference arm is gone — and a deep-prefill probe at
|
||||
262K on this checkpoint. The 170 GiB pristine `qwen38-flash-next-orcarouter-nvfp4` download is
|
||||
retained; it is what lets the PLE conversion be redone without re-fetching.
|
||||
|
||||
Rejected alternatives, for the record: `nvidia/…-NVFP4` is the cleanest ModelOpt build but is
|
||||
not abliterated; `lovedheart/…-Pruned-RTXPRO-6000` prunes to 448 of 512 experts;
|
||||
|
||||
Reference in New Issue
Block a user