feat(erp-seat): run 7 quantized to NVFP4A16 and serving as the trial seat on ana-ml2
- services/erp-seat-quant/run_quant_erp_v7.sh: v6 runner retargeted; dry-run gate passed identically (11,725 targets, 11,520 experts = 30x128x3, routers+vision BF16) - 49 GiB bf16 relayed gx10 -> ana-ml2 (no key path either way; nh3-dev relays), checksums verified against source; quant 49 -> 16 GiB, all post-steps clean - stacks/erp-seat: .env-driven swap to erp-tune-v7-nvfp4a16, served under its TRUE name; homepage labels + README updated, v6 rollback path recorded - stacks/litellm: trial -> erp-tune-v7-nvfp4a16 (config-file alias; /model/update refuses a config model, so this is an edit + restart)
This commit is contained in:
@@ -1,11 +1,18 @@
|
||||
# erp-seat — ERP-tune seat on ana-ml2 (GPU1, `:8021`)
|
||||
|
||||
Serves the latest gated ERP LoRA merge as an **NVFP4A16** (weight-only) compressed-tensors
|
||||
checkpoint so the GX10 is free to train the next run. First occupant: **run 6** —
|
||||
`erp-tune-v6-nvfp4a16` = merged-run06 (jenerallee78 ARA-abliterated Gemma-4-26B-A4B-it, index
|
||||
`33c59654…`, + R47 SFT r6) quantized by `services/erp-seat-quant/`.
|
||||
checkpoint so the GX10 is free to train the next run.
|
||||
|
||||
- **True name only.** `--served-model-name erp-tune-v6-nvfp4a16`. Gateway aliases (`trial`) are
|
||||
**Current occupant: run 7** — `erp-tune-v7-nvfp4a16` = merged-run07 (jenerallee78
|
||||
ARA-abliterated Gemma-4-26B-A4B-it, index `33c59654…`, + R47 SFT r7 = r6 plus the opening-split
|
||||
slot and its companion loss mask), quantized by `services/erp-seat-quant/` on 2026-09-09.
|
||||
49 GiB bf16 → 16 GiB NVFP4A16. Runbook `docs/runbooks/gx10-run-07.md`.
|
||||
|
||||
*Previous: run 6 (`erp-tune-v6-nvfp4a16`, 2026-09-08). Its artifact is still on `/tank/aimodels/`
|
||||
and the pre-swap host env is at `/tmp/erp-seat-env.v6.bak` on ana-ml2, so a rollback is an `.env`
|
||||
flip plus `docker compose up -d`.*
|
||||
|
||||
- **True name only.** `--served-model-name erp-tune-v7-nvfp4a16`. Gateway aliases (`trial`) are
|
||||
set in LiteLLM on the operator's word, never here (no silent substitution — the bf16 arm on the
|
||||
GX10 and this NVFP4 arm are different artifacts).
|
||||
- **Recipe** = `stacks/gemma4-charrp` (same arch + format, proven on this box): `gemma4` tool
|
||||
|
||||
Reference in New Issue
Block a user