feat(erp-tune): run 7 launched on pfi-gx10 (opening-split slot + mask union) — config, launcher, builder, runbook; erp-seat: pin vLLM nightly 311b3513 (forced tool_choice 1/9 -> 6/9, round trip clean), README on the gemma4-parser design limit

This commit is contained in:
vh
2026-09-08 23:31:09 -07:00
parent 3c54f59878
commit a34a72fc09
8 changed files with 251 additions and 2 deletions
+12
View File
@@ -19,6 +19,18 @@ checkpoint so the GX10 is free to train the next run. First occupant: **run 6**
the model answers in prose (3/3). The rest of the matrix (auto / required / named / parallel /
nested schema / empty `tools: []` / streaming / tool-result round trip) was green before and
after. `stacks/gemma4-charrp` has the same exposure and does NOT carry the flag yet.
- **Forced tool_choice (named / `required`) is prompt-driven on EVERY Gemma-4 seat, not
grammar-enforced — by vLLM design.** `vllm/tool_parsers/gemma4_engine_tool_parser.py` sets
`supports_required_and_named = False` and its `adjust_request` deliberately skips the
structured-output JSON for required/named so the model can emit its native
`<|tool_call>call:…` syntax. A tune that weakened that syntax (this ERP tune) therefore
honours forced calls only sometimes. Measured 2026-09-08, 3 conversations × 3 turns, real
system prompt: v0.26.0 **1/9**; nightly `311b3513` (v0.27.2rc1, the `gen` seat's image) **6/9**
and the tool-result round trip stays clean 3/3 — so the seat runs the nightly. tts-dev measured
0/18 on v0.26.0 with `gen` 18/18 as the positive control, and **`response_format:
json_schema` (guided decoding) 18/18 on this seat** — that is the deterministic path for a
forced call; `tool_choice: auto` works normally. A parser plugin that re-enables guided JSON
would also need JSON extraction in the engine-parser path; not attempted.
- **GPU1 is shared** — check real usage (`nvidia-smi --query-compute-apps=pid,used_memory`) before
raising `ERP_GPU_MEM_UTIL`; the flag sizes KV, not CUDA context.
- **Rollback / next run:** point `ERP_MODEL` + `ERP_SERVED_NAME` at the next quant dir, keep the