Files
esh-pfi-infrastructure/stacks/litellm/conf
vh 207798de66 feat(litellm): promote cyberprev into the sec / sec-reasoning seats; retire mog-sec
Operator instruction: take down the existing sec seat (mog-sec) and promote
hotdogs (cyberprev) into the sec and sec-reasoning gateway seats.

- mog-sec container (vllm-mog-sec, :8019, fv-ml1 GPU0) taken down; ~48 GB freed
  on GPU0 (cyberprev, already co-resident there, is now the sole GPU0 chat seat).
- Gateway sec -> hosted_vllm/cyberprev-27b @ :8025; sec-reasoning ->
  hosted_vllm/cyberprev-27b-thinking @ :8025. sec/sec-reasoning are ROLE aliases,
  so this is a promotion, not silent substitution (samplers were already identical
  between the sec blocks and cyberprev, so only model+api_base changed).
- Removed the standalone cyberprev-27b / cyberprev-reasoning gateway aliases added
  in the prior commit -- now redundant with sec/sec-reasoning, and the fleet
  convention is a role alias on the gateway with the model's served-name only at
  the vLLM layer (as mog-sec had). cyberprev's vLLM served-names are unchanged.
- Verified e2e through the gateway: sec answers (nmap -sV version detection),
  sec-reasoning answers with a thinking split (127 reasoning tokens); retired
  mog-sec-27b now 400s.

Note: mog-sec was the fleet's only offense+defense/blue-team seat; the sec role
is now offense-only (cyberprev tool-calling). Operator-directed after reviewing
the capability comparison. mog-sec stack files retained for a future restore.
2026-09-14 07:49:40 -07:00
..