vh
f08b6cbddf
Replaces the ad-hoc docker-run seats with proper compose stacks on ana-ml2, mirrored here: - meromero-charrp: G4-MeroMero-v2-31B NVFP4A16, char-rp prose (non-thinking, multimodal, vision-enabled), GPU0, 256K @ ~2x. util 0.52 (leaves ~4.6GB GPU0 headroom). - darkscarlett-charrp-reasoning: Dark-Scarlett-v1.0-27B NVFP4A16 (Qwen wrapper recipe), char-rp-reasoning thinking seat, GPU1, 256K. MTP deferred (no spec-decode). Both survive reboot now. Supersede the retired char-rp-gguf + heretic2-charrp-reasoning stacks.
5 lines
141 B
Bash
5 lines
141 B
Bash
# ana-ml2 GPU1 char-rp-reasoning seat (Dark-Scarlett). Real .env lives on the host.
|
|
DS_GPU_MEM_UTIL=0.44
|
|
DS_MAX_MODEL_LEN=262144
|
|
DS_GPU_ID=1
|