vh
39da1d4a97
The board mixed tools with endpoints. A vLLM seat whose href is a /docs page
sat in the same band as ComfyUI; the MQTT broker and the RustDesk relay, which
have no page at all, sat in Apps; and `Service Networking` was thirteen members
spanning three AdGuards, five Dockges, two Traefiks and four headless agents.
Every group is now one of two kinds and they never mix. TOOLS are expanded and
sit at the top of their tab. ENDPOINTS — an API, a broker, a background agent,
an href that is /docs or /ping or nothing — carry `initiallyCollapsed: true`
and sit at the bottom. Collapsed is not hidden: the eyebrow and its rule still
render, so the tab still says the thing exists and one click expands it.
A second rule fell out of the same pass and now shapes the group boundaries: a
group's members should all carry a widget or none should. A stat strip makes a
card ~50px taller, so one widget card in a row of plain ones opens a void under
the plain ones. That is why AdGuard and Traefik get their own groups rather
than sharing one with Dockge, and it is most of why the old Service Networking
band looked broken. AdGuard (ANA) was the last short card in its row and now
carries the same query/blocked/latency strip as its two siblings — one
infra-ops AdGuard login authenticates against all three instances, verified
against each; it lives in that stack's .env on the host and is vaulted.
The sixteen GPU-backed model seats were deliberately NOT relabelled.
`homepage.group` is read at container creation, so clearer names for
`AI - Inference` and friends would have cost a recreate on six vLLM seats, four
eval seats and four TTS engines — multi-minute model reloads on endpoints peers
reach through the gateway. Order plus `initiallyCollapsed` buys the same
separation for nothing, so those names stay as they are on purpose.
28 containers that ARE cheap to bounce were relabelled, across five hosts, via
rerunnable elway playbooks. Their label steps are gated on the old value still
being present, so a second run reports skipped rather than churning. Two verify
steps were wrong on first contact and are fixed with the reason recorded: the
traefik check raced its own recreate, and asserting a model seat is "running"
cannot answer "did I bounce it" when a seat may be legitimately stopped —
container age can, and now does.
The canonical stacks/ tree was synced to the deployed labels afterwards, so
intent and reality agree again on all fourteen tracked stacks.
Also documents the real nature of the post-recreate blank dashboard, which cost
~25 minutes here and an hour on 2026-08-19. `initialSettings":{}` in the served
HTML is the catch branch of the page's data loader, not a warm-up and not a
cache — and the error can vanish entirely, because the logger is assigned inside
the same try and the catch only logs if the logger exists. Ruled out by
measurement this time: all four API routes return 200 with correct content while
the page serves {}, and the previous known-good settings.yaml reproduces it
identically. The README now carries the one-command test and the next lead.
Before/after, all four tabs: http://10.100.10.50:8090/b/homepage-relayout/
103 lines
5.2 KiB
YAML
103 lines
5.2 KiB
YAML
# ComfyUI — node-based Stable Diffusion / Flux inference UI.
|
|
#
|
|
# Runs on irv-ml1 (dual GPU: RTX 3090 + RTX A6000). PINNED to the A6000
|
|
# (device 1) via NVIDIA_VISIBLE_DEVICES=1 — the 3090 hosts the audio/TTS
|
|
# zoo (chatterbox, parakeet, vibevoice, ytvc, kokoro) so ComfyUI gets the
|
|
# full 48 GB A6000 to itself (operator consolidation 2026-06-18).
|
|
#
|
|
# All user state — models, workflows, custom_nodes, input, output —
|
|
# lives under a single BASE_DIRECTORY tree on /worktank (462 GB
|
|
# dedicated), owned by lkraven:lkraven (1000:1000) so external
|
|
# tooling can read and write workflow files directly on the host.
|
|
#
|
|
# Runtime state (ComfyUI source, venv, pip cache) lives in a bind
|
|
# mount at ${COMFYUI_RUNDIR} — disposable (can be wiped on version
|
|
# bumps to force re-bootstrap), but owned by the host user so no
|
|
# sudo dance is needed. (Named volumes would be created root-owned
|
|
# and the image refuses to chown a mounted path.)
|
|
#
|
|
# First-run prerequisite: both ${COMFYUI_BASEDIR} and ${COMFYUI_RUNDIR}
|
|
# must exist on the host with ownership matching COMFYUI_UID:COMFYUI_GID
|
|
# before `up`. See README for the bootstrap command.
|
|
#
|
|
# All tunables live in .env — edit that, not this file.
|
|
|
|
services:
|
|
comfyui:
|
|
image: mmartial/comfyui-nvidia-docker:${COMFYUI_VERSION}
|
|
container_name: comfyui
|
|
restart: unless-stopped
|
|
runtime: nvidia
|
|
ports:
|
|
- "${COMFYUI_BIND:-0.0.0.0}:${COMFYUI_PORT}:8188"
|
|
environment:
|
|
- NVIDIA_VISIBLE_DEVICES=1
|
|
# Pin torch at the current 2.12.1+cu129 so the boot script stops
|
|
# auto-upgrading it — compiled SageAttention kernels must not drift
|
|
# (comfy-dev torch-pin, operator-approved 2026-06-18).
|
|
- DISABLE_UPGRADES=true
|
|
- WANTED_UID=${COMFYUI_UID}
|
|
- WANTED_GID=${COMFYUI_GID}
|
|
- BASE_DIRECTORY=/basedir
|
|
- SECURITY_LEVEL=${COMFYUI_SECURITY_LEVEL:-normal}
|
|
- USE_UV=true
|
|
# Extra ComfyUI launch flags (image appends these to main.py, then adds
|
|
# --base-directory + --enable-manager itself):
|
|
# --fp8_e4m3fn-text-enc — load the FLUX.2 Qwen3-8B text encoder as fp8
|
|
# (~8.7 GB) instead of upcasting the fp8 file to fp16 (~16 GB). Matches
|
|
# the box's Ampere-fp8 posture; the encoder runs once per gen so the
|
|
# upcast-on-compute cost is negligible.
|
|
# --use-sage-attention — 0.24.1's NATIVE attention selection (the node-based
|
|
# BlehGlobalSageAttention is dead on 0.24.1: "does not support the new
|
|
# ComfyUI attention changes"). Binds the in-image sageattention v2.2.0
|
|
# sm_86 build (rebuilt against the pinned torch 2.12.1). Global speedup
|
|
# across Flux/SDXL/Wan (comfy-dev benchmarking, 2026-06-18).
|
|
#
|
|
# ALLOCATOR (2026-07-19 — comfy-dev A/B, operator-run — cudaMallocAsync WON).
|
|
# We deliberately DO NOT pass --disable-cuda-malloc, so ComfyUI keeps CUDA's
|
|
# default async allocator (cudaMallocAsync). History: --disable-cuda-malloc +
|
|
# PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True were added when the A6000 was
|
|
# SHARED with the TTS zoo (the native allocator dodged a cudaMallocAsync
|
|
# phantom-OOM). TTS moved to the 3090 (2026-06-18), removing that trigger; the
|
|
# LTX-2.3 v1.5.0 LoRA stack (DMD+OmniNFT+act LoRAs patching the DiT + the 12B
|
|
# Gemma text-encoder) then began hitting the 48 GB ceiling under the native
|
|
# allocator, which fragments/over-reserves (~45 GB allocated+reserved-but-
|
|
# unallocated) and OOMs at TE load. cudaMallocAsync packs tighter + promptly
|
|
# returns freed blocks, so the same job now FITS: the operator's previously-
|
|
# OOMing stress test peaks ~82% VRAM (~40/48 GB) with headroom, 0 OOM/errors.
|
|
# COUPLING: PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True is native-allocator-
|
|
# only, so it is REMOVED here (inert/invalid under cudaMallocAsync) — revert BOTH
|
|
# together. If the TTS zoo ever moves back onto the A6000, re-evaluate the pair.
|
|
- COMFY_CMDLINE_EXTRA=--fp8_e4m3fn-text-enc --use-sage-attention
|
|
volumes:
|
|
- ${COMFYUI_BASEDIR}:/basedir
|
|
# models/ overlaid from storetank. The ~325 GB model tree was migrated
|
|
# off the near-full worktank NVMe (2026-06-13) to /storetank/arbo (roomy
|
|
# SATA SSD). This nested mount shadows the models subdir of /basedir;
|
|
# everything else (custom_nodes, output, input, user, workflows) stays on
|
|
# worktank. Inventory: docs/arbo-comfyui-model-catalog.md.
|
|
- ${COMFYUI_MODELS_DIR:-/storetank/arbo/models}:/basedir/models
|
|
- ${COMFYUI_RUNDIR}:/comfy/mnt
|
|
healthcheck:
|
|
test: ["CMD-SHELL", "curl -fsS http://localhost:8188/ >/dev/null || exit 1"]
|
|
interval: 30s
|
|
timeout: 10s
|
|
retries: 3
|
|
# First boot installs ~5 GB of Python packages; allow generous
|
|
# start_period so the container isn't marked unhealthy during
|
|
# bootstrap. Subsequent starts are fast.
|
|
start_period: 600s
|
|
networks:
|
|
- tnet
|
|
labels:
|
|
- homepage.group=AI - Studios
|
|
- homepage.name=ComfyUI
|
|
- homepage.icon=mdi-image-auto-adjust
|
|
- homepage.description=Node-based SD/Flux inference (irv-ml1)
|
|
- homepage.href=http://10.100.79.3:${COMFYUI_PORT}
|
|
|
|
networks:
|
|
tnet:
|
|
name: traefik-net
|
|
external: true
|