39da1d4a97
The board mixed tools with endpoints. A vLLM seat whose href is a /docs page
sat in the same band as ComfyUI; the MQTT broker and the RustDesk relay, which
have no page at all, sat in Apps; and `Service Networking` was thirteen members
spanning three AdGuards, five Dockges, two Traefiks and four headless agents.
Every group is now one of two kinds and they never mix. TOOLS are expanded and
sit at the top of their tab. ENDPOINTS — an API, a broker, a background agent,
an href that is /docs or /ping or nothing — carry `initiallyCollapsed: true`
and sit at the bottom. Collapsed is not hidden: the eyebrow and its rule still
render, so the tab still says the thing exists and one click expands it.
A second rule fell out of the same pass and now shapes the group boundaries: a
group's members should all carry a widget or none should. A stat strip makes a
card ~50px taller, so one widget card in a row of plain ones opens a void under
the plain ones. That is why AdGuard and Traefik get their own groups rather
than sharing one with Dockge, and it is most of why the old Service Networking
band looked broken. AdGuard (ANA) was the last short card in its row and now
carries the same query/blocked/latency strip as its two siblings — one
infra-ops AdGuard login authenticates against all three instances, verified
against each; it lives in that stack's .env on the host and is vaulted.
The sixteen GPU-backed model seats were deliberately NOT relabelled.
`homepage.group` is read at container creation, so clearer names for
`AI - Inference` and friends would have cost a recreate on six vLLM seats, four
eval seats and four TTS engines — multi-minute model reloads on endpoints peers
reach through the gateway. Order plus `initiallyCollapsed` buys the same
separation for nothing, so those names stay as they are on purpose.
28 containers that ARE cheap to bounce were relabelled, across five hosts, via
rerunnable elway playbooks. Their label steps are gated on the old value still
being present, so a second run reports skipped rather than churning. Two verify
steps were wrong on first contact and are fixed with the reason recorded: the
traefik check raced its own recreate, and asserting a model seat is "running"
cannot answer "did I bounce it" when a seat may be legitimately stopped —
container age can, and now does.
The canonical stacks/ tree was synced to the deployed labels afterwards, so
intent and reality agree again on all fourteen tracked stacks.
Also documents the real nature of the post-recreate blank dashboard, which cost
~25 minutes here and an hour on 2026-08-19. `initialSettings":{}` in the served
HTML is the catch branch of the page's data loader, not a warm-up and not a
cache — and the error can vanish entirely, because the logger is assigned inside
the same try and the catch only logs if the logger exists. Ruled out by
measurement this time: all four API routes return 200 with correct content while
the page serves {}, and the previous known-good settings.yaml reproduces it
identically. The README now carries the one-command test and the next lead.
Before/after, all four tabs: http://10.100.10.50:8090/b/homepage-relayout/
100 lines
4.5 KiB
YAML
100 lines
4.5 KiB
YAML
# waterland-studio — watercolour render service on irv-ml1, port 8410.
|
|
#
|
|
# FastAPI + vanilla-JS SPA fronting the waterland CLI: upload an image, get a
|
|
# watercolour plate and a painted-in reveal animation. Every job shells out to
|
|
# the CLI, which runs a fluid simulation on the A6000.
|
|
#
|
|
# Handed over by waterland-dev 2026-08-19, replacing a bare `nohup` that would
|
|
# not have survived a reboot.
|
|
#
|
|
# ⚠️ THE BUILD CONTEXT LIVES OUTSIDE THIS DIRECTORY, DELIBERATELY.
|
|
# /opt/waterland-studio/src is a checkout of vh/waterland @ main.
|
|
# `deploy-stack.sh` rsyncs this stack dir with --delete, so a checkout kept
|
|
# in here would be destroyed on the next deploy. Refresh it with ./update.sh.
|
|
#
|
|
# ⚠️ SERIAL BY DESIGN — ONE REPLICA, ONE CARD. A render is 20-45s of near-full
|
|
# GPU and the app runs a single worker thread. Two of these on the same A6000
|
|
# would OOM or thrash. Throughput is a conversation about hardware, not about
|
|
# replica count (waterland-dev, explicitly).
|
|
#
|
|
# ⚠️ NO AUTHENTICATION, AND IT ACCEPTS ARBITRARY FILE UPLOADS. It must stay
|
|
# inside the LAN / WireGuard boundary. Do NOT paper over this by putting it
|
|
# behind a proxy with a password — waterland-dev has offered to add a real
|
|
# auth layer if it ever needs wider reach. Ask, don't improvise.
|
|
|
|
name: waterland-studio
|
|
|
|
services:
|
|
waterland-studio:
|
|
build:
|
|
# Absolute paths: the context is the source checkout, the Dockerfile is
|
|
# this version-controlled one, and the two live in different trees.
|
|
context: /opt/waterland-studio/src
|
|
dockerfile: /opt/docker/compose/waterland-studio/Dockerfile
|
|
image: waterland-studio:local
|
|
container_name: ${WLS_CONTAINER:-waterland-studio}
|
|
restart: unless-stopped
|
|
ports:
|
|
- "${WLS_PORT:-8410}:8410"
|
|
volumes:
|
|
# Job store: uploaded sources plus rendered plates and animations.
|
|
# ~12 MB per job with an animation; the app self-evicts at 40 retained
|
|
# jobs (RETAIN in studio/jobs.py), so steady state is bounded ~500 MB.
|
|
# That bound holds ACROSS restarts only as of b72425b, which rehydrates
|
|
# the job index from this volume at startup; before that, eviction was
|
|
# blind to anything a restart had orphaned. See the README.
|
|
# Scratch output, not source-of-truth — losing it costs a re-render.
|
|
- waterland_studio_data:/data
|
|
# cupy JIT kernel cache. Not optional for good behaviour: cupy compiles
|
|
# its kernels through NVRTC on first use, and measured on this host that
|
|
# cold compile costs ~17s — the first 256^2 render after a fresh
|
|
# container took 23.3s against 6.1s warm. Without this volume every
|
|
# restart makes the next user wait 4x, and it looks like the service is
|
|
# slow rather than warming up.
|
|
- waterland_studio_kernels:/root/.cupy
|
|
environment:
|
|
- WATERLAND_STUDIO_DATA=/data
|
|
- WATERLAND_STUDIO_REPO=/app
|
|
- WATERLAND_STUDIO_BACKEND=${WLS_BACKEND:-cupy}
|
|
# 0, not 1 — see the Dockerfile. Exactly one GPU is exposed below, so
|
|
# inside this container the A6000 is index 0 under PCI_BUS_ID ordering.
|
|
- CUDA_VISIBLE_DEVICES_TARGET=${WLS_CUDA_TARGET:-0}
|
|
deploy:
|
|
resources:
|
|
reservations:
|
|
devices:
|
|
- driver: nvidia
|
|
# "1" is the A6000 in DOCKER's device ordering, matching the
|
|
# comfyui stack on this host. Device 0 is the 3090, which hosts
|
|
# the TTS zoo and must not be touched.
|
|
device_ids: ["${WLS_GPU_ID:-1}"]
|
|
capabilities: [gpu]
|
|
healthcheck:
|
|
# /api/health touches no GPU and is safe to poll. The interval is
|
|
# deliberately loose: a render holds the GPU for 20-45s and the app's own
|
|
# job timeout is 480s, so an aggressive probe would be measuring queue
|
|
# depth rather than liveness.
|
|
test: ["CMD-SHELL", "python -c \"import urllib.request,sys; sys.exit(0 if urllib.request.urlopen('http://127.0.0.1:8410/api/health', timeout=5).status==200 else 1)\""]
|
|
interval: 60s
|
|
timeout: 10s
|
|
retries: 3
|
|
start_period: 30s
|
|
networks:
|
|
- tnet
|
|
labels:
|
|
- homepage.group=AI - Studios
|
|
- homepage.name=Waterland Studio
|
|
- homepage.icon=mdi-watercolor
|
|
- homepage.description=Watercolour plate + reveal animation renderer (irv-ml1, A6000)
|
|
- homepage.href=http://10.100.79.3:${WLS_PORT:-8410}/
|
|
- homepage.siteMonitor=http://10.100.79.3:${WLS_PORT:-8410}/api/health
|
|
|
|
volumes:
|
|
waterland_studio_data: {}
|
|
waterland_studio_kernels: {}
|
|
|
|
networks:
|
|
tnet:
|
|
name: traefik-net
|
|
external: true
|