Files
esh-pfi-infrastructure/stacks/waterland-studio/compose.yaml
T
vh e0d1c44137 chore(fleet): repoint stale irv-ml1 refs (10.100.79.3 -> irv-ml1.nh3.internal)
The 2026-09-06 headscale cutover retired irv-ml1's wg0 tunnel IP 10.100.79.3
(now 10.6.110.50). Repointed all LIVE canonical refs to the DNS NAME so the next
move can't re-break them: homepage.href/siteMonitor labels across 25 stack
composes, load-bearing env defaults (asset-engine INFERENCE_HOST, open-webui
AUDIO_TTS_OPENAI_API_BASE_URL, skaldsong SKALDSONG_TTS_BASE_URL, zonos-gateway
ZONOS_URL, dia), homepage services.yaml manual cards (Voice Design Studio,
IRV-ML1), and servers/irv-ml1/ssh-target. Updated the stale 'WG tunnel' comment
to the mesh reality.

Left as-is: README curl-examples and .env.example comments (docs), and historical
mentions in CLAUDE.md/persistent-memory. NOTE: applying the label repoints to the
RUNNING irv-ml1 containers needs a recreate per service (labels read at creation);
deployed .env values are separate from these canonical defaults.
2026-09-07 15:08:56 -07:00

100 lines
4.5 KiB
YAML

# waterland-studio — watercolour render service on irv-ml1, port 8410.
#
# FastAPI + vanilla-JS SPA fronting the waterland CLI: upload an image, get a
# watercolour plate and a painted-in reveal animation. Every job shells out to
# the CLI, which runs a fluid simulation on the A6000.
#
# Handed over by waterland-dev 2026-08-19, replacing a bare `nohup` that would
# not have survived a reboot.
#
# ⚠️ THE BUILD CONTEXT LIVES OUTSIDE THIS DIRECTORY, DELIBERATELY.
# /opt/waterland-studio/src is a checkout of vh/waterland @ main.
# `deploy-stack.sh` rsyncs this stack dir with --delete, so a checkout kept
# in here would be destroyed on the next deploy. Refresh it with ./update.sh.
#
# ⚠️ SERIAL BY DESIGN — ONE REPLICA, ONE CARD. A render is 20-45s of near-full
# GPU and the app runs a single worker thread. Two of these on the same A6000
# would OOM or thrash. Throughput is a conversation about hardware, not about
# replica count (waterland-dev, explicitly).
#
# ⚠️ NO AUTHENTICATION, AND IT ACCEPTS ARBITRARY FILE UPLOADS. It must stay
# inside the LAN / WireGuard boundary. Do NOT paper over this by putting it
# behind a proxy with a password — waterland-dev has offered to add a real
# auth layer if it ever needs wider reach. Ask, don't improvise.
name: waterland-studio
services:
waterland-studio:
build:
# Absolute paths: the context is the source checkout, the Dockerfile is
# this version-controlled one, and the two live in different trees.
context: /opt/waterland-studio/src
dockerfile: /opt/docker/compose/waterland-studio/Dockerfile
image: waterland-studio:local
container_name: ${WLS_CONTAINER:-waterland-studio}
restart: unless-stopped
ports:
- "${WLS_PORT:-8410}:8410"
volumes:
# Job store: uploaded sources plus rendered plates and animations.
# ~12 MB per job with an animation; the app self-evicts at 40 retained
# jobs (RETAIN in studio/jobs.py), so steady state is bounded ~500 MB.
# That bound holds ACROSS restarts only as of b72425b, which rehydrates
# the job index from this volume at startup; before that, eviction was
# blind to anything a restart had orphaned. See the README.
# Scratch output, not source-of-truth — losing it costs a re-render.
- waterland_studio_data:/data
# cupy JIT kernel cache. Not optional for good behaviour: cupy compiles
# its kernels through NVRTC on first use, and measured on this host that
# cold compile costs ~17s — the first 256^2 render after a fresh
# container took 23.3s against 6.1s warm. Without this volume every
# restart makes the next user wait 4x, and it looks like the service is
# slow rather than warming up.
- waterland_studio_kernels:/root/.cupy
environment:
- WATERLAND_STUDIO_DATA=/data
- WATERLAND_STUDIO_REPO=/app
- WATERLAND_STUDIO_BACKEND=${WLS_BACKEND:-cupy}
# 0, not 1 — see the Dockerfile. Exactly one GPU is exposed below, so
# inside this container the A6000 is index 0 under PCI_BUS_ID ordering.
- CUDA_VISIBLE_DEVICES_TARGET=${WLS_CUDA_TARGET:-0}
deploy:
resources:
reservations:
devices:
- driver: nvidia
# "1" is the A6000 in DOCKER's device ordering, matching the
# comfyui stack on this host. Device 0 is the 3090, which hosts
# the TTS zoo and must not be touched.
device_ids: ["${WLS_GPU_ID:-1}"]
capabilities: [gpu]
healthcheck:
# /api/health touches no GPU and is safe to poll. The interval is
# deliberately loose: a render holds the GPU for 20-45s and the app's own
# job timeout is 480s, so an aggressive probe would be measuring queue
# depth rather than liveness.
test: ["CMD-SHELL", "python -c \"import urllib.request,sys; sys.exit(0 if urllib.request.urlopen('http://127.0.0.1:8410/api/health', timeout=5).status==200 else 1)\""]
interval: 60s
timeout: 10s
retries: 3
start_period: 30s
networks:
- tnet
labels:
- homepage.group=AI - Studios
- homepage.name=Waterland Studio
- homepage.icon=mdi-watercolor
- homepage.description=Watercolour plate + reveal animation renderer (irv-ml1, A6000)
- homepage.href=http://irv-ml1.nh3.internal:${WLS_PORT:-8410}/
- homepage.siteMonitor=http://irv-ml1.nh3.internal:${WLS_PORT:-8410}/api/health
volumes:
waterland_studio_data: {}
waterland_studio_kernels: {}
networks:
tnet:
name: traefik-net
external: true