vh
6b201e1d4a
Prime 2026-09-30: move scriberr to GPU 3 and extend the Jev endpoint to 32k tokens. Scriberr holds 0 VRAM idle; verified a 20-min job on GPU 3 at 5,496 MiB. With GPU 1 freed, intern-decision's measured card peak at MAX_TOKENS=32768 is 15,220 MiB against a 15,437 MiB budget (n=3, 1 and 16 questions); 32,769 tokens is refused 422 up front. JevBench v1.2.16 via /v1/systemone unchanged: 202/231, 0 diffs vs the bench.
57 lines
3.6 KiB
Bash
57 lines
3.6 KiB
Bash
# Scriberr — copy to .env on the host at /opt/docker/compose/scriberr/.env
|
|
# Real .env is gitignored and lives only on fv-ml1.
|
|
|
|
# ── Image ────────────────────────────────────────────────────────────────
|
|
# Built locally from Dockerfile.cuda.12.9 — see the compose header for why
|
|
# the published scriberr-cuda image is NOT usable on these Blackwell cards.
|
|
# Patched builds come from scripts/scriberr-rebuild and are tagged
|
|
# scriberr:local-blackwell-<upstream sha7>-<suffix> (e.g. -a353078-slicer1)
|
|
# so every build keeps its own tag. Deploying = pointing this at a new tag;
|
|
# rollback = pointing it back. See stacks/scriberr/patches/README.md.
|
|
# (Unset falls back to the original unpatched scriberr:local-blackwell.)
|
|
SCRIBERR_IMAGE=scriberr:local-blackwell
|
|
|
|
# ── Network ──────────────────────────────────────────────────────────────
|
|
SCRIBERR_PORT=8080
|
|
SCRIBERR_BIND=0.0.0.0
|
|
# CORS. Must list every origin the UI is actually reached from, or the
|
|
# browser blocks the API calls. Comma-separated, no spaces, no trailing /.
|
|
SCRIBERR_ALLOWED_ORIGINS=http://10.251.50.54:8080,http://scriberr.fv.internal:8080
|
|
|
|
# ── GPU ──────────────────────────────────────────────────────────────────
|
|
# GPU 3 since 2026-09-30 (Prime): an on-demand tenant of the full-size-seat reserve; it steps aside
|
|
# (to irv-ml1's A6000) when a full-size seat claims GPU 3. See compose.yaml.
|
|
SCRIBERR_GPU_ID=3
|
|
|
|
# ── Storage (on /tank — NOT the root pool, weights are multi-GB) ─────────
|
|
SCRIBERR_DATA_DIR=/tank/scriberr/data
|
|
SCRIBERR_ENV_DIR=/tank/scriberr/whisperx-env
|
|
|
|
# ── Runtime ──────────────────────────────────────────────────────────────
|
|
# ⚠ 10001, not the fleet-usual 1000. The Blackwell image's `appuser` IS 10001
|
|
# and its PUID remapping is broken — at 1000 the app cannot open its SQLite DB
|
|
# and crash-loops. The /tank dirs are chowned to 10001:10001 to match.
|
|
# See README "The PUID trap".
|
|
SCRIBERR_PUID=10001
|
|
SCRIBERR_PGID=10001
|
|
# Keep false while the app is served over plain HTTP. Setting this true
|
|
# without TLS makes login silently fail (cookie marked Secure, dropped).
|
|
SCRIBERR_SECURE_COOKIES=false
|
|
|
|
# ── Optional: summarisation / transcript chat ────────────────────────────
|
|
# Scriberr speaks the OpenAI API. Point it at the LiteLLM gateway so this
|
|
# costs nothing and stays on-prem, rather than a paid vendor key.
|
|
# Configure the base URL in the Scriberr UI (Settings -> AI provider):
|
|
# base URL : http://10.250.50.70:4000/v1
|
|
# model : summarizer (or gen / gen-reasoning)
|
|
# The key below is the shared all-agents gateway key.
|
|
# ⚠ That key also reaches PAID passthrough models (GLM, Kimi) on a shared
|
|
# tab — keep the configured model on a free local seat.
|
|
# SCRIBERR_OPENAI_API_KEY=
|
|
|
|
# Memory settings measured on GPU 1 (2026-09-30; still in force on GPU 3). Parakeet slice length in seconds and the
|
|
# torch allocator mode; see compose.yaml for the measurements. Defaults apply
|
|
# when unset; override only with a re-measured peak.
|
|
# SCRIBERR_PARAKEET_CHUNK_SECS=120
|
|
# SCRIBERR_PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True
|