vh
e376d0aec9
Captures the full workspace state built up to this point:
- CLAUDE.md + README.md describing conventions and the four-host fleet
(ana-ml2, ana-docker, nh3-docker, esh-docker-vm).
- Per-host notes under servers/<host>/ with ssh-target fallback files
and latest system-details snapshots (two in-compose credential leaks
scrubbed; the upstream compose files still need to move those to .env).
- scripts/: server_inspect.sh (read-only remote diagnostic),
refresh-server-info.sh (dir-driven discovery + snapshot capture with
validation warnings), add-host.sh, sync-stacks.sh (pull
compose/conf trees), deploy-stack.sh (push with per-file diff + prompt).
- stacks/: canonical compose for backrest, beszel, dozzle, llama-swap,
rest-server-ana, rest-server-nh3, vllm-qwen3, plus the retired
infinity reference. All use the .env-driven + traefik-net + homepage
label pattern.
- configs/restic/ana-docker/: first resticprofile config + pre-backup
hook (Synapse pg_dump, Seafile mysqldump, Vaultwarden SQLite); templates
for the other three hosts to come.
- docs/pfi/: general infrastructure reference carried over.
- .gitignore excludes .env, stacks-mirror/, and assorted secret/state
filenames to prevent re-leaks on later commits.
19 lines
629 B
Bash
19 lines
629 B
Bash
# llama-swap stack tunables. Copy to `.env` on ana-docker before deploying.
|
|
#
|
|
# cp .env.example .env
|
|
# # edit if needed
|
|
# docker compose up -d
|
|
|
|
# Image tag. `cuda` is the CUDA-enabled build; pin to a specific release
|
|
# (e.g. `cuda-v0.0.6`) for reproducibility once upstream tags stabilize.
|
|
LLAMA_SWAP_VERSION=cuda
|
|
|
|
# Host port for the OpenAI-compatible API (container listens on 8080)
|
|
LLAMA_SWAP_PORT=9292
|
|
|
|
# Host paths
|
|
# --- Legacy GGUF models referenced by config.yaml as `-m /models/<file>`
|
|
MODELS_DIR=/tank/aimodels/llm
|
|
# --- Shared HuggingFace cache used by `-hf` model entries
|
|
HF_CACHE_DIR=/tank/aimodels/huggingface
|