3.2 KiB
3.2 KiB
created, id, keywords, links, modified, summary, tags, title
| created | id | keywords | links | modified | summary | tags | title | ||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2026-04-12T05:45:57+00:00 | 42ee6aab-1bf5-451d-add5-0316541736e3 |
|
2026-04-12T05:45:57+00:00 | Correction: GPU inference Docker services (llama-swap, ComfyUI, VibeVoice, Parakeet, ChromaDB, Dockge) run on ana-ml2 (10.250.50.54), not VM 102. VM 102 runs only Synapse, Vaultwarden, and SillyTavern. Also records Kokoro TTS being added to ana-ml2 on port 8765. |
|
Infrastructure Correction: Docker Host Assignment |
Infrastructure Correction: Docker Host Assignment
Created: 2025-07-11 Status: Active correction Affects: All Infrastructure-PFI documents referencing Docker service placement
Summary
Multiple documents in the Infrastructure-PFI set incorrectly state that the Docker host running GPU inference services is VM 102 (10.250.50.70). The actual host is ana-ml2 (10.250.50.54).
Corrected Service Assignment
ana-ml2 (10.250.50.54) — Bare Metal, Docker Host for GPU Inference
| Service | Port | GPU | Image | Status |
|---|---|---|---|---|
| Dockge | 5001 | No | louislam/dockge:latest |
Running |
| llama-swap | 9292→8080 | Yes | ghcr.io/mostlygeek/llama-swap:cuda |
Running |
| ComfyUI | 8188 | Yes | mmartial/comfyui-nvidia-docker |
Running |
| ChromaDB | 8000 | No | chromadb/chroma:latest |
Running |
| VibeVoice TTS | 8745 | Yes | eworkerinc/vibevoice:latest |
Running |
| Parakeet STT | 8300→8000 | Yes | parakeet-stt (local build) |
Running |
| Kokoro TTS | 8765 | Yes | ghcr.io/hexgrad/kokoro-onnx:latest |
New — being added |
VM 102 (10.250.50.70) — Proxmox VM, Non-GPU Application Host
| Service | Port | Notes |
|---|---|---|
| Synapse (Matrix) | 8008 | Matrix homeserver |
| Element Web | 8080 | Matrix client |
| AIPA Matrix Bridge | 8009 | Appservice bridge |
| Vaultwarden | — | Password vault |
| SillyTavern | — | LLM chat frontend |
Kokoro TTS — New Service Record
- Host: ana-ml2 (10.250.50.54)
- Port: 8765
- GPU: Yes
- Image:
ghcr.io/hexgrad/kokoro-onnx:latest - API: OpenAI-compatible TTS API (
/v1/audio/speech) - Status: Being added to the stack
Documents Known to Contain the Error
The following Infrastructure-PFI documents describe VM 102 as the Docker host for GPU inference services and need correction:
Infrastructure-PFI-Project-Index.md— VM 102 service table lists all GPU services- Any references to compose files at
/opt/docker/compose/should be attributed to ana-ml2, not VM 102 - Port allocation tables should be split between the two hosts
Port Allocation — Corrected
ana-ml2 (10.250.50.54)
| Port | Service |
|---|---|
| 5001 | Dockge |
| 8000 | ChromaDB |
| 8080 | llama-swap (internal) |
| 8188 | ComfyUI |
| 8300 | Parakeet STT |
| 8745 | VibeVoice TTS |
| 8765 | Kokoro TTS |
| 9292 | llama-swap (external) |
VM 102 (10.250.50.70)
| Port | Service |
|---|---|
| 8008 | Synapse |
| 8009 | AIPA Matrix Bridge |
| 8080 | Element Web |