vh/VuongKB
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Create: ATLAS/Infrastructure/Infrastructure-PFI-Correction-Docker-Host.md

Browse Source
This commit is contained in:
Atlas
2026-04-11 22:45:57 -07:00
parent 989571977e
commit 4e5875ecc4
1 changed files with 109 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
ATLAS/Infrastructure/Infrastructure-PFI-Correction-Docker-Host.md
+109
View File
@@ -0,0 +1,109 @@
---
created: '2026-04-12T05:45:57+00:00'
id: 42ee6aab-1bf5-451d-add5-0316541736e3
keywords:
- ana-ml2
- 10.250.50.54
- VM-102
- 10.250.50.70
- docker-host
- correction
- kokoro
- vibevoice
- parakeet
- llama-swap
- comfyui
- chromadb
- dockge
- port-allocation
- infrastructure-correction
links: []
modified: '2026-04-12T05:45:57+00:00'
summary: 'Correction: GPU inference Docker services (llama-swap, ComfyUI, VibeVoice,
Parakeet, ChromaDB, Dockge) run on ana-ml2 (10.250.50.54), not VM 102. VM 102 runs
only Synapse, Vaultwarden, and SillyTavern. Also records Kokoro TTS being added
to ana-ml2 on port 8765.'
tags:
- infrastructure
- correction
- ana-ml2
- VM-102
- docker
- kokoro
- port-map
title: 'Infrastructure Correction: Docker Host Assignment'
---
# Infrastructure Correction: Docker Host Assignment
> **Created:** 2025-07-11
> **Status:** Active correction
> **Affects:** All Infrastructure-PFI documents referencing Docker service placement
## Summary
Multiple documents in the Infrastructure-PFI set incorrectly state that the Docker host running GPU inference services is VM 102 (`10.250.50.70`). The actual host is **ana-ml2 (`10.250.50.54`)**.
## Corrected Service Assignment
### ana-ml2 (10.250.50.54) — Bare Metal, Docker Host for GPU Inference
| Service | Port | GPU | Image | Status |
|---|---|---|---|---|
| Dockge | 5001 | No | `louislam/dockge:latest` | Running |
| llama-swap | 9292→8080 | Yes | `ghcr.io/mostlygeek/llama-swap:cuda` | Running |
| ComfyUI | 8188 | Yes | `mmartial/comfyui-nvidia-docker` | Running |
| ChromaDB | 8000 | No | `chromadb/chroma:latest` | Running |
| VibeVoice TTS | 8745 | Yes | `eworkerinc/vibevoice:latest` | Running |
| Parakeet STT | 8300→8000 | Yes | `parakeet-stt` (local build) | Running |
| **Kokoro TTS** | **8765** | **Yes** | **`ghcr.io/hexgrad/kokoro-onnx:latest`** | **New — being added** |
### VM 102 (10.250.50.70) — Proxmox VM, Non-GPU Application Host
| Service | Port | Notes |
|---|---|---|
| Synapse (Matrix) | 8008 | Matrix homeserver |
| Element Web | 8080 | Matrix client |
| AIPA Matrix Bridge | 8009 | Appservice bridge |
| Vaultwarden | — | Password vault |
| SillyTavern | — | LLM chat frontend |
## Kokoro TTS — New Service Record
- **Host:** ana-ml2 (10.250.50.54)
- **Port:** 8765
- **GPU:** Yes
- **Image:** `ghcr.io/hexgrad/kokoro-onnx:latest`
- **API:** OpenAI-compatible TTS API (`/v1/audio/speech`)
- **Status:** Being added to the stack
## Documents Known to Contain the Error
The following Infrastructure-PFI documents describe VM 102 as the Docker host for GPU inference services and need correction:
- `Infrastructure-PFI-Project-Index.md` — VM 102 service table lists all GPU services
- Any references to compose files at `/opt/docker/compose/` should be attributed to ana-ml2, not VM 102
- Port allocation tables should be split between the two hosts
## Port Allocation — Corrected
### ana-ml2 (10.250.50.54)
| Port | Service |
|---|---|
| 5001 | Dockge |
| 8000 | ChromaDB |
| 8080 | llama-swap (internal) |
| 8188 | ComfyUI |
| 8300 | Parakeet STT |
| 8745 | VibeVoice TTS |
| 8765 | Kokoro TTS |
| 9292 | llama-swap (external) |
### VM 102 (10.250.50.70)
| Port | Service |
|---|---|
| 8008 | Synapse |
| 8009 | AIPA Matrix Bridge |
| 8080 | Element Web |