chore: retire asset-engine (Prime 2026-10-17); kuma gains delete-by-name; FleetTools/bootstrap/catalog marked

This commit is contained in:
vh
2026-10-17 00:16:31 -07:00
parent 055d56fa45
commit bc91b40ac5
8 changed files with 42 additions and 29 deletions
-1
View File
@@ -17,7 +17,6 @@ their own:
```sh
curl -s http://10.0.50.45:5100/api/services # every fleet service, curated
curl -s http://10.250.50.70:8200/api/v1/services # inference seats + GPU state
curl -s http://10.250.50.70:4000/v1/models # the LLM roster (needs a key)
```
+4 -5
View File
@@ -14,12 +14,11 @@ directory; that defeats the point.
## Rule zero: query live inventories, never a written list
Three endpoints answer "what exists right now" better than any document, and they stay
Two endpoints answer "what exists right now" better than any document, and they stay
correct on their own. **Reach for these before asking anyone:**
```sh
curl -s http://10.0.50.45:5100/api/services # every fleet service, curated
curl -s http://10.250.50.70:8200/api/v1/services # inference seats + GPU state
curl -s -H "Authorization: Bearer $KEY" \
http://10.250.50.70:4000/v1/models # the LLM roster (~40 models)
```
@@ -70,13 +69,13 @@ live contract for its API. Fetch it rather than trusting a transcription.
⚠ *The shared key CAN spend real vendor credits.*
*Detail:* `/home/lkraven/development/eshpfi-management/docs/fleettools/litellm.md`
- **Direct inference seats + Asset Engine** — the control plane at
`http://10.250.50.70:8200` enumerates seats, reads GPU state, and starts/stops them.
- **Direct inference seats** — most sit behind the gateway; the GPU hosts and their traps.
(The Asset Engine control plane at `:8200` was RETIRED 2026-10-17.)
*When:* the gateway does not expose what you need, or a seat is down.
*Detail:* `/home/lkraven/development/eshpfi-management/docs/fleettools/inference.md`
- **Speech (TTS/ASR)** — Breeze-TTS-2 is the fleet primary; Chatterbox-fast is the
low-latency chat front end; Speaches and Parakeet do ASR.
low-latency chat front end; Parakeet does ASR (`whisper-1` / `ext-stt` on the gateway).
*When:* you need audio out of text, or text out of audio.
*Detail:* `/home/lkraven/development/eshpfi-management/docs/fleettools/speech.md`
+9 -19
View File
@@ -1,4 +1,4 @@
# Direct inference seats + the Asset Engine control plane
# Direct inference seats
Most seats are vLLM behind the LiteLLM gateway — prefer the gateway
(`docs/fleettools/litellm.md`) unless you need something it does not expose.
@@ -8,30 +8,20 @@ Most seats are vLLM behind the LiteLLM gateway — prefer the gateway
```sh
# every fleet service, curated, with hrefs and descriptions
curl -s http://10.0.50.45:5100/api/services | python3 -m json.tool
# the inference control plane: what exists, what is up, GPU state
curl -s http://10.250.50.70:8200/api/v1/services
curl -s http://10.250.50.70:8200/api/v1/gpus
# the LLM roster
curl -s -H "Authorization: Bearer $KEY" http://10.250.50.70:4000/v1/models
```
Seats move between hosts and GPUs often enough that any transcribed table here would
mislead within a month.
## Asset Engine — `http://10.250.50.70:8200`
## Asset Engine — RETIRED 2026-10-17
Control plane over the PFI inference fleet. Can enumerate services, read GPU state,
**start and stop seats**, submit jobs and fetch assets.
```
GET /api/v1/services GET /api/v1/services/{id}/state
POST /api/v1/services/{id}/start POST /api/v1/services/{id}/stop
GET /api/v1/gpus POST /api/v1/jobs
GET /api/v1/assets/{id}/blob GET /api/v1/presets
```
⚠ **Liveness is keyed on the compose PROJECT name.** A seat reads OFFLINE unless the
compose project name equals the catalog's `lifecycle.stack`. Pin `name: <stack>` in
the compose file.
The control plane at `http://10.250.50.70:8200` is gone (Prime). Its last job was 2026-08-02, and every
catalog endpoint pointed at irv-ml1's dead wg0 address after the 09-06 mesh cutover. `docker compose
down` on ana-docker; the DB, image, repo (`vh/asset-engine`) and catalog (`docs/asset-engine/`) are kept, so
`docker compose up -d` in `/opt/docker/compose/asset-engine` brings it back. Start/stop a seat by hand
(`docker compose up -d` / `stop` in its compose dir on the GPU host).
## GPU hosts
+1 -1
View File
@@ -33,7 +33,7 @@ the router cooldown** — list voices first.
Retired, verified 2026-10-17: **Speaches** (irv-ml1 :8204 is now Breeze-TTS-2), the sherpa-onnx `parakeet` container
on fv-ml1 (stopped; NeMo replaced it), and the asset-engine `parakeet` entry at `10.100.79.3:8765` (the dead wg0
lifeline address). The first two's leftover containers were removed 2026-10-17 (images and compose dirs kept), so
lifeline address; asset-engine itself was retired 2026-10-17). The first two's leftover containers were removed 2026-10-17 (images and compose dirs kept), so
Homepage no longer lists them.
## Traps