vh
bc278d4ba8
- esh-pve-nvidia-host -> pve-nvidia-host: headers/dkms/build-essential step, nouveau blacklist + guarded unload (refuses if nouveau bound a device) - esh-ml1-lxc -> gpu-lxc: host vars have no defaults (elway aborts on undefined), rootfs storage/startup order parameterized, CT kept out of all-guests vzdump jobs - embed-rerank: Homepage labels take HOST_NAME/HOST_IP, defaults = esh-ml1
26 lines
746 B
Bash
26 lines
746 B
Bash
# embed-rerank tunables (TEI). Copy to `.env` on the server.
|
|
|
|
# Per-host Homepage labels. Unset = esh-ml1's values. nh3-ml1 sets:
|
|
# HOST_NAME=nh3-ml1
|
|
# HOST_IP=10.100.50.80
|
|
#HOST_NAME=esh-ml1
|
|
#HOST_IP=10.0.50.80
|
|
|
|
# TEI image tag. `89-` = the Ada Lovelace (sm_89) build; a different GPU
|
|
# generation needs a different prefix (see the TEI README's image table).
|
|
# PINNED to an exact release.
|
|
TEI_TAG=89-1.9.4
|
|
|
|
# Kept from the vLLM era so the embedding gateway entry did not have to change.
|
|
EMBED_PORT=8001
|
|
RERANK_PORT=8013
|
|
|
|
# ⚠ Changing EMBED_MODEL invalidates every index built on it.
|
|
EMBED_MODEL=Qwen/Qwen3-Embedding-0.6B
|
|
RERANK_MODEL=BAAI/bge-reranker-v2-m3
|
|
|
|
MAX_CLIENT_BATCH_SIZE=128
|
|
|
|
# Both models are public; no token needed.
|
|
HF_TOKEN=
|