vh/esh-pfi-infrastructure
1
0
Fork 0
Code Issues 7 Pull Requests Actions Packages Projects Releases Wiki Activity

scriberr: correct the GPU 1 budget — nvidia-smi Free is 15,442 MiB, not total−used; 70 MiB spare beside intern-decision at 9.0 GiB

Browse Source
This commit is contained in:
vh
2026-09-30 09:39:12 -07:00
parent a262477a61
commit 66034cc69e
3 changed files with 7 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
stacks/scriberr/README.md
+3 -2
View File
@@ -136,8 +136,9 @@ tab. Keep the configured model on a free local seat.
## Parakeet memory and slicing (measured 2026-09-30)
Scriberr shares fv-ml1 GPU 1 with intern-decision (~10.3 GB cap). The budget left
for Scriberr is about 5.8 GB, so the compose file sets
Scriberr shares fv-ml1 GPU 1 with intern-decision (9.0 GiB cap, 9,876 MiB card peak).
GPU 1's nvidia-smi Free is 15,442 MiB, so the budget left for Scriberr is about 5.5 GB
(70 MiB spare at both peaks), so the compose file sets
`PARAKEET_CHUNK_THRESHOLD_SECS=120` and
`PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True`. The numbers behind those
settings are in the compose comments.