Files
esh-pfi-infrastructure/services/semif-serve/bench-jev-2026-09-30/code/pull2.py
T
vh 475d6d6bcb docs: Jev candidate bench vs SemIf (fv-ml1 GPU 3) — Intern-Decision-4B is the replacement if SemIf is displaced
Operator ask relayed by brokkr-smithy-dev. Positive control (SemIf 187/231,
hard 0.613) reproduced exactly; negative control and a 4-restart noise floor
(0 flips) measured. On our replaced-baseline sets no candidate beats SemIf-with-
rotations beyond the ~4-pt floor; Intern-Decision-4B native matches it at one
ordering, is better on Wyrd, fits 9.7/10.3 GB and is 1.5-2.3x faster. JevBench
rank does not transfer. Raw per-item data kept out of git.
2026-09-30 05:00:45 -07:00

6 lines
218 B
Python

import time
from huggingface_hub import snapshot_download
t = time.time()
p = snapshot_download("alibiserikbay/JevK5", revision="c4f7fdb3aeab5582336406e78d3bef11bf98833d")
print(p, f"{time.time()-t:.0f}s", flush=True)