vh/heretic
1
0
Fork 0
mirror of https://github.com/p-e-w/heretic.git synced 2026-09-26 22:11:39 -07:00
Code Issues Packages Projects Releases Wiki Activity

feat: headless operation + end-to-end tests (#392)

Browse Source 
* fix: remove notebook input shims

Closes #280

* feat: support headless operation (no interactive input)

* fix: prevent infinite loops

* feat: add end-to-end tests

* ci: run tests in CI

* ci: fix test output ordering

* fix: replace home-cooked `set_seed` function with Transformers builtin

* feat: print PyTorch config when running tests

* feat: print additional information

* experiment: try to standardize test environment

* fix: revert environment changes

* feat: support multiple valid hashes for each output file

* feat: add test output hashes for CI

* feat: add test output hashes for CI (alternative environment)

* feat: add hashes for Windows (#394)

* fix: Hash on windows

* trigger ci

* fix: prefer .yaml (used widely than .toml for model configs)

* use removeprefix

* docs: restore commet

* use removeprefix again

* tests: Add windows hash files for all test models

* trigger ci

* fix: minor cleanup

* clean merge mismatch

* remove unnecessary CRLF replace, now that we support more SUMS files

* fix: use binary mode for hashes everywhere

---------

Co-authored-by: Vinay Umrethe <umrethevinay@gmail.com>
This commit is contained in:
Philipp Emanuel Weidmann
2026-06-27 13:41:48 +05:30
committed by GitHub
co-authored by Vinay Umrethe
parent 3f68a0d4e5
commit 0146b2760f
27 changed files with 715 additions and 272 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tests/README.md
+17
View File
@@ -0,0 +1,17 @@
Run the tests with
```sh
uv run run_tests.py
```
To update the hashes after a logic change, run the tests, then execute
```sh
cd TEST_DIR/model
sha256sum -b * > ../SHA256SUMS.LABEL
```
where `LABEL` describes the type of system you are running the tests on.
Since PyTorch does not guarantee exact cross-system reproducibility regardless of configuration,
multiple valid hashes can be provided for each output file. The above update must be performed
for each `TEST_DIR` and on each type of system.