prysm-pulse/testing/spectest
Sammy Rosso 14d7416c16
Spec test coverage report hack (#13718)
* Spec test report hack

* no export

* fix shell complaint

* shell fix?

* shell again?

* chmod +x ./hack/spectest-report.sh

* Review + improvements

* Remove unwanted change

* Add exclusion list

* Fix path + add eip6110 to exclusion

* Fix bazel path nonsense

* Add extra detail about specific test

* Cleanup exclusion list

* Add fail conditions

* Add mkdir

* Shorten filename + mkdir only if new

* Fix names

* Add to exclusion list

* Add report to .gitignore

* Back to stupid names

* Add Bazel flags option

---------

Co-authored-by: Preston Van Loon <pvanloon@offchainlabs.com>
2024-03-25 16:10:32 +00:00
..
general Update to V5 (#13622) 2024-02-15 05:46:47 +00:00
mainnet Blob verification spectest (#13707) 2024-03-08 18:20:38 +00:00
minimal Blob verification spectest (#13707) 2024-03-08 18:20:38 +00:00
shared Blob verification spectest (#13707) 2024-03-08 18:20:38 +00:00
utils Spec test coverage report hack (#13718) 2024-03-25 16:10:32 +00:00
exclusions.txt Spec test coverage report hack (#13718) 2024-03-25 16:10:32 +00:00
README.md Move Spectests Into a Testing/ Folder (#9582) 2021-09-14 16:02:58 +00:00

Spec Tests

Spec testing vectors: https://github.com/ethereum/consensus-spec-tests

To run all mainnet spec tests:

bazel test //... --test_tag_filters=spectest

Minimal tests require --define ssz=minimal setting and are not triggered automatically when //... is selected. One can run minimal tests manually, though:

bazel query 'tests(attr("tags", "minimal, spectest", //...))' | xargs bazel test --define ssz=minimal