Sammy Rosso
374d77f437
Blob filesystem metrics ( #13316 )
...
* Add metrics
* Replace counter with gauge
* Preston's comments
* Remove hardcoded number
* Count blob files
* Fix count order
* Fixes
* Cleanup
* Add blob bucket
* Update beacon-chain/node/node.go
Co-authored-by: Preston Van Loon <pvanloon@offchainlabs.com>
* Rename
---------
Co-authored-by: Preston Van Loon <pvanloon@offchainlabs.com>
2023-12-18 18:24:07 +00:00
Justin Traglia
1f6d1d1852
For golangci-lint, enable all by default ( #13353 )
...
* For golangci-lint, enable all by default
* Use latest golangci-lint here too
* Use v1.55.2 instead of latest
* Remove usestdlibvars from list
---------
Co-authored-by: terence <terence@prysmaticlabs.com>
2023-12-18 18:20:55 +00:00
terence
0eff83cb9d
Use a cache of one entry to build attestation ( #13300 )
...
* Use a cache of one entry to build attestation
* Gazelle
* Enforce on RPC side
* Rm unused var
* Potuz feedback, dont use pointer
* Fix tests
* Init fetcher
* Add in-progress
* Add back missing lock
* Potuz feedback
* Update beacon-chain/rpc/prysm/v1alpha1/validator/attester_test.go
Co-authored-by: Potuz <potuz@prysmaticlabs.com>
---------
Co-authored-by: Potuz <potuz@prysmaticlabs.com>
2023-12-18 16:12:43 +00:00
Justin Traglia
ffe2f6b732
Enable mirror linter and fix findings ( #13342 )
...
* Enable mirror linter and fix findings
* Use latest version of golangci-lint
* Use v1.55.2 instead of latest
---------
Co-authored-by: terence <terence@prysmaticlabs.com>
Co-authored-by: Radosław Kapka <rkapka@wp.pl>
2023-12-18 12:16:26 +00:00
terence
d57bca97a5
Check builder header kzg commitment ( #13358 )
2023-12-18 06:14:59 +00:00
Nishant Das
b45a6664be
Enable Deneb For E2E Scenario Tests ( #13317 )
...
* fix all cases
* update web3signer
* current progress
* fix it finally
* push it back to capella
* remove hard-coded forks
* fix failing tests
* gaz
* fix dumb bug
* fix bad test setup
* change back
2023-12-16 11:37:44 +00:00
Justin Traglia
c56abfb840
Enable usestdlibvars linter and fix findings ( #13339 )
...
Co-authored-by: terence <terence@prysmaticlabs.com>
2023-12-15 19:21:54 +00:00
Preston Van Loon
d70f477b1e
Fix docker image version strings in CI ( #13356 )
2023-12-15 19:15:51 +00:00
Preston Van Loon
db096488b0
fixing sa4006 ( #13350 )
2023-12-15 16:49:27 +00:00
Radosław Kapka
344e68b81b
Use SkipMevBoost properly during block production ( #13352 )
...
* fix bugs
* tests
* name fix
2023-12-15 16:14:42 +00:00
Justin Traglia
1962cca69e
Fix error string generation for missing commitments ( #13338 )
2023-12-15 04:03:45 +00:00
Justin Traglia
4a374435c0
Enable errname linter and fix findings ( #13341 )
2023-12-15 03:26:48 +00:00
David Theodore
0fde4a22e1
reordered blob validation ( #13347 )
2023-12-15 02:46:12 +00:00
terence
62ecc0d177
Add more color to sending blob by range req log ( #13349 )
2023-12-15 02:43:16 +00:00
Justin Traglia
97dfec84f6
Handle potential error from newBlockRangeBatcher ( #13344 )
2023-12-15 02:28:07 +00:00
terence
53bc96844e
Move pruning log to after retention check ( #13348 )
2023-12-15 00:49:29 +00:00
terence
ddcf0c18dc
Excluse DA wait time for chain processing time ( #13335 )
...
* Excluse DA wait time for chain processing time
* Rename
2023-12-14 22:46:48 +00:00
james-prysm
45a2746d0e
Builder API: Fix max field check on toProto function ( #13334 )
...
* fixing field param used in ToProto function
* fxing test to pass
* making blobs empty in test
2023-12-14 03:03:00 +00:00
Preston Van Loon
09f3df309d
Remove rules_docker, make multiarch images canonical ( #13324 )
...
* Remove rules_docker
* Update base image
2023-12-13 23:31:58 +00:00
Potuz
96df81d5c5
Hook to slot stream instead of block stream on the VC ( #13327 )
...
* Hook to slot stream instead of block stream on the VC
* Implement StreamSlots in the BN
* mock update
* fix tests
* don't return from stream
* Terence's review
* deepsource second complain
---------
Co-authored-by: rkapka <rkapka@wp.pl>
2023-12-13 23:13:56 +00:00
terence
c47c52152b
Enhance Pruning Logs ( #13331 )
...
* Log prunning info
* Added start log
* Log prunning info
* Added start log
2023-12-13 19:24:47 +00:00
james-prysm
4cbe144a6c
CLI: fixing account import ux bugs ( #13328 )
...
* fixing account import checking wallet twice, and adding sub folder search with a depth of 2
* removing uneeded check
* fixing unit test
* adding reset cache to fix potential flake
* improving test based on feedback
2023-12-13 17:11:32 +00:00
Justin Traglia
52b9b65adb
Add sanity checks for bundle from builder ( #13319 )
...
* Add sanity checks for bundle from builder
* Add more checks to BlobsBundle.ToProto()
* Fix minor typo
* Fix tests & add new ones
* Add tests for ToProto
* Add "not" to error message
---------
Co-authored-by: james-prysm <90280386+james-prysm@users.noreply.github.com>
2023-12-13 15:54:00 +00:00
Radosław Kapka
ea59b1ec71
Increase buffer of events channel ( #13329 )
2023-12-13 15:37:45 +00:00
Radosław Kapka
175c484c44
Uncomment e2e flakiness ( #13326 )
2023-12-13 12:50:13 +00:00
Nishant Das
8aaab86987
fix it ( #13325 )
2023-12-13 11:01:01 +00:00
Preston Van Loon
381116a3e8
Fix missing testnet versions. Issue #13288 ( #13323 )
2023-12-12 21:44:14 +00:00
Sammy Rosso
3d61fd0436
Blob filesystem add pruning during blob write ( #13275 )
...
* Add prune during write
* Fix merge errors
* Add test
* Add test timeout
* Gaz
* Check prune at midpoint
* Fix slot number
* More checks
2023-12-12 21:27:15 +00:00
james-prysm
b19d24c581
Remove signed block requirement from no-verify functions ( #13314 )
...
* removing fake wrappers
* fixing conficts and missed tests
* fixing more conflicts
* addressing missed unit test
* fixing nogo error
* fixing more unit tests
* fixing more tests
2023-12-12 20:18:40 +00:00
Radosław Kapka
8387088a52
Handle HTTP 404 Not Found in SubmitAggregateAndProof ( #13320 )
...
Co-authored-by: james-prysm <90280386+james-prysm@users.noreply.github.com>
2023-12-12 19:46:19 +00:00
Potuz
ce7452c97a
update spectests to 1.4.0-beta.5 ( #13318 )
...
* update spectests to 1.4.0-beta.5
* add spec config
2023-12-12 18:27:48 +00:00
james-prysm
5e56b5fdd7
Beacon APIs: re enabling blob events ( #13315 )
...
* re enabling blob events
* terence's comments
* Update beacon-chain/rpc/eth/events/events_test.go
Co-authored-by: Radosław Kapka <rkapka@wp.pl>
---------
Co-authored-by: Radosław Kapka <rkapka@wp.pl>
2023-12-12 15:58:11 +00:00
Nishant Das
bfaba378f6
activate deneb ( #13311 )
2023-12-12 08:04:55 +00:00
Sammy Rosso
3bd116db16
Blob filesystem add pruning at startup ( #13253 )
...
* Add Save blob and tests
* Remove locks
* Remove test cleanup
* Fix go mod
* Cleanup
* Add checksum
* Add file hashing to fileutil
* Move test
* Check data when exists
* Add one more test
* Rename
* Gaz
* Add packaged level comment
* Fix block proposals in the REST validator client (#13116 )
* Fix block proposals in the REST validator client
* fix graffiti test
* return empty graffiti
* fallback to old endpoints
* logs
* handle 404
* everything passes
* review from James
* log undecoded value
* test fixes and additions
---------
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
* fix head slot in log (#13139 )
* zig: Update zig to recent main branch commit (#13142 )
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
* Fix Pending Queue Deadline Bug (#13145 )
* rearrange deadline
* naming
* Add pruning
* Gaz
* Gaz
* Update pruning
* Cleanup
* Making a mess
* Benchmarking
* Forgot to add the file + fixes
* Fixes
* Pruning from DB fixed
* Add prune by file data
* Fix pruning
* Prune fixes
* Cleanup db blockRoot filter
* Handle file close error
* Fix deletion
* Change read at + remove retentionEpich from bs
* Gaz
* Seperate logic + add detailed comments
* Add tests
* Add retention slot when creating blobStorage
* Fix tests
* Gaz
* Fix testonly import
* Add pruning at startup
* Add nil check
* Fix merge errors
* Fix test
* Fix test
---------
Co-authored-by: Radosław Kapka <rkapka@wp.pl>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
Co-authored-by: Potuz <potuz@prysmaticlabs.com>
Co-authored-by: Preston Van Loon <pvanloon@offchainlabs.com>
Co-authored-by: Nishant Das <nishdas93@gmail.com>
2023-12-11 17:08:52 +00:00
terence
7d2ddaee43
Test improvement TestValidateVoluntaryExit_ValidExit ( #13313 )
2023-12-11 08:01:56 +00:00
terence
122a7782ff
Initialize blob storage for initial sync service ( #13312 )
2023-12-11 07:52:07 +00:00
terence
9b1b6f9be6
Use verified blob for gossip checks ( #13294 )
...
* Use blob verifier for gossip rules
* Fixing tests
* Fix lint
* Mocks
* Trying Kasey's rec
* mock verifier init workaround
* Add more tests
* Reset deneb epoch for exit test
---------
Co-authored-by: Kasey Kirkham <kasey@users.noreply.github.com>
2023-12-11 00:37:45 +00:00
Delweng
0eb08a4f96
beacon-chain/rpc: use BalanceAtIndex instead of Balances to reduce memory copy ( #13279 )
...
* beacon-chain/rpc: use BalanceAtIndex instead of Balances
Signed-off-by: jsvisa <delweng@gmail.com>
* beacon-chain/rpc: stream use BalanceAtIndex is sufficient
Signed-off-by: jsvisa <delweng@gmail.com>
* beacon-chain/rpc: fix commit review
Signed-off-by: jsvisa <delweng@gmail.com>
* beacon-chain/rpc: http2 -> httputil
Signed-off-by: jsvisa <delweng@gmail.com>
---------
Signed-off-by: jsvisa <delweng@gmail.com>
Co-authored-by: Radosław Kapka <rkapka@wp.pl>
2023-12-10 00:04:45 +00:00
Radosław Kapka
bdfa06ed65
Simplify post-evaluation in Beacon API evaluator ( #13309 )
...
* Simplify post-evaluation in Beacon API evaluator
* revert slottime
* remove unused error
2023-12-09 07:54:31 +00:00
Manu NALEPA
a94f2b93e3
filterAndCacheActiveKeys: Stop filtering out exiting validators (#13305 )
...
* `filterAndCacheActiveKeys`: Add test cases
- Validator is in unknown status (to be fitered out)
- Validator is in pending status,
with activation period > current period (to be filtered out)
- Validator is in pending status,
with activation period == current period (to be kept)
* `filterAndCacheActiveKeys`: Keep exiting keys
Initially:
-------
If a validator is in exiting (so, with status==EXITING != ACTIVE) state,
it will be filtered out by the `filterAndCacheActiveKeys` function.
The validator won't be registered to the beacon node.
If this exiting validator has to propose a block:
- the block will be proposed using local block building only.
- the fee recipient will be the one set in the beacon node.
(Additionally, if the beacon node Prysm without any
fee recipient defined at the beacon node level, the fee recipient
will default on the `0x00000...` burn address.)
This commit modifies the `filterAndCacheActiveKeys` function
by stopping filtering out exiting validators.
2023-12-09 07:53:08 +00:00
Radosław Kapka
4c47756aed
HTTP endpoints cleanup ( #13251 )
...
* remove validation package
* structs cleanup
* merge with apimiddleware removal
* more validation and Bls capitalization
* builder test fix
* use strconv for uint->str conversions
* use DecodeHexWithLength
* use exact param names
* rename http package to httputil
* change conversions to fmt.Sprintf
* handle query paramsd and route variables
* spans and receiver name
* split structs, move bytes helper
* missing ok check
* fix reference to indexed failure
* errors fixup
* add godoc to helper
* fix BLS casing and chainhead ref
* review
* fix import in tests
* gzl
2023-12-08 20:37:20 +00:00
Nishant Das
440841d565
only run it in the middle of an epoch ( #13303 )
2023-12-08 15:14:01 +00:00
Preston Van Loon
ff99616833
Fix staticcheck violations ( #13301 )
...
* Fix violations of sa2002
* Fix violations of sa4005
* Fix violations of sa4010
* Fix violations for sa4023
* Comment on commented static checks
2023-12-08 13:07:52 +00:00
Preston Van Loon
f537a98fcd
Add staticchecks to bazel builds ( #13298 )
...
* Update staticcheck to latest
* Add static checks while ignoring for third party / external stuff
* Added a hack to keep go mod happy.
* disable SA2002
* Pin go mod tidy checker image to golang:1.20-alpine
2023-12-08 05:42:55 +00:00
Radosław Kapka
cee38660c7
Gracefully handle unknown validator index in the REST VC ( #13296 )
...
* Gracefully handle unknown validaor index in the REST VC
* add apostrophes
2023-12-08 04:30:50 +00:00
james-prysm
481d77bfde
APIs: reusing grpc cors middleware for rest ( #13284 )
...
* reusing grpc cors middleware for rest
* addressing radek's comments
* Update api/server/middleware.go
Co-authored-by: Sammy Rosso <15244892+saolyn@users.noreply.github.com>
* fixing to recommended name
* fixing naming
* fixing rename on test
---------
Co-authored-by: Sammy Rosso <15244892+saolyn@users.noreply.github.com>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2023-12-08 04:24:18 +00:00
Nishant Das
590317553c
Support New Subnet Backbone ( #13179 )
...
* add in changes
* fix it up
* fix test
* gaz
* lint
* add back
* fix tests
* fix it
* fix tests
* add lib
* fix it
2023-12-08 04:07:48 +00:00
terence
68b7d1009e
Update README.md ( #13302 )
2023-12-08 04:07:10 +00:00
james-prysm
b5b8825cc8
Beacon API: fix get blob returns 500 instead of empty ( #13297 )
...
* fix blob api, should return empty if no indicies were found
* fixing small bug with slice
2023-12-07 22:33:26 +00:00
Justin Traglia
382b8b23c2
Ensure partial blob is deleted if there's an error ( #13292 )
...
* Ensure partial blob is deleted if there's an error
* Add debug log if file is removed
2023-12-07 20:52:16 +00:00
