kasey
5cea6bebb8
minimize syscalls in pruning routine ( #13425 )
...
* minimize syscalls in pruning routine
* terence feedback
* Update beacon-chain/db/filesystem/pruner.go
Co-authored-by: Justin Traglia <95511699+jtraglia@users.noreply.github.com>
* pr feedback
---------
Co-authored-by: Kasey Kirkham <kasey@users.noreply.github.com>
Co-authored-by: Justin Traglia <95511699+jtraglia@users.noreply.github.com>
2024-01-08 22:31:16 +00:00
Sammy Rosso
374d77f437
Blob filesystem metrics ( #13316 )
...
* Add metrics
* Replace counter with gauge
* Preston's comments
* Remove hardcoded number
* Count blob files
* Fix count order
* Fixes
* Cleanup
* Add blob bucket
* Update beacon-chain/node/node.go
Co-authored-by: Preston Van Loon <pvanloon@offchainlabs.com>
* Rename
---------
Co-authored-by: Preston Van Loon <pvanloon@offchainlabs.com>
2023-12-18 18:24:07 +00:00
Sammy Rosso
3d61fd0436
Blob filesystem add pruning during blob write ( #13275 )
...
* Add prune during write
* Fix merge errors
* Add test
* Add test timeout
* Gaz
* Check prune at midpoint
* Fix slot number
* More checks
2023-12-12 21:27:15 +00:00
kasey
737e0e0d3a
Use functional options for --blob-retention-epochs ( #13283 )
...
* blob retention period functional opts
* missed unstaged change
* missed other init after cleardb
* fix ineffassign
* fix dup import
* config failsafe for tests
---------
Co-authored-by: Kasey Kirkham <kasey@users.noreply.github.com>
2023-12-06 20:20:34 +00:00
Sammy Rosso
f40b8583f7
Blob filesystem: prune blobs ( #13147 )
...
* Add Save blob and tests
* Remove locks
* Remove test cleanup
* Fix go mod
* Cleanup
* Add checksum
* Add file hashing to fileutil
* Move test
* Check data when exists
* Add one more test
* Rename
* Gaz
* Add packaged level comment
* Fix block proposals in the REST validator client (#13116 )
* Fix block proposals in the REST validator client
* fix graffiti test
* return empty graffiti
* fallback to old endpoints
* logs
* handle 404
* everything passes
* review from James
* log undecoded value
* test fixes and additions
---------
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
* fix head slot in log (#13139 )
* zig: Update zig to recent main branch commit (#13142 )
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
* Fix Pending Queue Deadline Bug (#13145 )
* rearrange deadline
* naming
* Add pruning
* Gaz
* Gaz
* Update pruning
* Cleanup
* Making a mess
* Benchmarking
* Forgot to add the file + fixes
* Fixes
* Pruning from DB fixed
* Add prune by file data
* Fix pruning
* Prune fixes
* Cleanup db blockRoot filter
* Handle file close error
* Fix deletion
* Change read at + remove retentionEpich from bs
* Gaz
* Seperate logic + add detailed comments
* Add tests
* Add retention slot when creating blobStorage
* Fix tests
* Gaz
* Fix testonly import
* Fix linter errors
* Fix retentionSlot calculation
* Move + use MaxEpochsToPersistBlobs
* Remove unused ctx
* Prestons suggestion
Co-authored-by: Preston Van Loon <pvanloon@offchainlabs.com>
* Rename
---------
Co-authored-by: Radosław Kapka <rkapka@wp.pl>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
Co-authored-by: Potuz <potuz@prysmaticlabs.com>
Co-authored-by: Preston Van Loon <pvanloon@offchainlabs.com>
Co-authored-by: Nishant Das <nishdas93@gmail.com>
2023-12-05 21:07:34 +00:00
Sammy Rosso
7a70305935
Blob filesystem: delete blobs ( #13233 )
...
* Add deletion
* Gaz
* Return on removal
* Test cleanup
* Simply blob deletion
* Add test case to prove that deleting a root that doesn't exist will not return an error
---------
Co-authored-by: Preston Van Loon <pvanloon@offchainlabs.com>
2023-12-01 19:03:47 +00:00
kasey
1123df7432
Verified roblobs ( #13190 )
...
Co-authored-by: Kasey Kirkham <kasey@users.noreply.github.com>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2023-11-21 18:44:38 +00:00
Sammy Rosso
0f65e51d1e
Blob filesystem: Save Blobs ( #13129 )
...
* Add Save blob and tests
* Remove locks
* Remove test cleanup
* Fix go mod
* Cleanup
* Add checksum
* Add file hashing to fileutil
* Move test
* Check data when exists
* Add one more test
* Rename
* Gaz
* Add packaged level comment
* Save full sidecar + reviews
* Use path builder in test
* Use other BlobSidecar
* Cleanup
* Fix gosec
---------
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2023-11-03 16:24:30 +00:00
