Raul Jordan
9edba29f64
Slasher Simulator Code for Testing Optimized Slasher Behavior ( #9695 )
...
* slashing simulator
* add in necessary items for slasher sim
* sim item
* fix up
* fixed build
* rev
* slasher sim in testing
* testonly
* gaz
* gaz
* fix viz
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
Co-authored-by: prestonvanloon <preston@prysmaticlabs.com>
2021-09-29 02:27:21 +00:00
Raul Jordan
57f965df50
Include Slasher Receiving Methods ( #9692 )
...
* first
* add receive details
* ensure most builds
* add slasherkv changes
* db iface additions
* build
* gaz
* proper todo comment
* terence comments
* sig check
* bad sig checks
* proper lock issue
* fix test
* fix up tests
2021-09-28 18:13:16 +00:00
Raul Jordan
f2840c9ffa
Slasher Min/Max Chunk Logic ( #9673 )
...
* slasher chunks code
* slasher chunks code
* avoid using shared
* testing helper
* slasher gaz
* radek comments
* preston feedback
2021-09-28 02:04:32 +00:00
terence tsao
ea9ceeff03
Various clean up before v2 ( #9672 )
...
* Update package names
* Various clean up
* Gazelle
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-09-24 17:42:16 +00:00
Raul Jordan
a9a4bb9163
Move Shared/Testutil into Testing ( #9659 )
...
* move testutil
* util pkg
* build
* gaz
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-09-23 18:53:46 +00:00
Raul Jordan
29513c804c
Create Encoding Bytesutil ( #9658 )
...
* bytesutil
* gaz
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-09-23 15:23:37 +00:00
Raul Jordan
f3d6dbcc1e
Move Shared/Params Into Config/Params ( #9642 )
...
* config params into pkg
* gaz
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-09-21 19:59:25 +00:00
Raul Jordan
eebcd52ee6
Miscellaneous Packages from Shared Into Proper Folders ( #9638 )
...
* slashutil
* builds
* interop
* viz
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-09-21 18:11:16 +00:00
deepsource-autofix[bot]
531f05d30d
Unused parameter should be replaced by underscore ( #9632 )
...
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
Co-authored-by: terence tsao <terence@prysmaticlabs.com>
2021-09-20 20:51:59 +00:00
Raul Jordan
7dadc780b8
Move Shared Packages into Math/ and IO/ ( #9622 )
...
* amend
* building
* build
* userprompt
* imports
* build val
* gaz
* io file
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-09-17 21:55:24 +00:00
Raul Jordan
61c24c3870
Move Fuzz/ Into Testing/ ( #9617 )
...
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-09-16 17:32:51 +00:00
Raul Jordan
23e2d62c0c
Create Container Package for Shared/ Subpackages ( #9607 )
...
* ensure run
* amend
* fix initial sync test target
Co-authored-by: prestonvanloon <preston@prysmaticlabs.com>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-09-16 12:05:58 -05:00
Raul Jordan
495e92ce9f
Create Runtime Package for Moving Several Packages in Shared/ ( #9588 )
...
* add maxprocs
* add prereqs
* add tos and version pkg
* add in all runtime packages
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-09-16 09:46:29 +00:00
Raul Jordan
5230af0e0c
Move EndtoEnd Tests to Testing/ Folder ( #9586 )
...
* endtoend to testing/
* gaz
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-09-15 14:42:05 +00:00
terence tsao
31a78ab22a
Create config package for Shared/featureconfig ( #9593 )
...
* add config/features
* Gazelle
* Gazelle
* Fix build
* Go mod tidy
* active cache
Co-authored-by: rauljordan <raul@prysmaticlabs.com>
2021-09-15 01:18:39 +00:00
Raul Jordan
9935ca3733
Move Shared/ Subpackages Into Monitoring/ Folder ( #9591 )
...
* add tracing
* monitoring pkg
* move prom
* Add client stats
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-09-14 20:59:51 +00:00
Nishant Das
fd920bb786
Fix Finalized Block Retrieval in Altair ( #9561 )
...
* fix
* radek's review
Co-authored-by: terence tsao <terence@prysmaticlabs.com>
2021-09-13 06:57:31 +00:00
Preston Van Loon
4beb352e6f
Move Slot and Epoch functions from helpers to core pkg ( #9519 )
...
* Move Slot and Epoch functions from helpers to core
* limited viz
* goimports
* fix fuzz build
* fix fuzz build
* fix
* fix
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-09-03 20:10:31 +00:00
Raul Jordan
031830baa4
Remove Kafka from Prysm ( #9470 )
...
* remove kafka
* gaz
* rem foreign rules
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-08-26 23:59:00 +00:00
Raul Jordan
fa4a4225a7
Improve DB.SaveBlocks Performance ( #9431 )
...
* improve save blocks performance
* comment
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-08-20 20:01:38 +00:00
Raul Jordan
6368da2716
Remove Nested BoltDB View Within Update Transaction in SaveHeadBlockRoot ( #9428 )
...
* no nested bolt txs
* remove the nested view in update calls
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-08-19 21:42:30 +00:00
Nishant Das
f8355bb241
Add in Database Support For Altair State ( #9388 )
...
* add in schema
* add in altair state support
* nil check
Co-authored-by: Raul Jordan <raul@prysmaticlabs.com>
2021-08-16 12:39:52 +08:00
Nishant Das
49440c90ba
Add in Database Support For Altair Blocks ( #9387 )
...
* add in schema
* gaz
* fix panic in rpc
Co-authored-by: Raul Jordan <raul@prysmaticlabs.com>
2021-08-14 15:50:49 +00:00
terence tsao
d77616f705
Fixes Issues Found by Goland IDE Code Inspect ( #9368 )
...
* Ran code inspect
* Update shared/testutil/altair.go
Co-authored-by: Raul Jordan <raul@prysmaticlabs.com>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-08-11 20:12:22 +00:00
Raul Jordan
ce10be9a16
Add Latest Slasher KV Methods to DB Subpackage ( #9328 )
...
* tests pass
* use end slot for epoch pruning
* amended to endslot of epoch
Co-authored-by: terence tsao <terence@prysmaticlabs.com>
2021-08-05 21:27:05 +00:00
Mohamed Zahoor
395feeb35d
Cross check db state bucket after migration ( #9311 )
...
* added state db check after migration
* satisfy deepsource
* added db compare after migration sub-command
* fomt issue
* point ot bolt issue
* gazel fix
* maxUint84
* revert accidental deletion of WORKSPACE file
* added sorting support
* cleanup debug
* gazel fix
* satisfy deepsource
Co-authored-by: Raul Jordan <raul@prysmaticlabs.com>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-08-05 18:30:05 +00:00
Mohamed Zahoor
239d904d27
Fix memory usability ( #9310 )
...
* fix cache usability
* fix the name of the prometheus flag
Co-authored-by: Raul Jordan <raul@prysmaticlabs.com>
2021-08-04 02:33:28 +00:00
Mohamed Zahoor
0d818a5709
Reduce memory overhead during DB migrations ( #9298 )
...
* wip
* migration happening
* wip
* fix memory utilization, add the testcases
* migration issues
* the gazel
* remove debug logging
* goimport
* gazel
2021-07-30 08:38:54 -05:00
terence tsao
012d279663
Fix duplicated imports ( #9304 )
...
* Fix duplicated imports
* Fix metrics test
2021-07-29 16:45:17 -05:00
Raul Jordan
9145310647
Eliminate Proto V2 Namespace ( #9297 )
...
* get rid of v2 in prysm codebase
* replace block2
* builds
* terence comments
* gazelle
2021-07-28 21:23:44 +00:00
Mohamed Zahoor
21c79f4dfa
Protect the state objects in memory when saving them ( #9291 )
...
Co-authored-by: Raul Jordan <raul@prysmaticlabs.com>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-07-28 18:27:27 +00:00
Mohamed Zahoor
c6bd7a2f83
Efficient Historical State Representation ( #9155 )
...
* added migration in to new schema
* gazel fix
* goimports fix
* construct state with validator entries from a seperate bucket
* save state with validator entry indirection
* fixed save and retreieve issues
* fixed more test cases related to DeepEqual
* added save benchmark
* gazel fix
* organize benchmarks
* add cache and improve state construction performance
* gazel fix
* check type
* remove cache checking from Has
* fix decoding when cache is off
* fix slice bugs
* add migration testcases
* linter fix
* fix few review comments
* fix review feedback
* gazel fix
* satisfy deepsource
* added the feature flag
* lint fix
* fix usage of featureconfig Inti in testcases
* call resetConfig method
* add feature flag in migration testcases
* fix formatting
* change bucket name from blockRootValidatorKeysIndexBucket to blockRootValidatorHashesBucket
* remove from cache when state deleted
* fixed few more comments
* added to devModeFlags
* added cache delete under the feature flag
* fix lint
* change cache sizes and improve documentation
* fiexed few more review coments
* not using hash anymore and using a new SaveStates function
* satisfu deepsource
* run gazel
* fix feature flag related stuff
* fixing merge conflict fix
* few goodies
* improve UX and dont swallow error
* merge fix
* import format fix
* fix migrationion when flag not given issue
Co-authored-by: Radosław Kapka <rkapka@wp.pl>
Co-authored-by: Nishant Das <nishdas93@gmail.com>
2021-07-27 20:02:53 +00:00
terence tsao
8db0c9a0e6
Move proto/interfaces -> proto/prysm/v2 ( #9270 )
...
* Move proto/interfaces -> proto/prysm
* Update paths
* Fix block2
* Update blocks_fetcher_utils.go
* Update BUILD.bazel
Co-authored-by: Raul Jordan <raul@prysmaticlabs.com>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-07-23 20:10:15 +00:00
Preston Van Loon
c0076cc7a2
State: move state interfaces into state package ( #9268 )
...
* Move interfaces from github.com/prysmaticlabs/prysm/beacon-chain/state/interface to github.com/prysmaticlabs/prysm/beacon-chain/state
* remove/rename state2
2021-07-23 16:11:21 +00:00
Raul Jordan
2d10bcf179
Move State Protos Into V2 Namespace ( #9257 )
...
* move state protos
* regen ssz
* edit v1 code
* fix imports
* building
* beacon chain builds
* validator and shared builds
* fuzz builds
* changes
* spectest builds
* tools build
* remove import cycle
* generate ssz
* pcli
* gaz
* kafka
* gaz
2021-07-23 08:07:40 -05:00
Raul Jordan
5864795ca5
Move RPC Protos Into V2 Namespace ( #9254 )
...
* moved rpc protos
* gazelle
* change pb
* validator health
* edit name
* naming
2021-07-22 21:00:28 +00:00
Raul Jordan
b7919b3115
Move DB Protos Into V2 Namespace ( #9253 )
...
* move db protos into prysm v2
* build
* build
* imports gaz
* v2
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-07-22 20:05:06 +00:00
Raul Jordan
6dadb80cc4
Move v1alpha1 into Prysm API namespace ( #9245 )
2021-07-21 21:34:07 +00:00
Nishant Das
c780301096
Remove Validator DB Cache ( #9238 )
...
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-07-21 15:26:07 +00:00
terence tsao
1d3a9983cc
Move block interface next to generated pb ( #9146 )
...
* Move block interface next to pb
* Update fuzz build bazel
* Move interface to /proto/interface and wrapper next to generated pb
* Fix fuzz build bazel
* Add //proto/eth/v1alpha1/wrapper
Co-authored-by: Raul Jordan <raul@prysmaticlabs.com>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-07-06 15:34:05 +00:00
Preston Van Loon
d6bd619429
Bazel: minimal test build transitions ( #9122 )
...
* Add build transitions for minimal config based tests
* respect existing gotags
* clean up import
* Add some commentary
* gaz
Co-authored-by: terence tsao <terence@prysmaticlabs.com>
Co-authored-by: rauljordan <raul@prysmaticlabs.com>
2021-06-30 19:22:09 +00:00
Raul Jordan
b23f63a064
Beacon State V2 Interface Definition With Semantic Version Paths ( #9125 )
...
* v2 state initialize and semantic paths
* ensure build
* gaz changes to ignored build files
* gaz
2021-06-30 15:06:19 +00:00
Raul Jordan
a860648960
Reduce Usage of Eth2 Terminology in Prysm ( #9104 )
...
* remove all mentions
* more changes
* folder by folder
Co-authored-by: terence tsao <terence@prysmaticlabs.com>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-06-26 19:00:33 +00:00
Raul Jordan
1e99ec30cb
Revert "Improve performance during CheckAttesterDoubleVotes" ( #9085 )
...
This reverts commit a958dd246b
.
2021-06-23 21:19:22 +00:00
Nishant Das
9ee086feaf
Disable No Freelist Sync In Backups ( #9069 )
2021-06-21 15:14:55 +02:00
Alexander Mollohan
ae7e2764e0
Adding ability to override directory permissions for db backup ( #8888 )
...
* Adding ability to override directory permissions for db backup
* adding new flag to usage.go
* Backup now has its own directory handling method to reduce footprint of prospective change
* removing unneeded test
* fixing build error
* switching to url param for override
* stripping flag
* adding in unit tests
* fixing a test
* minor changes for testing
Co-authored-by: Raul Jordan <raul@prysmaticlabs.com>
2021-06-18 01:37:58 +00:00
Raul Jordan
5aac06f04e
Move EthereumAPIs Into Prysm ( #8968 )
...
* begin move
* use same import path
* imports
* regen protos
* regen
* no rename
* generate ssz
* gaz
* fmt
* edit build file
* imports
* modify
* remove generated files
* remove protos
* edit imports in prysm
* beacon chain all builds
* edit script
* add generated pbs
* add replace rules
* license for ethereumapis protos
* change visibility
* fmt
* update build files to gaz ignore
* use proper form
* edit imports
* wrap block
* revert scripts
* revert go mod
2021-06-02 18:49:52 -05:00
terence tsao
276d03553c
Block interface clean up ( #8947 )
2021-05-26 11:33:46 -07:00
Nishant Das
caf9bdbc6f
Use Block Interface Across Prysm ( #8918 )
...
* commit initial work
* checkpoint current work
* gaz
* checkpoint
* req/resp changes
* initial-sync
* finally works
* fix error
* fix bugs
* fix issue
* fix issues
* fix refs
* tests
* more text fixes
* more text fixes
* more text fixes
* fix tests
* fix tests
* tests
* finally fix builds
* finally
* comments
* fix fuzz
* share common library
* fix
* fix
* add in more defensive nil checks
* add in more defensive nil checks
* imports
* Apply suggestions from code review
Co-authored-by: terence tsao <terence@prysmaticlabs.com>
* Apply suggestions from code review
Co-authored-by: terence tsao <terence@prysmaticlabs.com>
* Update shared/interfaces/block_interface.go
Co-authored-by: terence tsao <terence@prysmaticlabs.com>
* Update shared/interfaces/block_wrapper.go
Co-authored-by: terence tsao <terence@prysmaticlabs.com>
* Update shared/interfaces/block_interface.go
Co-authored-by: terence tsao <terence@prysmaticlabs.com>
* imports
* fix bad changes
* fix
* terence's review
* terence's review
* fmt
* Update beacon-chain/rpc/beacon/blocks.go
Co-authored-by: Radosław Kapka <rkapka@wp.pl>
* fix tests
* fix
* fix all tests
Co-authored-by: terence tsao <terence@prysmaticlabs.com>
Co-authored-by: Radosław Kapka <rkapka@wp.pl>
2021-05-26 16:19:54 +00:00
Zahoor Mohamed
a958dd246b
Improve performance during CheckAttesterDoubleVotes ( #8927 )
...
* de-normalize attestationDataRootsBucket to improve performace in CheckAttesterDoubleVotes
* parallize processing of every attestation
* fix double vote test case to take care of jumbled double votes due to parallel processing
* remove attestationRecordsBucket totally and take care of pruning
* missed out build file
* fix review comments
Co-authored-by: Raul Jordan <raul@prysmaticlabs.com>
2021-05-25 13:02:18 +05:30