prysm-pulse/beacon-chain/sync
terence tsao 7f7866ff2a
Micro optimizations on new-state-mgmt service for initial syncing (#5241)
* Starting a quick PoC

* Rate limit to one epoch worth of blocks in memory

* Proof of concept working

* Quick comment out

* Save previous finalized checkpoint

* Test

* Minor fixes

* More run time fixes

* Remove panic

* Feature flag

* Removed unused methods

* Fixed tests

* E2e test

* comment

* Compatible with current initial sync

* Starting

* New cache

* Cache getters and setters

* It should be part of state gen

* Need to use cache for DB

* Don't have to use finalized state

* Rm unused file

* some changes to memory mgmt when using mempool

* More run time fixes

* Can sync to head

* Feedback

* Revert "some changes to memory mgmt when using mempool"

This reverts commit f5b3e7ff4714fef9f0397007f519a45fa259ad24.

* Fixed sync tests

* Fixed existing tests

* Test for state summary getter

* Gaz

* Fix kafka passthrough

* Fixed inputs

* Gaz

* Fixed build

* Fixed visibility

* Trying without the ignore

* Didn't work..

* Fix kafka

Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
Co-authored-by: Preston Van Loon <preston@prysmaticlabs.com>
2020-03-30 17:10:45 -05:00
..
initial-sync Batch save blocks for initial sync. 80% faster BPS (#5215) 2020-03-30 18:04:10 +00:00
initial-sync-old Batch save blocks for initial sync. 80% faster BPS (#5215) 2020-03-30 18:04:10 +00:00
BUILD.bazel Micro optimizations on new-state-mgmt service for initial syncing (#5241) 2020-03-30 17:10:45 -05:00
deadlines.go Initial Sync: Round robin (#3538) 2019-09-25 12:00:04 -05:00
decode_pubsub.go Use libp2p gossipsub upstream validator framework (#4318) 2019-12-20 03:18:08 +00:00
doc.go Regular Sync - First Pass (#3201) 2019-08-16 13:13:04 -04:00
error_test.go Service as proper names (#4293) 2019-12-16 19:53:55 -06:00
error.go Rate limiter for rpc beacon blocks (#4549) 2020-01-15 17:19:06 -08:00
log.go Regular Sync - First Pass (#3201) 2019-08-16 13:13:04 -04:00
metrics.go Handle attestations with missing block (#4705) 2020-02-02 01:42:29 +00:00
pending_attestations_queue_test.go Micro optimizations on new-state-mgmt service for initial syncing (#5241) 2020-03-30 17:10:45 -05:00
pending_attestations_queue.go Micro optimizations on new-state-mgmt service for initial syncing (#5241) 2020-03-30 17:10:45 -05:00
pending_blocks_queue_test.go Add Attestation Subnet Bitfield (#4989) 2020-03-23 09:41:47 -05:00
pending_blocks_queue.go add lock (#4739) 2020-02-04 16:31:31 +08:00
rpc_beacon_blocks_by_range_test.go Rate limiter for rpc beacon blocks (#4549) 2020-01-15 17:19:06 -08:00
rpc_beacon_blocks_by_range.go Rate limiter for rpc beacon blocks (#4549) 2020-01-15 17:19:06 -08:00
rpc_beacon_blocks_by_root_test.go Ensure New State Type Tests Pass in Prysm (#4646) 2020-01-31 12:57:01 -08:00
rpc_beacon_blocks_by_root.go Pending blocks queue: Better locking priority (#4709) 2020-02-01 22:47:51 +00:00
rpc_chunked_response.go Update run time to v0.9.3 (#4154) 2020-01-07 18:47:39 +00:00
rpc_goodbye_test.go Fix Goodbye RPC handler (#4831) 2020-02-11 09:08:01 -06:00
rpc_goodbye.go Fix Goodbye RPC handler (#4831) 2020-02-11 09:08:01 -06:00
rpc_status_test.go Ensure New State Type Tests Pass in Prysm (#4646) 2020-01-31 12:57:01 -08:00
rpc_status.go Ensure initial sync is initialised (#4587) 2020-01-20 10:38:27 -06:00
rpc_test.go Service as proper names (#4293) 2019-12-16 19:53:55 -06:00
rpc.go Resolve Miscellaneous Bugs in Beacon Node (#4743) 2020-02-04 11:21:02 -06:00
service.go Micro optimizations on new-state-mgmt service for initial syncing (#5241) 2020-03-30 17:10:45 -05:00
subscriber_beacon_aggregate_proof_test.go Faster hashing for attestation pool (#5217) 2020-03-26 23:55:25 +00:00
subscriber_beacon_aggregate_proof.go Update run time to v0.9.3 (#4154) 2020-01-07 18:47:39 +00:00
subscriber_beacon_blocks_test.go Faster hashing for attestation pool (#5217) 2020-03-26 23:55:25 +00:00
subscriber_beacon_blocks.go Fix new state mgmt sync stuck in a loop (#5142) 2020-03-19 18:46:35 -07:00
subscriber_committee_index_beacon_attestation_test.go Micro optimizations on new-state-mgmt service for initial syncing (#5241) 2020-03-30 17:10:45 -05:00
subscriber_committee_index_beacon_attestation.go Attestation Dynamic Committee Subnets (#5123) 2020-03-18 23:13:37 +00:00
subscriber_handlers.go handle slashing from p2p (#5047) 2020-03-13 16:47:27 -05:00
subscriber_test.go handle slashing from p2p (#5047) 2020-03-13 16:47:27 -05:00
subscriber.go Add HighestSlotBlock Getter for db (#5182) 2020-03-23 18:42:41 -05:00
validate_aggregate_proof_test.go Micro optimizations on new-state-mgmt service for initial syncing (#5241) 2020-03-30 17:10:45 -05:00
validate_aggregate_proof.go Micro optimizations on new-state-mgmt service for initial syncing (#5241) 2020-03-30 17:10:45 -05:00
validate_attester_slashing_test.go fuzz core/blocks package (#4907) 2020-03-03 19:02:14 +05:30
validate_attester_slashing.go Ensure New State Type Tests Pass in Prysm (#4646) 2020-01-31 12:57:01 -08:00
validate_beacon_blocks_test.go Add ssz marshal and unmarshal for most data structures (#5121) 2020-03-19 02:39:23 +00:00
validate_beacon_blocks.go Update run time to v0.9.3 (#4154) 2020-01-07 18:47:39 +00:00
validate_committee_index_beacon_attestation_test.go Micro optimizations on new-state-mgmt service for initial syncing (#5241) 2020-03-30 17:10:45 -05:00
validate_committee_index_beacon_attestation.go Micro optimizations on new-state-mgmt service for initial syncing (#5241) 2020-03-30 17:10:45 -05:00
validate_proposer_slashing_test.go fuzz core/blocks package (#4907) 2020-03-03 19:02:14 +05:30
validate_proposer_slashing.go Ensure New State Type Tests Pass in Prysm (#4646) 2020-01-31 12:57:01 -08:00
validate_voluntary_exit_test.go fuzz core/blocks package (#4907) 2020-03-03 19:02:14 +05:30
validate_voluntary_exit.go Ensure New State Type Tests Pass in Prysm (#4646) 2020-01-31 12:57:01 -08:00