Commit Graph

2247 Commits

Author SHA1 Message Date
battlmonstr
92db317e06
Observer - P2P network crawler (#3928)
Observer crawls the Ethereum network and collects information about the nodes.
2022-04-22 12:02:12 +01:00
Alex Sharov
0d6775fd95
torrent: print peers amount in logs (#3942) 2022-04-22 17:37:35 +07:00
Giulio rebuffo
c5b1836481
Added Ethstats service (#3931)
* somewhat there but not yet

* lol

* more efficient ethstats

* lint

* not die on no wifi
2022-04-22 07:23:52 +01:00
Alex Sharov
58c86d550d
Snapshots: Max index parallelism to 4 (#3925)
* save

* save

* Readme update: built-in rpc daemon and syncmode=snap

* save

* save

* save
2022-04-21 17:49:42 +07:00
Alex Sharov
9051d95836
Downloader tables, mdbx-based torrent pieces completion store (#3923)
* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save
2022-04-21 10:34:31 +07:00
Alex Sharov
6aa4999729
Parallel indexing (#3921) 2022-04-21 10:34:10 +07:00
Alex Sharov
e1d7cc3d3f
Enable: syncmode=snap by default (goerli, mainnet, bsc) (#3910) 2022-04-18 14:40:40 +07:00
Alex Sharov
768e1204f6
integration: check that snapshots are nil #3906 2022-04-17 09:54:00 +07:00
Giulio rebuffo
ef14176007
Caching Least Recently Used Contract Code in Stage Execution (#3887)
* caching gets

* whitelist

* fix

* less ram

* comment
2022-04-14 23:34:03 +02:00
ledgerwatch
156da607e7
More compact representation of huffman trees in the seg files (#3875)
* More compact representation of huffman trees in the seg files

* Update to latest erigon-lib

* recompress

* recompress

* recompress

* uncompress: buf fix

* Update to latest erigon-lib

* Revert default sync mode

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2022-04-13 16:29:44 +01:00
alex.sharov
8db37cfd97 change default syncmode 2022-04-13 19:09:20 +07:00
Andrew Ashikhmin
b41fe19ecb
Memorize bad PoS headers (#3879)
* Memorize bad PoS headers

* More places to ReportBadHeaderPoS
2022-04-12 17:05:23 +02:00
Alex Sharov
ff44db147e
Torrent: Increase peers amount to improve Swarm-ing, can do it now because have ratelimiter #3877 2022-04-12 09:09:09 +07:00
Alex Sharov
c56d32682e
fix_nil_pointer (#3871) 2022-04-11 17:29:53 +07:00
Alex Sharov
54ec6df6e1
ErigonLib: move types to own package (#3865) 2022-04-11 10:05:07 +07:00
ledgerwatch
f56d4c5881
Switch peerId from 256 to 512 bit (as in stable) (#3862)
* Switch peerId from 256 to 512 bit (as in stable)

* go mod tidy

* Fix some tests

* Fixed

* Fixes

* Fix tests

* Update to erigon-lib main

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-10 08:01:25 +01:00
Alex Sharov
9b47daee44
Default syncmode=snap for Mainnet, Bsc, Goerli (#3861)
* change syncmode default to snap sync

* save
2022-04-10 07:20:20 +01:00
Andrea Lanfranchi
03bd96ef8c
Remove unneeded Plainstate lookups for EOAs (#3860) 2022-04-10 09:28:41 +07:00
alex.sharov
072e49653a A bit less logs 2022-04-09 10:45:46 +07:00
alex.sharov
637c981350 Fix for slow LogIndex prune 2022-04-09 10:29:40 +07:00
alex.sharov
fea26a4c0d Fix for slow LogIndex prune 2022-04-09 10:14:39 +07:00
Alex Sharov
b512d4423a
Fix for slow LogIndex prune (#3858)
* save

* save
2022-04-09 10:11:18 +07:00
Alex Sharov
3d0b339124
wait for snapshots not only for POW (#3857) 2022-04-09 09:45:18 +07:00
alex.sharov
f02a390dad snapshots: delete portion of ancient blocks on each sync cycle 2022-04-08 14:43:11 +07:00
Andrew Ashikhmin
9b9da14cd1
Check that safe & finalized blocks are ancestors of head block (#3839)
* Check that safe & finalized blocks are ancestors of head block

* Add logging
2022-04-07 09:37:12 +02:00
Andrew Ashikhmin
634e9e4f3c
Prohibit EIP-2718 txn wrapped as RLP strings (#3827) 2022-04-06 10:40:44 +02:00
alex.sharov
ce95cb496d download on empty 2022-04-06 09:40:14 +07:00
Alex Sharov
67a623e264
Open rwdir once(#3833) 2022-04-06 05:54:53 +07:00
ledgerwatch
9898376cdc
Fix nil pointer error (#3825)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-05 12:10:33 +01:00
Alex Sharov
80bd44fce5
Snapsthos: build indices on retire blocks (#3823)
* grpc up

* grpc up

* grpc up
2022-04-05 16:22:11 +07:00
Giulio rebuffo
1b0d7c80bf
Better batches for Execution (Hashmaps based instead of BTree based) (#3814) 2022-04-04 14:11:59 +07:00
Alex Sharov
ca66e64f22
Limit amount of deletes during one sync cycle (#3816) 2022-04-04 08:38:38 +07:00
Alex Sharov
68153ff6e6
Relax segments expectation (#3812)
* skip empty seg

* skip empty seg

* skip empty seg
2022-04-02 10:47:01 +07:00
alex.sharov
d8d13e07d1 fix linter 2022-04-01 15:08:13 +07:00
Alex Sharov
d1218181b0
Snapshots: geth compatibility, use --syncmode=snap flag (#3808) 2022-04-01 15:00:50 +07:00
Alex Sharov
8b03582558
compressor: log lvl #408
* save

* save
2022-04-01 10:44:30 +07:00
Andrew Ashikhmin
6ff6c39d13
Prefer forkchoice head as latest block in RPC (#3806)
* LastForkchoice accessors

* Update erigon-lib

* Prefer forkchoice head as latest block in RPC

* Fix typo
2022-04-01 08:33:50 +07:00
Alex Sharov
84cff259b5
snapshots: prune txlookup (#3794) 2022-03-30 11:50:16 +07:00
Andrew Ashikhmin
816ad30eff
Small Merge-related clarifications & improvements (#3785)
* Hd.Fetching -> FetchingNew

* ReadHeadHeaderHash makes more sense in verifyAndSaveNewPoSHeader

* Potentially more correct LatestValidHash in case of payload with invalid transactions
2022-03-29 11:47:07 +02:00
Alex Sharov
89d4477df3
Snapshots: nil indices on p2p fix (#3772) 2022-03-27 10:07:58 +07:00
ledgerwatch
9ea6398524
Fixes to subscribe logs (#3769)
* Fixes to subscribe logs

* Add criteria to logs subscription

* Skeleton of RPC daemon event log distribution

* Simplify

* Send aggregated filter to Erigon

* Change API

* Print

* Fixes

* Fix topics filtering

* Fill txHash and blockHash

* Timing logs, fill tx index

* Print

* More print

* Print

* Asynchronous sending of log events to RPC daemon

* Remove prints

* Only extract logs if there are subscribers

* Check empty when RPC daemon is removed

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-03-26 18:21:31 +00:00
Alex Sharov
e0dfb8fb22
Snapshots: handle well gaps in idx files (#3762)
* handle well gaps in idx files

* handle well gaps in idx files
2022-03-24 14:19:14 +07:00
alex.sharov
e2ac8e56a6 save 2022-03-24 12:18:50 +07:00
Alex Sharov
85e47d83d2
Snapshots: remove "experimental" prefix from cli flag (#3760) 2022-03-24 12:17:31 +07:00
Alex Sharov
a357421719
Snapshots: notify rpcdaemon about new snapshot (#3755) 2022-03-24 09:25:38 +07:00
Giulio rebuffo
b7fb85df6a
demoted logs (#3753) 2022-03-23 10:28:32 +01:00
Andrew Ashikhmin
74a7d7c75a
Refactor PoS downloader (#3717)
* Remove blockHeight arg from FeedHeaderPoW

* Revert "Remove blockHeight arg from FeedHeaderPoW"

This reverts commit 9bf92921db11cd4e13386fcee29f30241d070fc6.

* Move PayloadMessage & ForkChoiceMessage to package engineapi

* RequestList instead of newPayloadCh & forkChoiceCh

* Introduce request status

* Send reply only when request status is New

* Move BeaconRequestList to HeaderDownload

* Don't SetFetching when PoS (Fetching means handling newBlockHashes)

* Merge Syncing & Synced into DataWasMissing

* Introduce SyncStatus

* onlyNew arg in WaitForRequest

* Move waitingForBeaconChain into RequestList

* Interrupt instead of skipCycleHack

* Introduce timeout for PoS headers

* Split downloadMissingPoSHeaders

* Move StartPoSDownloader into HeaderDownload

* Move Stopping interrupt to StartPoSDownloader

* Move stopping PayloadStatus back to HeadersPOS

* cleanUpPoSDownload

* Post-merge fix

* TestBogusForkchoice

* TestPoSDownloader

* requestStatus in attemptPoSDownload

* Broadcast in SetStatus

* Cosmetics

* attemptPoSDownload -> schedulePoSDownload

* Demote some logs to Trace
2022-03-22 17:49:12 +01:00
Alex Sharov
36b9cc2982
Snapshots: initial sync fix (#3750) 2022-03-22 10:33:15 +07:00
Alex Sharov
4cf4c1bac1
Snapshots: better support of p2p (#3749) 2022-03-21 20:36:03 +07:00
Alex Sharov
9100e0dc3c
Snapshots: fix for fresh sync (#3748) 2022-03-21 14:07:39 +07:00