alex.sharov
cbd1116cf3
save
2022-04-19 17:40:09 +07:00
Alex Sharov
8d81c3b0f8
Rwdir fix2 ( #3915 )
2022-04-19 08:55:46 +07:00
ledgerwatch
7080c6fab9
Fix help and README.md about pruning options ( #3914 )
...
* Update README.md
* Update flags.go
* Update README.md
2022-04-18 21:50:21 +01:00
ledgerwatch
748f70e7be
Fixes in header downloader ( #3913 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-18 18:01:20 +01:00
Alex Sharov
e1d7cc3d3f
Enable: syncmode=snap by default (goerli, mainnet, bsc) ( #3910 )
2022-04-18 14:40:40 +07:00
alex.sharov
d10d194984
save
2022-04-18 11:27:36 +07:00
Alex Sharov
9305efeaa7
Snapshots: use kv.ReadAhead helper ( #3909 )
2022-04-18 10:48:09 +07:00
ledgerwatch
b45707ca06
Update header_algos.go ( #3907 )
2022-04-17 07:45:56 +01:00
Alex Sharov
4419c23866
Compress: reduce maxlen to 512 ( #3891 )
2022-04-17 07:59:38 +07:00
ledgerwatch
ba689258fa
Update header_algos.go ( #3900 )
2022-04-16 14:48:45 +01:00
Alex Sharov
777412e0bb
Snapshots: notify before remove ( #3885 )
...
* goerli
* goerli
2022-04-14 14:56:08 +07:00
alex.sharov
d439b76a1f
goerli
2022-04-14 11:12:15 +07:00
ledgerwatch
78a58047dc
Fix in recompression ( #3884 )
...
* Fix in recompression
* Fix error handling
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-14 11:07:17 +07:00
ledgerwatch
156da607e7
More compact representation of huffman trees in the seg files ( #3875 )
...
* More compact representation of huffman trees in the seg files
* Update to latest erigon-lib
* recompress
* recompress
* recompress
* uncompress: buf fix
* Update to latest erigon-lib
* Revert default sync mode
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2022-04-13 16:29:44 +01:00
alex.sharov
482e06ead3
uncompress: buf fix
2022-04-13 16:35:21 +07:00
alex.sharov
594477ab23
uncompress: buf fix
2022-04-13 12:45:22 +07:00
Andrew Ashikhmin
b41fe19ecb
Memorize bad PoS headers ( #3879 )
...
* Memorize bad PoS headers
* More places to ReportBadHeaderPoS
2022-04-12 17:05:23 +02:00
alex.sharov
6cbbfb46eb
recompress
2022-04-12 14:53:21 +07:00
Alex Sharov
0842e2bd12
RetireBlocks: preserve genesis ( #3869 )
...
* save
* save
* save
2022-04-11 13:16:45 +07:00
Alex Sharov
54ec6df6e1
ErigonLib: move types to own package ( #3865 )
2022-04-11 10:05:07 +07:00
ledgerwatch
f56d4c5881
Switch peerId from 256 to 512 bit (as in stable) ( #3862 )
...
* Switch peerId from 256 to 512 bit (as in stable)
* go mod tidy
* Fix some tests
* Fixed
* Fixes
* Fix tests
* Update to erigon-lib main
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-10 08:01:25 +01:00
Alex Sharov
9b47daee44
Default syncmode=snap for Mainnet, Bsc, Goerli ( #3861 )
...
* change syncmode default to snap sync
* save
2022-04-10 07:20:20 +01:00
Alex Sharov
b6334870e8
Snapshots: recompress.sh ( #3845 )
...
* save
* save
2022-04-07 13:26:14 +07:00
Alex Sharov
7d86283910
Sapshots: idx merge ( #3841 )
...
* return err on interruption
* save
* save
* save
* save
* save
* save
* save
* save
* save
2022-04-07 11:27:57 +07:00
Alex Sharov
bc368098c8
Torrent: more cli params ( #3838 )
2022-04-06 21:06:58 +07:00
alex.sharov
5c5bcfe0fe
bsc snapshot
2022-04-06 15:44:12 +07:00
alex.sharov
d223580d10
goerli snapshot
2022-04-06 09:49:58 +07:00
ledgerwatch
d604b5e107
Update preverified hashes and skip analysis ( #3831 )
...
* Update skip_analysis
* Preverified hashes
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-05 21:49:45 +01:00
Alex Sharov
80bd44fce5
Snapsthos: build indices on retire blocks ( #3823 )
...
* grpc up
* grpc up
* grpc up
2022-04-05 16:22:11 +07:00
Alex Sharov
4cdc38ca58
reopen after merge ( #3822 )
2022-04-05 09:18:39 +07:00
TBC Dev
23e1bc9771
Fix block hash announces ( #3819 )
2022-04-05 08:06:12 +07:00
TBC Dev
057298f71b
Fix broken Goerli sync ( #3817 )
...
Previous preverified hashes were not from Goerli
2022-04-05 08:05:28 +07:00
alex.sharov
4fb2a14756
add readahead to segment uncompress pipe
2022-04-04 21:07:02 +07:00
Giulio rebuffo
1b0d7c80bf
Better batches for Execution (Hashmaps based instead of BTree based) ( #3814 )
2022-04-04 14:11:59 +07:00
alex.sharov
32467007c1
snapshots: auto fix
2022-04-02 13:28:18 +07:00
alex.sharov
38ad751fa0
goerli snapshot
2022-04-02 11:26:39 +07:00
Alex Sharov
68153ff6e6
Relax segments expectation ( #3812 )
...
* skip empty seg
* skip empty seg
* skip empty seg
2022-04-02 10:47:01 +07:00
Alex Sharov
d1218181b0
Snapshots: geth compatibility, use --syncmode=snap flag ( #3808 )
2022-04-01 15:00:50 +07:00
Alex Sharov
8b03582558
compressor: log lvl #408
...
* save
* save
2022-04-01 10:44:30 +07:00
Andrew Ashikhmin
6ff6c39d13
Prefer forkchoice head as latest block in RPC ( #3806 )
...
* LastForkchoice accessors
* Update erigon-lib
* Prefer forkchoice head as latest block in RPC
* Fix typo
2022-04-01 08:33:50 +07:00
Alex Sharov
804f322e91
fix nil pointer in fetch.go ( #3801 )
...
* fix nil pointer in fetch.go
* fix nil pointer in fetch.go
2022-03-31 15:13:20 +07:00
Alex Sharov
328c7b28a6
compress uncompress cli methods ( #3798 )
2022-03-31 14:10:40 +07:00
alex.sharov
4519e10e39
save
2022-03-31 09:44:12 +07:00
Alex Sharov
84cff259b5
snapshots: prune txlookup ( #3794 )
2022-03-30 11:50:16 +07:00
Andrew Ashikhmin
816ad30eff
Small Merge-related clarifications & improvements ( #3785 )
...
* Hd.Fetching -> FetchingNew
* ReadHeadHeaderHash makes more sense in verifyAndSaveNewPoSHeader
* Potentially more correct LatestValidHash in case of payload with invalid transactions
2022-03-29 11:47:07 +02:00
ledgerwatch
eb07ad89dd
Update Skip analysis and preverified hashes ( #3777 )
...
* Update skip analysis
* Add preverified hashes for mainnet and ropsten
* preverified hashes and bootnode for sepolia
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-03-27 09:42:33 +01:00
Alex Sharov
89d4477df3
Snapshots: nil indices on p2p fix ( #3772 )
2022-03-27 10:07:58 +07:00
Giulio rebuffo
6a345847d8
[Critical] POS Panda Banner Added ( #3758 )
...
* pandaaa
* better
2022-03-24 07:35:58 +00:00
Alex Sharov
e0dfb8fb22
Snapshots: handle well gaps in idx files ( #3762 )
...
* handle well gaps in idx files
* handle well gaps in idx files
2022-03-24 14:19:14 +07:00
Alex Sharov
a357421719
Snapshots: notify rpcdaemon about new snapshot ( #3755 )
2022-03-24 09:25:38 +07:00
Giulio rebuffo
f4bf94f78a
Fixed Erigon README for Authentication API and jwt.hex generates in Datadir ( #3757 )
...
* added datadir jwt
* fixed readme
2022-03-24 09:10:29 +07:00
Andrew Ashikhmin
74a7d7c75a
Refactor PoS downloader ( #3717 )
...
* Remove blockHeight arg from FeedHeaderPoW
* Revert "Remove blockHeight arg from FeedHeaderPoW"
This reverts commit 9bf92921db11cd4e13386fcee29f30241d070fc6.
* Move PayloadMessage & ForkChoiceMessage to package engineapi
* RequestList instead of newPayloadCh & forkChoiceCh
* Introduce request status
* Send reply only when request status is New
* Move BeaconRequestList to HeaderDownload
* Don't SetFetching when PoS (Fetching means handling newBlockHashes)
* Merge Syncing & Synced into DataWasMissing
* Introduce SyncStatus
* onlyNew arg in WaitForRequest
* Move waitingForBeaconChain into RequestList
* Interrupt instead of skipCycleHack
* Introduce timeout for PoS headers
* Split downloadMissingPoSHeaders
* Move StartPoSDownloader into HeaderDownload
* Move Stopping interrupt to StartPoSDownloader
* Move stopping PayloadStatus back to HeadersPOS
* cleanUpPoSDownload
* Post-merge fix
* TestBogusForkchoice
* TestPoSDownloader
* requestStatus in attemptPoSDownload
* Broadcast in SetStatus
* Cosmetics
* attemptPoSDownload -> schedulePoSDownload
* Demote some logs to Trace
2022-03-22 17:49:12 +01:00
Alex Sharov
36b9cc2982
Snapshots: initial sync fix ( #3750 )
2022-03-22 10:33:15 +07:00
Alex Sharov
4cf4c1bac1
Snapshots: better support of p2p ( #3749 )
2022-03-21 20:36:03 +07:00
alex.sharov
752a52c4af
fix test
2022-03-21 19:33:26 +07:00
Alex Sharov
9100e0dc3c
Snapshots: fix for fresh sync ( #3748 )
2022-03-21 14:07:39 +07:00
Alex Sharov
9c49142e6b
Snapshots: script to commit hashes ( #3746 )
2022-03-21 13:40:35 +07:00
Alex Sharov
586ad297e6
Snapshots: script to auto-commit torrent hashes ( #3745 )
2022-03-21 11:22:37 +07:00
Alex Sharov
7799d145ca
Snapshots: fix partial .idx detection ( #3744 )
...
* save
* save
* save
* save
2022-03-21 10:28:33 +07:00
Alex Sharov
5f4bb98264
Snapshots: do indexing for older ranges if need ( #3733 )
...
* save
* save
* save
* save
2022-03-21 10:28:24 +07:00
alex.sharov
1e78e509ac
save
2022-03-21 09:10:52 +07:00
Enrique Jose Avila Asapche
726557fe72
Expose jwt-secret flag in erigon ( #3741 )
2022-03-21 08:33:10 +07:00
ledgerwatch
d5fb8f7d24
[erigon2] Separate handover timing ( #3736 )
...
* Separate handover timing
* Update
* Corrected handover time calculation
* Not use compression when aggregate
* Update to latest erigon-lib
* Update to erigon-lib main
* Update
* Disable reproducible builds
* Restore github actions
* Restore github actions
* Revert "linter to support go 1.18 (#3739 )"
This reverts commit 1fd434d3d1
2022-03-19 16:15:12 +00:00
ledgerwatch
4f7f1554c5
Update helper.go ( #3737 )
2022-03-19 09:36:35 +07:00
EXEC
a6ff889db9
Fix erigon version miss git commit ( #3738 )
2022-03-19 09:36:00 +07:00
Alex Sharov
a04fa4838d
Snapshots: corner cases when .seg exists and .idx doesn't ( #3731 )
2022-03-18 13:36:59 +07:00
Alex Sharov
f314222180
Snapshots: start seed new large .seg files ( #3724 )
2022-03-18 11:12:18 +07:00
Artem Tsebrovskiy
f14df3faa3
added support of Clique consensus for block processing for erigon2 ( #3705 )
...
* added support of Clique consensus for block processing for erigon2
* erigon2: remove block reader which doesn't use system pre and post block transactions
2022-03-17 07:30:47 +00:00
Alex Sharov
d5dbad4f27
save (#3715co
2022-03-16 15:35:36 +07:00
Alex Sharov
469b75c3d3
Snapshots: retire blocks by default ( #3707 )
2022-03-16 09:57:48 +07:00
ledgerwatch
10aee02e2e
Update skip analysis and preverified hashes ( #3700 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-03-15 14:45:36 +00:00
alex.sharov
6823dc21c4
goerli snapshots
2022-03-13 10:16:19 +07:00
Alex Sharov
f03d08c5ce
Snapshots: retire testing tool ( #3684 )
2022-03-12 17:26:11 +07:00
Alex Sharov
aed679c8a0
snapshots: enum file types ( #3683 )
2022-03-12 15:27:55 +07:00
alex.sharov
82ac1b9649
goerli snapshots
2022-03-12 10:39:34 +07:00
Alex Sharov
b003d07839
Add system-txs to begin end of block ( #3654 )
...
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* up torrent
* up torrent
* up torrent
* up torrent
* up torrent
* up torrent
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
2022-03-10 07:48:58 +00:00
Vox
865999abb6
Fix dev chain listen port not set ( #3671 )
...
* Fix forced --port=0 and warn user of hard-coded flags
* Fix typo
* Check for port explicitly set, be verbose about it
Co-authored-by: 0xVox <ohnoyoudont@nottoday.com>
2022-03-10 12:13:55 +07:00
Alex Sharov
0b2ce6f845
rpcdaemon: limit amount of read transactions ( #3637 )
...
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* a
* a
* a
* a
* a
* a
* fefefe
* fefefe
* fefefe
* fefefe
* fefefe
* fefefe
* fefefe
* fefefe
* fefefe
* fefefe
* fefefe
* fefefe
* fefefe
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
2022-03-08 10:43:14 +07:00
Alex Sharov
f5be8919ef
snapshots: merge segments strategy ( #3645 )
...
* save
* save
* save
2022-03-04 14:16:16 +07:00
Andrew Ashikhmin
4607179849
Handle a corner case in forkchoiceUpdated ( #3640 )
...
* Fix typo
* fix typos
* Handle corner case when unwinding to geneis
* No-op ForkChoice
2022-03-03 16:09:03 +01:00
battlmonstr
47df98a499
Use "err" key for logging errors. ( #3632 )
...
log.Warn/Error uses "err" key to log errors in most places.
This renames "error" to "err" in some places to adhere to this convention.
2022-03-01 15:40:51 +00:00
Enrique Jose Avila Asapche
a65f12b248
State override support ( #3628 )
...
* added stateOverride type
* solved import cycle
* refactoring
* imported wrong package
* fixed Call arguments
* typo
* override for traceCall
2022-03-01 15:40:24 +00:00
Alex Sharov
f8c1fb9563
snapshots: speedup slow test ( #3623 )
2022-02-25 11:42:54 +07:00
Alex Sharov
96e0691d4a
snapshots: delete .idx after merge ( #3619 )
2022-02-25 11:41:49 +07:00
battlmonstr
65ce332e8b
Fix lint: remove unused findAndMergeBlockSegments log level parameter. ( #3613 )
...
Fixes lint errors:
turbo/snapshotsync/block_snapshots_test.go:77:69: not enough arguments in call to findAndMergeBlockSegments (typecheck)
_, err := findAndMergeBlockSegments(context.Background(), s, dir, 1)
turbo/snapshotsync/block_snapshots_test.go:88:68: not enough arguments in call to findAndMergeBlockSegments (typecheck)
_, err = findAndMergeBlockSegments(context.Background(), s, dir, 1)
2022-02-24 20:15:33 +07:00
Alex Sharov
ac15d2b922
snapshots: better logging ( #3611 )
2022-02-24 16:28:46 +07:00
ledgerwatch
67b9e5988c
Add preverified hashes for mainnet and ropsten ( #3609 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-02-24 08:37:20 +00:00
Alex Sharov
454045185a
snapshots: fix indexing of recently merged range ( #3607 )
2022-02-24 14:19:01 +07:00
Alex Sharov
809cfdcf19
snapshots: indexing of recently merged range ( #3606 )
...
* snapshots: fix indexing of recently merged range
* snapshots: fix indexing of recently merged range
* snapshots: fix indexing of recently merged range
* snapshots: fix indexing of recently merged range
* snapshots: fix indexing of recently merged range
2022-02-24 14:15:03 +07:00
Alex Sharov
b94bc84a3b
snapshots: command to debug retire blocks ( #3603 )
...
* snapshots: command_to_debug_retire
* snapshots: command_to_debug_retire
2022-02-24 11:30:34 +07:00
ledgerwatch
17b2a9ba93
Bor fixes ( #3553 )
...
* Integration to work with bor
* Turn off validator set check
* disable verifySeal, add skeleton of postExec stage
* Pass around syscall
* Print
* Print more
* Default heimdall values for integration
* restore contract
* Print
* Print
* Print
* Print
* Print
* Print
* Print
* Print
* Fix nonce of system contract
* Remove prints
* Revert some more printing
* More fixes
* Print log
* Fix transfer log
* More printing
* More printing
* Print
* Print
* Print
* Print
* Print
* Print
* Print
* Fix validaor reward
* Remove printing
* Remove more prints
* Less printing
* Fetch validators from heimdall
* Remove syscall from Seal and CalcDifficulty
* Remove syscall from Prepare
* Print
* Remove DNS discovery
* Print apply snapshot
* Print
* Chunk up snapshot generation
* Chunk up snapshot generation
* Better logs when snapshotting
* Handle parents
* Prevent shadowing of snap
* Fix heimdall fetch
* Logging fixes
* Save generated snapshots
* Add header
* Less logging
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-02-24 00:03:10 +00:00
ledgerwatch
ee488020dd
Auto detect latest block for optimal use of plain state and state cache ( #3598 )
...
* Auto detect latest block for optimal use of plain state and state cache
* Fix lint
* Fix test
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-02-23 23:42:14 +00:00
ledgerwatch
7397af57d4
Optimise eth_getStorageAt for current state ( #3580 )
...
* Optimise eth_getStorageAt for current state
* Fix
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-02-23 09:44:55 +00:00
alex.sharov
258e8d5506
snapshots: fix test
2022-02-23 13:18:00 +07:00
Alex Sharov
0a09187492
Snapshots: more filename fixes ( #3583 )
2022-02-23 13:05:44 +07:00
Alex Sharov
81d51e1589
snapshots: better files sort and filter ( #3582 )
2022-02-23 10:54:35 +07:00
battlmonstr
e6c056e666
Rename Datadir/dataDir to follow conventions. ( #3576 )
...
* rename from Datadir to DataDir (functions and public vars)
* rename dataDir to datadir (local variables)
2022-02-22 17:39:48 +00:00
Giulio rebuffo
b49381821f
Fixed get-payload and Hanging ForkChoice ( #3575 )
...
* done
* removed sleep
* f
* errors.Is(err, io.EOF) instead of err == io.EOF
Co-authored-by: yperbasis <andrey.ashikhmin@gmail.com>
2022-02-22 14:47:23 +01:00
Alex Sharov
ab01d64916
fix close files error on win ( #3572 )
2022-02-22 16:24:33 +07:00
Alex Sharov
b08cb44353
embed rpcdaemon: enable it only by --http flag ( #3574 )
2022-02-22 16:23:54 +07:00
