mirror/erigon-pulse
1
0
Fork 0
mirror of https://gitlab.com/pulsechaincom/erigon-pulse.git synced 2025-01-18 00:28:46 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
16,151 Commits 5 Branches 14 Tags 295 MiB
d2389a1f26
Commit Graph

889 Commits

Author SHA1 Message Date
ledgerwatch
7132a90613
Add bor mainnet snapshot hashes (#4368) 
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-06-05 14:36:26 +05:30
Enrique Jose Avila Asapche
9f1cc40c89
changed syncmode flag to snapshots flag (#4353) 
* changed syncmode flag to snapshots flag

* using boolT

* Remove syncmode concept

* Add mumbai

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-06-05 07:33:55 +01:00
Alex Sharov
f838268e44
[wip] Snapshots: more runtime invariants check (#4350) 2022-06-03 18:50:01 +07:00
Enrique Jose Avila Asapche
49292346b3
Auto correcting sync mode instead of giving an error (#4337) 2022-06-03 09:38:10 +01:00
ledgerwatch
bcbb8bec65
Try to prevent double block retire (#4330) 
* Try to prevent double block retire

* Remove print

* More careful setting of segmentsMax

* Print snapshots max

* Clean lists

* Print

* Use Reopen

* Fix

* Remove prints

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-06-02 16:58:38 +01:00
Giulio rebuffo
f2be5a74a0
fixed it (#4336) 2022-06-02 15:54:11 +02:00
Enrique Jose Avila Asapche
bc21ab9d97
syncmode changes (#4334) 
* log syncmode

* little comment

* ops

* calling log in correct place

* got rid of error instead we warn

* no return
 2022-06-02 14:15:00 +01:00
ledgerwatch
b06b4b4c91
Prevent double retiring of the same interval, prevent hiding errors (#4325) 
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-06-02 08:49:24 +07:00
ledgerwatch
e0ac654da5
Better diagnostics for anchorQueue (#4326) 
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-06-01 23:45:06 +01:00
Giulio rebuffo
40230d5ab5
Refactor mining batch (#4322) 
* refactooor

* updated ethdb

* more fixing

* more fixing

* more

* refactoor

* fixed mdbx crash
 2022-06-01 22:48:42 +01:00
battlmonstr
0c5d1d64a3
observer: sentry candidates intake (#4321) 
* sentry client: log connected peer info

* observer: unseen sentry peers report

* observer: refactoring node.go to node_utils

* observer: sentry candidates intake
 2022-06-01 22:48:24 +01:00
Alex Sharov
e13e212288
rpc: add all blockReader methods (#4320) 
* save

* save
 2022-06-01 09:57:12 +07:00
Giulio rebuffo
576d736570
Added first prototype of mining mutation (#4266) 
* added first prototype of mining mutation

* tests and lint

* fixed some stuff

* more progress

* bug fixing

* more refactoring

* account only modifications are allowed

* Added account trie memory calculation

* SeekBothRange adjustments

* more on both range

* finished

* lint

* fix account tries

* fixes

* more fixes to storage tries

* more fixes

* just saving progress

* better version

* more progress

* done please

* lint
 2022-06-01 01:26:08 +02:00
ledgerwatch
cbc5729aa1
Fix and expand header downloader diagnostics (#4319) 
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-31 20:24:45 +01:00
ledgerwatch
0680671df9
Revert "Warn not error when body is missing (#4309)" (#4311) 
This reverts commit 85814cacc5.
 2022-05-30 18:31:47 +01:00
ledgerwatch
85814cacc5
Warn not error when body is missing (#4309) 
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-30 16:23:57 +01:00
Alex Sharov
955c669d21
Group few sync configs (#4303) 
* save

* save
 2022-05-30 17:08:49 +07:00
Alex Sharov
0795bcb865
integration: validate syncmode flag (#4300) 2022-05-30 09:59:38 +07:00
Alex Sharov
815119525a
reduce mem usage on building txs indices (#4299) 2022-05-30 09:33:48 +07:00
ledgerwatch
438c3933af
Fix invalidation of anchors (#4292) 
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-28 17:33:27 +01:00
Andrew Ashikhmin
0c76286509
Add rules to AsMessage to vet transaction types (#4276) 
* Add rules to AsMessage to vet transaction types

* Fix TestState
 2022-05-26 18:20:34 +02:00
Alex Sharov
6eb10ba9a8
Use ETL to fill kv.HeaderNumber from snapshots (#4272) 
* merge devel

* save
 2022-05-26 21:41:05 +07:00
leonardchinonso
3102a04d7f
Draft PR for the devnet automation (#4057) 
* Draft PR for the devnet automation

* Committing to save for later edit

* Finished creating shells, to test

* Changes:
* Added a shell for picking eth commands
* Implemented erigon node running with the --http flag to save processes
* Shell commands for get-balance and send-tx implemented
TODO:
* Make UX more friendly by adding start, stop and exit commands
* Add progress bar to show wait in progress
* Add flag or input to enable mining option for erigon node
* Implemented stress tests for other eth methods

* Experimenting

* little clean up

* lint

* Transitioned to static runs and tests from shell

* Finished stress test methods

* Rendering fixes

* save

* Cleanup

* Fixed lint

* Still fixing lint

* Removed args append ineffect

* Removed println in genesis init.go

* Removed println in genesis init.go

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Enrique Avila <eavilaasapche@gmail.com>
 2022-05-26 13:08:25 +01:00
Andrew Ashikhmin
86de64a2a3
TangerineWhistle instead of EIP150 & SpuriousDragon instead of EIP155/158 (#4273) 
* EIP150Block -> TangerineWhistleBlock

* Merge EIP158Block into EIP155Block

* EIP155Block -> SpuriousDragonBlock
 2022-05-26 12:08:59 +02:00
Alex Sharov
66248c4bfb
Torrent: verify all files (#4270) 2022-05-26 12:27:44 +07:00
battlmonstr
8a47a7ce33
sentry: PeerById method (#4260) 2022-05-26 10:53:23 +07:00
battlmonstr
6b1f91407d
sentry: multi sentry client refactoring (#4265) 2022-05-26 10:45:35 +07:00
Alex Sharov
fc1a37e6dc
create turbo/services pkg (#4269) 2022-05-26 10:31:06 +07:00
Enrique Jose Avila Asapche
124e004bd5
fixed stuck dev chain (#4261) 2022-05-25 19:49:26 +07:00
Alex Sharov
60ba14e2c7
bsc snap hashes to 17.5M #4249 2022-05-24 13:32:54 +07:00
Alex Sharov
52d6f1d551
kv_mdbx: atomic closed flag #464 (#4247) 2022-05-24 12:24:20 +07:00
Alex Sharov
31e94803dc
SnapshotIndex: Add more context to panic #4245 2022-05-24 11:00:55 +07:00
battlmonstr
2da927b74a
trie (#4236): skip TestIHCursor until it is fixed (#4237) 2022-05-23 13:01:04 +02:00
ledgerwatch
8ea2bb55d0
Prevent deletion of extra block worth of tx lookup records when pruning (#4232) 
* Print

* Prevent underflow, return 0 block if tx lookup failed

* Return nil receipt for 0 block

* Update to main erigon-lib

* Fix other places

* Fix other places

* Comment

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-22 20:35:02 +01:00
ledgerwatch
9dc7067e9c
Fix snapshot merge and anchor removal (#4228) 
* Print retire

* Print

* Print

* Print

* Print

* Not fail when block is not found

* Remove prints

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-22 11:08:03 +01:00
ledgerwatch
6974a98aca
Clean anchors, forward sort of headers (#4225) 
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-21 18:00:26 +01:00
ledgerwatch
e6cb086c90
More header download diagnostics (#4224) 
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-21 14:49:08 +01:00
ledgerwatch
803bfff67e
Clean headers pointers when removing links (#4222) 
* Clean headers pointers when removing links

* Replace the lock

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-21 08:59:30 +01:00
Giulio rebuffo
ea01c8e5b3
fixed kiln bug (#4221) 2022-05-21 10:33:00 +07:00
Alex Sharov
b1b5a319e1
It's safe now to open snapshots at app start (#4216) 2022-05-20 14:46:04 +07:00
Alex Sharov
7ecdf51d92
methods to read single txn by txnID (#4215) 2022-05-20 14:12:12 +07:00
Alex Sharov
ada46b0344
allow snap sync for mumbai chain (#4208) 
* save

* mumbai
 2022-05-19 19:31:02 +07:00
Alex Sharov
d9ed307807
allow --syncmode=snap for bor-mainnnet #4206 2022-05-19 18:54:50 +07:00
Alex Sharov
a95d86a99f
allow --syncmode=snap for bor-mainnnet (#4206) 
* save

* save
 2022-05-19 18:51:05 +07:00
Alex Sharov
726ef081ce
option to disable runtime.ReadMemStats (#4200) 2022-05-19 11:48:07 +07:00
Alex Sharov
64508a7d4e
Snap: call AddHeadersFromSnapshot only at initialCycle (#4198) 2022-05-19 10:38:53 +07:00
ledgerwatch
e40332bdd8
Simplify skeleton requests, limit bor spanCache, more fine grained locking in HeaderDownload (#4194) 
* Simplify skeleton requests

* Limit bor cache size

* In the middle of changing lists

* Fix

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
 2022-05-18 17:16:37 +01:00
ledgerwatch
ec08a284a6
Reduce insertQueue usage, throttle Skeleton requests (#4185) 
* Reduce insertQueue usage, throttle Skeleton requests

* Cleanup

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-17 19:31:17 +01:00
Håvard Anda Estensen
0a75065e7a
Use go:build lines and remove obsolete +build lines (#4175) 2022-05-17 14:46:53 +07:00
Alex Sharov
4e7807251a
Ensure snapshotDir not created by accident (#4164) 
* save

* save

* save
 2022-05-17 09:40:45 +07:00
leonardchinonso
3b87f8c726
Fix disabled value for --prune.* flags (#4165) 
* Changes:
* Proceeded to check if other h, r, t or c flags for 'before' and 'older' are set before returning from the default state of --prune
Concern:
* Does the 'disabled' value for '--prune=' need to be updated if the '--prune.*' flags are set but the '--prune=' flag is not?

* Modify mode.Initialised only when it is changed

* Updated layout for --prune=*

* save

* save

Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
 2022-05-17 09:31:14 +07:00
Alex Sharov
e1dec529d4
Generic sort of slices (no allocs, inlinable) (#4161) 
* save

* save

* save

* save

* save
 2022-05-16 08:24:12 +01:00
ledgerwatch
24244a09c7
Fix interaction with beacon node (#4157) 
* Fix interaction with beacon node

* Fix logging

* Fix logging and add comments

* Fix logging

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-15 23:32:38 +01:00
ledgerwatch
7125593cf5
Fix nil deference in ProcessHeadersPOS (#4155) 
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
 2022-05-15 17:09:27 +01:00
Enrique Jose Avila Asapche
a9ce803c67
No hack skip cycle (#4147) 
* added check method to hd

* goroutine to check if we have headers

* added initial cycle to Ethereum object

* stage loop will only run ones

* got rid of anchor print

* header stage skip cycle message

* increased original time by a 2 seconds

* for inside of stageloop

* simplified

* little fixes

* got rid of skipCycle

* simplified

* hmm
 2022-05-15 15:11:18 +01:00
ledgerwatch
0b6532fec1
Fix race condition in ProcessHeadersPOS (#4151) 
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-15 08:54:36 +01:00
ledgerwatch
e02c77bf5a
Further simplify header download, req/resp metrics (#4121) 
* Further simplify header download, req/resp metrics

* Not break the loop

* Move anchors correctly

* Log anchor state

* Print minNum

* Print hash

* Always add links

* Remove obsolete test

* cleanup

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alex Sharp <alexsharp@alexs-macbook-pro.home>
 2022-05-13 11:18:30 +01:00
Alex Sharov
91e43e52a6
Snapsync for ropsten (#4143) 
* save

* save
 2022-05-13 14:58:03 +07:00
Alex Sharov
4e0f3c8c4c
Sentry: batch events (#4140) 2022-05-13 11:00:44 +07:00
Alex Sharov
1b82acd7ff
it's ok to not have snapshots dir (#4135) 
* save

* save

* save
 2022-05-12 15:14:16 +07:00
Alex Sharov
763563ec77
RPCDaemon: open snapshots on startup (because now snapshots dir is atomic), even if no Erigon available (#4110) 
* save

* save

* save

* save

* save

* save
 2022-05-10 09:54:44 +01:00
ledgerwatch
8001cf2ad6
Simplify header downloader (#4104) 
* Simplify header downloader

* Remove VerifyQueue

* Fix

* More fixes

* Fix

* Break out of the loop

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-10 08:06:16 +01:00
Alex Sharov
2c26583f6f
Rename sentry.ControlServerImpl to sentry.MultyClient and sentry.SentryServerImpl to sentry.GrpcServer #444 2022-05-10 12:17:44 +07:00
Alex Sharov
3e4fb5dd49
up linter version (#4108) 
* save

* save

* save
 2022-05-10 10:14:09 +07:00
Alex Sharov
4ba1f03efe
Snapshots: atomic dir, step 3 (#4103) 2022-05-10 09:29:44 +07:00
Alex Sharov
32d8ab34d9
atomic snapshot dir, step 2 (#4093) 
* atomic snapshot dir

* atomic snapshot dir
 2022-05-07 14:53:21 +07:00
ledgerwatch
ba987cf262
Remove preverified hashes (#4088) 
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-06 15:15:01 +01:00
ledgerwatch
77441916fd
Update header_algos.go (#4078) 2022-05-04 19:41:02 +01:00
Andrew Ashikhmin
4529cc308d
Small performance optimization (hash already calculated) (#4053) 2022-05-04 10:58:26 +02:00
Giulio rebuffo
6927ffc54b
penalize naughty peers on PoS (#4060) 
* penalize naughty peers

* lint
 2022-05-04 10:39:34 +02:00
ledgerwatch
f634314226
Update header_algos.go 2022-05-04 08:33:42 +01:00
ledgerwatch
7c2a7150bb
Reverse relaxation of header downloader (#4064) 
* Undo headers relaxation change

* Undo headers relaxation change

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
 2022-05-04 07:46:52 +01:00
Alex Sharov
f590bf682f
RPCDaemon - open snapshots only when they are ready (and indices ready). 2022-05-04 12:55:58 +07:00
battlmonstr
c9a1c93b44
tests: split slow integration tests (#4048) 2022-05-04 10:35:59 +07:00
ledgerwatch
f297a28e6d
More relax inclusion of headers in the downloader (#4050) 
* More relax inclusion of headers in the downloader

* Fix

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-05-03 12:05:54 +01:00
Giulio rebuffo
af5bdceb14
added ovveride merge fork block (#4027) 2022-04-29 18:27:17 +02:00
Andrew Ashikhmin
f9858ff9f2
Add override.terminaltotaldifficulty flag (#4018) 
* cmd/utils: initialize f.Value before setting variable

* override.terminaltotaldifficulty flag

* Add OverrideTerminalTotalDifficulty to default_flags
 2022-04-28 19:01:51 +02:00
Alex Sharov
eda385eb28
Handle system-txn in block_reader (#4012) 
* reduce downloader deps

* reduce downloader deps

* save

* reduce downloader deps
 2022-04-28 13:08:27 +07:00
Alex Sharov
2655d57288
reduce downloader deps (#4010) 
* reduce downloader deps

* reduce downloader deps
 2022-04-28 12:13:30 +07:00
Alex Sharov
8b8c442dc6
Open shorter logs #400 2022-04-28 10:11:07 +07:00
Alex Sharov
ea8a347ece
Downloader: calc stat inside, add --torrent.download.slots and limit downloads inside (#3986) 
* save

* save

* save

* save

* save

* save

* save

* save

* save
 2022-04-28 09:10:00 +07:00
Andrew Ashikhmin
6c9d515968
No NewBlock gossip after Merge (#3995) 2022-04-27 14:03:06 +02:00
Andrew Ashikhmin
4d2db4467e
FullSync instead of FastSync (#3980) 2022-04-26 17:19:24 +02:00
ledgerwatch
b5a2a62c05
Potential fix for verification (#3962) 
* Potential fix for verification

* multi verify

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
 2022-04-26 15:36:48 +01:00
Alex Sharov
3906d7e51f
Snapshots: allow stage_headers --unwind behind available snapshots (#3971) 
* save

* save

* save
 2022-04-26 12:04:38 +07:00
ledgerwatch
538543ad17
Experiment files 1 by 1 (#3959) 
* Experiment files 1 by 1

* Remove check

* sort preverified snapshots

* docs: docker permissions

* sort preverified snapshots

* sort preverified snapshots

* sort preverified snapshots

* sort preverified snapshots

* sort preverified snapshots

* sort preverified snapshots

* save

* Fix speed log, remove file name

* Move timer out of the loop

* Calculate total size of downloaded files

* Fixes

* Fix

* Fix

* Fix

* Move downloadData

* Fix

* Revert "Fix"

This reverts commit 038e02b8a4d23cd32ddb111e9f325fc4ce1bbe2b.

* Revert "Move downloadData"

This reverts commit 8130a4d9bdc0705082eb7fe94e2261c9313f8482.

* Revert "Fix"

This reverts commit 1dca25bd68772bc42ac710c24698c8670f9f6b86.

* Revert "Fix"

This reverts commit ee5a1e82abd47bef4f9d8f0f68b8497476d29c0b.

* Revert "Fix"

This reverts commit 8af7be71d4685e0d6115fef91ed2f304695e1df9.

* Revert "Fixes"

This reverts commit 50509af81f3721cca957cd15d0286e8f30e5097b.

* Revert "Calculate total size of downloaded files"

This reverts commit 64a26df54f6226d739c8a5b57b32ad5af07d3061.

* Remove progress

* Remove progress

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
 2022-04-25 19:32:27 +01:00
battlmonstr
07367c2312
sentry: refactor flags, add maxpeers. (#3961) 2022-04-25 21:47:25 +07:00
Alex Sharov
b4774a831e
Snapshots: support empty buf case (#3957) 2022-04-25 10:24:37 +07:00
battlmonstr
3ad25c929c
Sentry GRPC: rename Peers to PeerEvents (#3944) 
* Sentry GRPC: rename Peers to PeerEvents

see https://github.com/ledgerwatch/interfaces/pull/101

* Update to erigon-lib main

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-04-23 17:52:22 +01:00
Håvard Anda Estensen
6844e74ad2
Replace ioutil with io and os (#3946) 2022-04-23 15:43:00 +01:00
Giulio rebuffo
c5b1836481
Added Ethstats service (#3931) 
* somewhat there but not yet

* lol

* more efficient ethstats

* lint

* not die on no wifi
 2022-04-22 07:23:52 +01:00
ledgerwatch
3ec9d270a2
Update flags.go (#3927) 2022-04-21 16:18:49 +01:00
Alex Sharov
58c86d550d
Snapshots: Max index parallelism to 4 (#3925) 
* save

* save

* Readme update: built-in rpc daemon and syncmode=snap

* save

* save

* save
 2022-04-21 17:49:42 +07:00
Alex Sharov
6aa4999729
Parallel indexing (#3921) 2022-04-21 10:34:10 +07:00
alex.sharov
25ab64558d save 2022-04-20 16:00:04 +07:00
ledgerwatch
5b9f973a56
Update preverified hashes (#3918) 
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-04-19 17:17:26 +01:00
alex.sharov
cbd1116cf3 save 2022-04-19 17:40:09 +07:00
Alex Sharov
8d81c3b0f8
Rwdir fix2 (#3915) 2022-04-19 08:55:46 +07:00
ledgerwatch
7080c6fab9
Fix help and README.md about pruning options (#3914) 
* Update README.md

* Update flags.go

* Update README.md
 2022-04-18 21:50:21 +01:00
ledgerwatch
748f70e7be
Fixes in header downloader (#3913) 
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-04-18 18:01:20 +01:00
Alex Sharov
e1d7cc3d3f
Enable: syncmode=snap by default (goerli, mainnet, bsc) (#3910) 2022-04-18 14:40:40 +07:00
alex.sharov
d10d194984 save 2022-04-18 11:27:36 +07:00
Alex Sharov
9305efeaa7
Snapshots: use kv.ReadAhead helper (#3909) 2022-04-18 10:48:09 +07:00
ledgerwatch
b45707ca06
Update header_algos.go (#3907) 2022-04-17 07:45:56 +01:00
Alex Sharov
4419c23866
Compress: reduce maxlen to 512 (#3891) 2022-04-17 07:59:38 +07:00
ledgerwatch
ba689258fa
Update header_algos.go (#3900) 2022-04-16 14:48:45 +01:00
Alex Sharov
777412e0bb
Snapshots: notify before remove (#3885) 
* goerli

* goerli
 2022-04-14 14:56:08 +07:00
alex.sharov
d439b76a1f goerli 2022-04-14 11:12:15 +07:00
ledgerwatch
78a58047dc
Fix in recompression (#3884) 
* Fix in recompression

* Fix error handling

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-04-14 11:07:17 +07:00
ledgerwatch
156da607e7
More compact representation of huffman trees in the seg files (#3875) 
* More compact representation of huffman trees in the seg files

* Update to latest erigon-lib

* recompress

* recompress

* recompress

* uncompress: buf fix

* Update to latest erigon-lib

* Revert default sync mode

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
 2022-04-13 16:29:44 +01:00
alex.sharov
482e06ead3 uncompress: buf fix 2022-04-13 16:35:21 +07:00
alex.sharov
594477ab23 uncompress: buf fix 2022-04-13 12:45:22 +07:00
Andrew Ashikhmin
b41fe19ecb
Memorize bad PoS headers (#3879) 
* Memorize bad PoS headers

* More places to ReportBadHeaderPoS
 2022-04-12 17:05:23 +02:00
alex.sharov
6cbbfb46eb recompress 2022-04-12 14:53:21 +07:00
Alex Sharov
0842e2bd12
RetireBlocks: preserve genesis (#3869) 
* save

* save

* save
 2022-04-11 13:16:45 +07:00
Alex Sharov
54ec6df6e1
ErigonLib: move types to own package (#3865) 2022-04-11 10:05:07 +07:00
ledgerwatch
f56d4c5881
Switch peerId from 256 to 512 bit (as in stable) (#3862) 
* Switch peerId from 256 to 512 bit (as in stable)

* go mod tidy

* Fix some tests

* Fixed

* Fixes

* Fix tests

* Update to erigon-lib main

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-04-10 08:01:25 +01:00
Alex Sharov
9b47daee44
Default syncmode=snap for Mainnet, Bsc, Goerli (#3861) 
* change syncmode default to snap sync

* save
 2022-04-10 07:20:20 +01:00
Alex Sharov
b6334870e8
Snapshots: recompress.sh (#3845) 
* save

* save
 2022-04-07 13:26:14 +07:00
Alex Sharov
7d86283910
Sapshots: idx merge (#3841) 
* return err on interruption

* save

* save

* save

* save

* save

* save

* save

* save

* save
 2022-04-07 11:27:57 +07:00
Alex Sharov
bc368098c8
Torrent: more cli params (#3838) 2022-04-06 21:06:58 +07:00
alex.sharov
5c5bcfe0fe bsc snapshot 2022-04-06 15:44:12 +07:00
alex.sharov
d223580d10 goerli snapshot 2022-04-06 09:49:58 +07:00
ledgerwatch
d604b5e107
Update preverified hashes and skip analysis (#3831) 
* Update skip_analysis

* Preverified hashes

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-04-05 21:49:45 +01:00
Alex Sharov
80bd44fce5
Snapsthos: build indices on retire blocks (#3823) 
* grpc up

* grpc up

* grpc up
 2022-04-05 16:22:11 +07:00
Alex Sharov
4cdc38ca58
reopen after merge (#3822) 2022-04-05 09:18:39 +07:00
TBC Dev
23e1bc9771
Fix block hash announces (#3819) 2022-04-05 08:06:12 +07:00
TBC Dev
057298f71b
Fix broken Goerli sync (#3817) 
Previous preverified hashes were not from Goerli
 2022-04-05 08:05:28 +07:00
alex.sharov
4fb2a14756 add readahead to segment uncompress pipe 2022-04-04 21:07:02 +07:00
Giulio rebuffo
1b0d7c80bf
Better batches for Execution (Hashmaps based instead of BTree based) (#3814) 2022-04-04 14:11:59 +07:00
alex.sharov
32467007c1 snapshots: auto fix 2022-04-02 13:28:18 +07:00
alex.sharov
38ad751fa0 goerli snapshot 2022-04-02 11:26:39 +07:00
Alex Sharov
68153ff6e6
Relax segments expectation (#3812) 
* skip empty seg

* skip empty seg

* skip empty seg
 2022-04-02 10:47:01 +07:00
Alex Sharov
d1218181b0
Snapshots: geth compatibility, use --syncmode=snap flag (#3808) 2022-04-01 15:00:50 +07:00
Alex Sharov
8b03582558
compressor: log lvl #408 
* save

* save
 2022-04-01 10:44:30 +07:00
Andrew Ashikhmin
6ff6c39d13
Prefer forkchoice head as latest block in RPC (#3806) 
* LastForkchoice accessors

* Update erigon-lib

* Prefer forkchoice head as latest block in RPC

* Fix typo
 2022-04-01 08:33:50 +07:00
Alex Sharov
804f322e91
fix nil pointer in fetch.go (#3801) 
* fix nil pointer in fetch.go

* fix nil pointer in fetch.go
 2022-03-31 15:13:20 +07:00
Alex Sharov
328c7b28a6
compress uncompress cli methods (#3798) 2022-03-31 14:10:40 +07:00
alex.sharov
4519e10e39 save 2022-03-31 09:44:12 +07:00
Alex Sharov
84cff259b5
snapshots: prune txlookup (#3794) 2022-03-30 11:50:16 +07:00
Andrew Ashikhmin
816ad30eff
Small Merge-related clarifications & improvements (#3785) 
* Hd.Fetching -> FetchingNew

* ReadHeadHeaderHash makes more sense in verifyAndSaveNewPoSHeader

* Potentially more correct LatestValidHash in case of payload with invalid transactions
 2022-03-29 11:47:07 +02:00
ledgerwatch
eb07ad89dd
Update Skip analysis and preverified hashes (#3777) 
* Update skip analysis

* Add preverified hashes for mainnet and ropsten

* preverified hashes and bootnode for sepolia

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
 2022-03-27 09:42:33 +01:00
Alex Sharov
89d4477df3
Snapshots: nil indices on p2p fix (#3772) 2022-03-27 10:07:58 +07:00
Giulio rebuffo
6a345847d8
[Critical] POS Panda Banner Added (#3758) 
* pandaaa

* better
 2022-03-24 07:35:58 +00:00
Alex Sharov
e0dfb8fb22
Snapshots: handle well gaps in idx files (#3762) 
* handle well gaps in idx files

* handle well gaps in idx files
 2022-03-24 14:19:14 +07:00
Alex Sharov
a357421719
Snapshots: notify rpcdaemon about new snapshot (#3755) 2022-03-24 09:25:38 +07:00
Giulio rebuffo
f4bf94f78a
Fixed Erigon README for Authentication API and jwt.hex generates in Datadir (#3757) 
* added datadir jwt

* fixed readme
 2022-03-24 09:10:29 +07:00
Andrew Ashikhmin
74a7d7c75a
Refactor PoS downloader (#3717) 
* Remove blockHeight arg from FeedHeaderPoW

* Revert "Remove blockHeight arg from FeedHeaderPoW"

This reverts commit 9bf92921db11cd4e13386fcee29f30241d070fc6.

* Move PayloadMessage & ForkChoiceMessage to package engineapi

* RequestList instead of newPayloadCh & forkChoiceCh

* Introduce request status

* Send reply only when request status is New

* Move BeaconRequestList to HeaderDownload

* Don't SetFetching when PoS (Fetching means handling newBlockHashes)

* Merge Syncing & Synced into DataWasMissing

* Introduce SyncStatus

* onlyNew arg in WaitForRequest

* Move waitingForBeaconChain into RequestList

* Interrupt instead of skipCycleHack

* Introduce timeout for PoS headers

* Split downloadMissingPoSHeaders

* Move StartPoSDownloader into HeaderDownload

* Move Stopping interrupt to StartPoSDownloader

* Move stopping PayloadStatus back to HeadersPOS

* cleanUpPoSDownload

* Post-merge fix

* TestBogusForkchoice

* TestPoSDownloader

* requestStatus in attemptPoSDownload

* Broadcast in SetStatus

* Cosmetics

* attemptPoSDownload -> schedulePoSDownload

* Demote some logs to Trace
 2022-03-22 17:49:12 +01:00
Alex Sharov
36b9cc2982
Snapshots: initial sync fix (#3750) 2022-03-22 10:33:15 +07:00
Alex Sharov
4cf4c1bac1
Snapshots: better support of p2p (#3749) 2022-03-21 20:36:03 +07:00