Commit Graph

743 Commits

Author SHA1 Message Date
ledgerwatch
e40332bdd8
Simplify skeleton requests, limit bor spanCache, more fine grained locking in HeaderDownload (#4194)
* Simplify skeleton requests

* Limit bor cache size

* In the middle of changing lists

* Fix

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-05-18 17:16:37 +01:00
ledgerwatch
ec08a284a6
Reduce insertQueue usage, throttle Skeleton requests (#4185)
* Reduce insertQueue usage, throttle Skeleton requests

* Cleanup

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-17 19:31:17 +01:00
Håvard Anda Estensen
0a75065e7a
Use go:build lines and remove obsolete +build lines (#4175) 2022-05-17 14:46:53 +07:00
Alex Sharov
4e7807251a
Ensure snapshotDir not created by accident (#4164)
* save

* save

* save
2022-05-17 09:40:45 +07:00
leonardchinonso
3b87f8c726
Fix disabled value for --prune.* flags (#4165)
* Changes:
* Proceeded to check if other h, r, t or c flags for 'before' and 'older' are set before returning from the default state of --prune
Concern:
* Does the 'disabled' value for '--prune=' need to be updated if the '--prune.*' flags are set but the '--prune=' flag is not?

* Modify mode.Initialised only when it is changed

* Updated layout for --prune=*

* save

* save

Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2022-05-17 09:31:14 +07:00
Alex Sharov
e1dec529d4
Generic sort of slices (no allocs, inlinable) (#4161)
* save

* save

* save

* save

* save
2022-05-16 08:24:12 +01:00
ledgerwatch
24244a09c7
Fix interaction with beacon node (#4157)
* Fix interaction with beacon node

* Fix logging

* Fix logging and add comments

* Fix logging

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-15 23:32:38 +01:00
ledgerwatch
7125593cf5
Fix nil deference in ProcessHeadersPOS (#4155)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-05-15 17:09:27 +01:00
Enrique Jose Avila Asapche
a9ce803c67
No hack skip cycle (#4147)
* added check method to hd

* goroutine to check if we have headers

* added initial cycle to Ethereum object

* stage loop will only run ones

* got rid of anchor print

* header stage skip cycle message

* increased original time by a 2 seconds

* for inside of stageloop

* simplified

* little fixes

* got rid of skipCycle

* simplified

* hmm
2022-05-15 15:11:18 +01:00
ledgerwatch
0b6532fec1
Fix race condition in ProcessHeadersPOS (#4151)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-15 08:54:36 +01:00
ledgerwatch
e02c77bf5a
Further simplify header download, req/resp metrics (#4121)
* Further simplify header download, req/resp metrics

* Not break the loop

* Move anchors correctly

* Log anchor state

* Print minNum

* Print hash

* Always add links

* Remove obsolete test

* cleanup

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alex Sharp <alexsharp@alexs-macbook-pro.home>
2022-05-13 11:18:30 +01:00
Alex Sharov
91e43e52a6
Snapsync for ropsten (#4143)
* save

* save
2022-05-13 14:58:03 +07:00
Alex Sharov
4e0f3c8c4c
Sentry: batch events (#4140) 2022-05-13 11:00:44 +07:00
Alex Sharov
1b82acd7ff
it's ok to not have snapshots dir (#4135)
* save

* save

* save
2022-05-12 15:14:16 +07:00
Alex Sharov
763563ec77
RPCDaemon: open snapshots on startup (because now snapshots dir is atomic), even if no Erigon available (#4110)
* save

* save

* save

* save

* save

* save
2022-05-10 09:54:44 +01:00
ledgerwatch
8001cf2ad6
Simplify header downloader (#4104)
* Simplify header downloader

* Remove VerifyQueue

* Fix

* More fixes

* Fix

* Break out of the loop

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-10 08:06:16 +01:00
Alex Sharov
2c26583f6f
Rename sentry.ControlServerImpl to sentry.MultyClient and sentry.SentryServerImpl to sentry.GrpcServer #444 2022-05-10 12:17:44 +07:00
Alex Sharov
3e4fb5dd49
up linter version (#4108)
* save

* save

* save
2022-05-10 10:14:09 +07:00
Alex Sharov
4ba1f03efe
Snapshots: atomic dir, step 3 (#4103) 2022-05-10 09:29:44 +07:00
Alex Sharov
32d8ab34d9
atomic snapshot dir, step 2 (#4093)
* atomic snapshot dir

* atomic snapshot dir
2022-05-07 14:53:21 +07:00
ledgerwatch
ba987cf262
Remove preverified hashes (#4088)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-06 15:15:01 +01:00
ledgerwatch
77441916fd
Update header_algos.go (#4078) 2022-05-04 19:41:02 +01:00
Andrew Ashikhmin
4529cc308d
Small performance optimization (hash already calculated) (#4053) 2022-05-04 10:58:26 +02:00
Giulio rebuffo
6927ffc54b
penalize naughty peers on PoS (#4060)
* penalize naughty peers

* lint
2022-05-04 10:39:34 +02:00
ledgerwatch
f634314226
Update header_algos.go 2022-05-04 08:33:42 +01:00
ledgerwatch
7c2a7150bb
Reverse relaxation of header downloader (#4064)
* Undo headers relaxation change

* Undo headers relaxation change

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-05-04 07:46:52 +01:00
Alex Sharov
f590bf682f
RPCDaemon - open snapshots only when they are ready (and indices ready). 2022-05-04 12:55:58 +07:00
battlmonstr
c9a1c93b44
tests: split slow integration tests (#4048) 2022-05-04 10:35:59 +07:00
ledgerwatch
f297a28e6d
More relax inclusion of headers in the downloader (#4050)
* More relax inclusion of headers in the downloader

* Fix

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-03 12:05:54 +01:00
Giulio rebuffo
af5bdceb14
added ovveride merge fork block (#4027) 2022-04-29 18:27:17 +02:00
Andrew Ashikhmin
f9858ff9f2
Add override.terminaltotaldifficulty flag (#4018)
* cmd/utils: initialize f.Value before setting variable

* override.terminaltotaldifficulty flag

* Add OverrideTerminalTotalDifficulty to default_flags
2022-04-28 19:01:51 +02:00
Alex Sharov
eda385eb28
Handle system-txn in block_reader (#4012)
* reduce downloader deps

* reduce downloader deps

* save

* reduce downloader deps
2022-04-28 13:08:27 +07:00
Alex Sharov
2655d57288
reduce downloader deps (#4010)
* reduce downloader deps

* reduce downloader deps
2022-04-28 12:13:30 +07:00
Alex Sharov
8b8c442dc6
Open shorter logs #400 2022-04-28 10:11:07 +07:00
Alex Sharov
ea8a347ece
Downloader: calc stat inside, add --torrent.download.slots and limit downloads inside (#3986)
* save

* save

* save

* save

* save

* save

* save

* save

* save
2022-04-28 09:10:00 +07:00
Andrew Ashikhmin
6c9d515968
No NewBlock gossip after Merge (#3995) 2022-04-27 14:03:06 +02:00
Andrew Ashikhmin
4d2db4467e
FullSync instead of FastSync (#3980) 2022-04-26 17:19:24 +02:00
ledgerwatch
b5a2a62c05
Potential fix for verification (#3962)
* Potential fix for verification

* multi verify

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-04-26 15:36:48 +01:00
Alex Sharov
3906d7e51f
Snapshots: allow stage_headers --unwind behind available snapshots (#3971)
* save

* save

* save
2022-04-26 12:04:38 +07:00
ledgerwatch
538543ad17
Experiment files 1 by 1 (#3959)
* Experiment files 1 by 1

* Remove check

* sort preverified snapshots

* docs: docker permissions

* sort preverified snapshots

* sort preverified snapshots

* sort preverified snapshots

* sort preverified snapshots

* sort preverified snapshots

* sort preverified snapshots

* save

* Fix speed log, remove file name

* Move timer out of the loop

* Calculate total size of downloaded files

* Fixes

* Fix

* Fix

* Fix

* Move downloadData

* Fix

* Revert "Fix"

This reverts commit 038e02b8a4d23cd32ddb111e9f325fc4ce1bbe2b.

* Revert "Move downloadData"

This reverts commit 8130a4d9bdc0705082eb7fe94e2261c9313f8482.

* Revert "Fix"

This reverts commit 1dca25bd68772bc42ac710c24698c8670f9f6b86.

* Revert "Fix"

This reverts commit ee5a1e82abd47bef4f9d8f0f68b8497476d29c0b.

* Revert "Fix"

This reverts commit 8af7be71d4685e0d6115fef91ed2f304695e1df9.

* Revert "Fixes"

This reverts commit 50509af81f3721cca957cd15d0286e8f30e5097b.

* Revert "Calculate total size of downloaded files"

This reverts commit 64a26df54f6226d739c8a5b57b32ad5af07d3061.

* Remove progress

* Remove progress

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2022-04-25 19:32:27 +01:00
battlmonstr
07367c2312
sentry: refactor flags, add maxpeers. (#3961) 2022-04-25 21:47:25 +07:00
Alex Sharov
b4774a831e
Snapshots: support empty buf case (#3957) 2022-04-25 10:24:37 +07:00
battlmonstr
3ad25c929c
Sentry GRPC: rename Peers to PeerEvents (#3944)
* Sentry GRPC: rename Peers to PeerEvents

see https://github.com/ledgerwatch/interfaces/pull/101

* Update to erigon-lib main

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-23 17:52:22 +01:00
Håvard Anda Estensen
6844e74ad2
Replace ioutil with io and os (#3946) 2022-04-23 15:43:00 +01:00
Giulio rebuffo
c5b1836481
Added Ethstats service (#3931)
* somewhat there but not yet

* lol

* more efficient ethstats

* lint

* not die on no wifi
2022-04-22 07:23:52 +01:00
ledgerwatch
3ec9d270a2
Update flags.go (#3927) 2022-04-21 16:18:49 +01:00
Alex Sharov
58c86d550d
Snapshots: Max index parallelism to 4 (#3925)
* save

* save

* Readme update: built-in rpc daemon and syncmode=snap

* save

* save

* save
2022-04-21 17:49:42 +07:00
Alex Sharov
6aa4999729
Parallel indexing (#3921) 2022-04-21 10:34:10 +07:00
alex.sharov
25ab64558d save 2022-04-20 16:00:04 +07:00
ledgerwatch
5b9f973a56
Update preverified hashes (#3918)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-19 17:17:26 +01:00