Commit Graph

666 Commits

Author SHA1 Message Date
ledgerwatch
e6cb086c90
More header download diagnostics (#4224)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-21 14:49:08 +01:00
Alex Sharov
7ecdf51d92
methods to read single txn by txnID (#4215) 2022-05-20 14:12:12 +07:00
Alex Sharov
10bcbf4a68
Snap: faster Erigon re-start (#4201) 2022-05-19 12:28:33 +07:00
Alex Sharov
726ef081ce
option to disable runtime.ReadMemStats (#4200) 2022-05-19 11:48:07 +07:00
Alex Sharov
64508a7d4e
Snap: call AddHeadersFromSnapshot only at initialCycle (#4198) 2022-05-19 10:38:53 +07:00
Giulio rebuffo
56fcb19578
fixed slow sync (#4190) 2022-05-17 22:41:40 +02:00
ledgerwatch
ec08a284a6
Reduce insertQueue usage, throttle Skeleton requests (#4185)
* Reduce insertQueue usage, throttle Skeleton requests

* Cleanup

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-17 19:31:17 +01:00
Giulio rebuffo
80c562bdd3
0x00... hash resistant (#4186) 2022-05-17 20:01:20 +02:00
Alex Sharov
55a4fa75b4
HeadersPOS: to use snapshots (#4178) 2022-05-17 17:42:34 +07:00
Alex Sharov
e1dec529d4
Generic sort of slices (no allocs, inlinable) (#4161)
* save

* save

* save

* save

* save
2022-05-16 08:24:12 +01:00
ledgerwatch
24244a09c7
Fix interaction with beacon node (#4157)
* Fix interaction with beacon node

* Fix logging

* Fix logging and add comments

* Fix logging

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-15 23:32:38 +01:00
Enrique Jose Avila Asapche
a9ce803c67
No hack skip cycle (#4147)
* added check method to hd

* goroutine to check if we have headers

* added initial cycle to Ethereum object

* stage loop will only run ones

* got rid of anchor print

* header stage skip cycle message

* increased original time by a 2 seconds

* for inside of stageloop

* simplified

* little fixes

* got rid of skipCycle

* simplified

* hmm
2022-05-15 15:11:18 +01:00
ledgerwatch
0b6532fec1
Fix race condition in ProcessHeadersPOS (#4151)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-15 08:54:36 +01:00
ledgerwatch
e02c77bf5a
Further simplify header download, req/resp metrics (#4121)
* Further simplify header download, req/resp metrics

* Not break the loop

* Move anchors correctly

* Log anchor state

* Print minNum

* Print hash

* Always add links

* Remove obsolete test

* cleanup

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alex Sharp <alexsharp@alexs-macbook-pro.home>
2022-05-13 11:18:30 +01:00
Alex Sharov
de606406c9
Update README.md (#4132) 2022-05-12 11:50:29 +07:00
Alex Sharov
763563ec77
RPCDaemon: open snapshots on startup (because now snapshots dir is atomic), even if no Erigon available (#4110)
* save

* save

* save

* save

* save

* save
2022-05-10 09:54:44 +01:00
ledgerwatch
8001cf2ad6
Simplify header downloader (#4104)
* Simplify header downloader

* Remove VerifyQueue

* Fix

* More fixes

* Fix

* Break out of the loop

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-10 08:06:16 +01:00
Alex Sharov
3e4fb5dd49
up linter version (#4108)
* save

* save

* save
2022-05-10 10:14:09 +07:00
Alex Sharov
4ba1f03efe
Snapshots: atomic dir, step 3 (#4103) 2022-05-10 09:29:44 +07:00
Alex Sharov
54076c9bcf
Snapshots: restore logInterval #4098 2022-05-07 19:26:13 +07:00
Alex Sharov
32d8ab34d9
atomic snapshot dir, step 2 (#4093)
* atomic snapshot dir

* atomic snapshot dir
2022-05-07 14:53:21 +07:00
Alex Sharov
f54628b7ba
remove metrics package, step 1 (#4094) 2022-05-07 14:52:04 +07:00
Andrew Ashikhmin
f900dbadee
[Docs] Add PoS downloader diagram (#4084)
* Extra comment for HeadersPOS

* Add PoS downloader diagram
2022-05-06 09:55:31 +02:00
Alex Sharov
152998721a
Torrent: increase network request size (#4067)
* save

* save
2022-05-04 18:18:35 +07:00
Alex Sharov
b71371633a
speedup logIndex test (#4068) 2022-05-04 18:17:15 +07:00
Alex Sharov
f590bf682f
RPCDaemon - open snapshots only when they are ready (and indices ready). 2022-05-04 12:55:58 +07:00
Alex Sharov
71b819bad1
fix nil-pointer download (#4061) 2022-05-04 09:46:36 +07:00
ledgerwatch
f9d7cb5ca9
Cleanup isBor (#4045)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-01 11:25:42 +01:00
ledgerwatch
14cbc01683
Fix for Bor (Polygon) (#4044)
* print branchHash

* Print state changes

* Print val

* Fix for author

* Remove prints

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-01 08:44:47 +01:00
Alex Sharov
c896807bfe
index segments by maximum by 2 workers #4041 2022-05-01 09:35:18 +07:00
ledgerwatch
e0d7998eb0
Truncate bor receipts on unwind (#4033)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-30 15:46:08 +01:00
Alex Sharov
a13c5ba904
Fix non-starting download (#4031)
* save

* save

* save

* save
2022-04-30 11:42:36 +07:00
Alex Sharov
77560b6732
More careful handle of sequences in stage_headers --reset (#4023)
* save

* save

* save

* save
2022-04-29 14:37:02 +07:00
Alex Sharov
8b8c442dc6
Open shorter logs #400 2022-04-28 10:11:07 +07:00
Alex Sharov
ea8a347ece
Downloader: calc stat inside, add --torrent.download.slots and limit downloads inside (#3986)
* save

* save

* save

* save

* save

* save

* save

* save

* save
2022-04-28 09:10:00 +07:00
ledgerwatch
ad4182ca36
Re-introduced cleanup of temporary table (#3999)
* Re-introduced cleanup of temporary table

* Fix sign

* Fix lint

* Fix lint

* Revert

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-04-27 19:11:15 +01:00
Andrew Ashikhmin
c9b26c23b3
Check that safe & finalized blocks are canonical for no-op forkChoice (#3997)
* Place finishHandlingForkChoice after startHandlingForkChoice

* forkChoiceMessage -> forkChoice

* Check that safe & finalized blocks are canonical for no-op forkChoice
2022-04-27 17:23:13 +02:00
Alex Sharov
8de3e8d0e9
TxLookup fix 2 (#3994)
* save

* save

* tolerate some fails

* tolerate some fails

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-27 12:37:08 +01:00
Alex Sharov
b25cbb439c
save (#3983) 2022-04-27 07:06:12 +01:00
Andrew Ashikhmin
3e1d4fab10
Forgot to check err status (#3978)
* Forgot to check err status

* Invalid header shouldn't fail the entire stage
2022-04-26 15:17:54 +02:00
Alex Sharov
e04f7fc9f8
Integration: allow headers --reset (#3972) 2022-04-26 12:54:05 +07:00
ledgerwatch
9c2ea3d41b
Update stage_headers.go (#3966) 2022-04-26 08:26:44 +07:00
ledgerwatch
538543ad17
Experiment files 1 by 1 (#3959)
* Experiment files 1 by 1

* Remove check

* sort preverified snapshots

* docs: docker permissions

* sort preverified snapshots

* sort preverified snapshots

* sort preverified snapshots

* sort preverified snapshots

* sort preverified snapshots

* sort preverified snapshots

* save

* Fix speed log, remove file name

* Move timer out of the loop

* Calculate total size of downloaded files

* Fixes

* Fix

* Fix

* Fix

* Move downloadData

* Fix

* Revert "Fix"

This reverts commit 038e02b8a4d23cd32ddb111e9f325fc4ce1bbe2b.

* Revert "Move downloadData"

This reverts commit 8130a4d9bdc0705082eb7fe94e2261c9313f8482.

* Revert "Fix"

This reverts commit 1dca25bd68772bc42ac710c24698c8670f9f6b86.

* Revert "Fix"

This reverts commit ee5a1e82abd47bef4f9d8f0f68b8497476d29c0b.

* Revert "Fix"

This reverts commit 8af7be71d4685e0d6115fef91ed2f304695e1df9.

* Revert "Fixes"

This reverts commit 50509af81f3721cca957cd15d0286e8f30e5097b.

* Revert "Calculate total size of downloaded files"

This reverts commit 64a26df54f6226d739c8a5b57b32ad5af07d3061.

* Remove progress

* Remove progress

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2022-04-25 19:32:27 +01:00
Giulio rebuffo
5e1900cc48
cleaned up forkchoices db insertions #3949 2022-04-24 08:13:49 +07:00
Alex Sharov
62c377521b
Torrent conns print (#3943)
* save

* save
2022-04-22 18:24:21 +07:00
Alex Sharov
0d6775fd95
torrent: print peers amount in logs (#3942) 2022-04-22 17:37:35 +07:00
Giulio rebuffo
c5b1836481
Added Ethstats service (#3931)
* somewhat there but not yet

* lol

* more efficient ethstats

* lint

* not die on no wifi
2022-04-22 07:23:52 +01:00
Alex Sharov
58c86d550d
Snapshots: Max index parallelism to 4 (#3925)
* save

* save

* Readme update: built-in rpc daemon and syncmode=snap

* save

* save

* save
2022-04-21 17:49:42 +07:00
Alex Sharov
6aa4999729
Parallel indexing (#3921) 2022-04-21 10:34:10 +07:00
Alex Sharov
768e1204f6
integration: check that snapshots are nil #3906 2022-04-17 09:54:00 +07:00