Commit Graph

15746 Commits

Author SHA1 Message Date
Alex Sharov
71b819bad1
fix nil-pointer download (#4061) 2022-05-04 09:46:36 +07:00
battlmonstr
a1d0ff3281
p2p: TestUDPv4_Lookup - unsolicited reply error (#4056)
The UDP test must be closed after the serveTestnet exits.
If it happens before, the serveTestnet encounters this error.
(it tries to emulate a packet receival after closing the transport)

FindNode triggers a Ping in ensureBond.
This causes an extra Sleep for "ping back".
Don't wait for this in tests.

Close v5 tests.

The requests may also timeout if a lot of them queue up in the udpTest.pipe,
and serveTestnet is slow to process them.
Increase replyTimeout a bit to prevent that.
2022-05-03 22:07:50 +01:00
ledgerwatch
18b51b1756
Increase max DB size to 8 Tb for chain data only (#4055)
* Update node.go

* Update node.go
2022-05-03 18:13:08 +01:00
ledgerwatch
4e683e1a34
Revert "Speed up docker image build by use layer cache (#4038)" (#4054)
This reverts commit e758fb800b.
2022-05-03 17:00:52 +01:00
ledgerwatch
f297a28e6d
More relax inclusion of headers in the downloader (#4050)
* More relax inclusion of headers in the downloader

* Fix

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-03 12:05:54 +01:00
ledgerwatch
1e5e8d69ce
Update skip_analysis.go (#4052) 2022-05-03 12:05:44 +01:00
battlmonstr
2e4947bbfb
p2p: improve test TestTable_findnodeByID (#4047)
* refactor test
* add a fast fixed examples test for the main suite
* split slow test for the integration suite
2022-05-03 08:32:54 +01:00
Groute
cf44803621
state_processor: fix ignored SkipAnalysis() result (#4046)
`cfg` is not a pointer
2022-05-02 18:56:49 +01:00
EXEC
e758fb800b
Speed up docker image build by use layer cache (#4038)
* speed up docker image build by use layer cache

* rearrenge Dockerfile

* enable docker layer cache in github action
2022-05-02 11:55:16 +07:00
ledgerwatch
f9d7cb5ca9
Cleanup isBor (#4045)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-01 11:25:42 +01:00
ledgerwatch
14cbc01683
Fix for Bor (Polygon) (#4044)
* print branchHash

* Print state changes

* Print val

* Fix for author

* Remove prints

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-01 08:44:47 +01:00
Alex Sharov
e68879810e
make sure stage_headers --reset doesn't left garbage in bodies table #4043 2022-05-01 11:38:35 +07:00
Alex Sharov
533970d31c
trace read parent header from snapshot and lru #4042 2022-05-01 10:35:30 +07:00
Alex Sharov
c896807bfe
index segments by maximum by 2 workers #4041 2022-05-01 09:35:18 +07:00
EXEC
47f492663e
eth/filters: Fix filterLogs() (#4036) 2022-04-30 15:46:40 +01:00
ledgerwatch
e0d7998eb0
Truncate bor receipts on unwind (#4033)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-30 15:46:08 +01:00
Alex Sharov
93ab7f5d82
save (#4032) 2022-04-30 11:43:07 +07:00
Alex Sharov
a13c5ba904
Fix non-starting download (#4031)
* save

* save

* save

* save
2022-04-30 11:42:36 +07:00
Giulio rebuffo
af5bdceb14
added ovveride merge fork block (#4027) 2022-04-29 18:27:17 +02:00
Alex Sharov
77560b6732
More careful handle of sequences in stage_headers --reset (#4023)
* save

* save

* save

* save
2022-04-29 14:37:02 +07:00
Alex Sharov
38e8706c91
Docker build: make db-tools to depend on git-submodules (#4024)
* save

* save

* save

* save

* save
2022-04-29 14:07:39 +07:00
ledgerwatch
285c782b1b
More efficient header verification of headers for Parlia when snapshots are used (#3998)
* Update stageloop.go

* Print

* Consider snapshot headers as parlia checkpoints

* Not fail after not loading snapshot

* Lazy snapshots

* Print number of validators

* More printing

* Use epoch instead of checkpoint interval

* Reduce logging

* Fix compilation

* Remove trace jump dest

* Fix lint

* Not store snapshots every epoch

* Separate snapshot for verification and finalisation

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-29 07:10:31 +01:00
Alex Sharov
6903587b11
Add link about rqspbery po (#4022) 2022-04-29 07:23:40 +07:00
battlmonstr
bc2e9e7b72
p2p: crawler-friendly handshake (#3982)
* exchange RLPx Hello even when maxpeers limit is reached
* bump MaxPendingPeers to increase the default handshake queue
  (and the likelyhood of Hello exchange)
2022-04-28 23:21:22 +01:00
gaia
7e07a3149a
Added Goerli Full Node Space Requirements (#4021) 2022-04-28 19:42:30 +01:00
battlmonstr
17fb707f80
p2p: fix flaky TestUDPv5_lookupE2E (#4020)
The test was flaky, because of the "endpoint prediction".
The test starts 5 nodes one by one.
Node 0 is used as a bootstrap node for nodes 1-4.
When it is about to add, say, node 3, nodes 0 and 1 might already have had a chance to communicate,
and updateEndpoints() deletes the node 0 UDP port, because fallbackUDP port was not configured.

In this case node 3 would get a bootstrap node 0 without a port and lead to an error:

    v5_udp_test.go:110: bad bootstrap node "enr:...": missing UDP port

The problem was reproducible by this command:

    go test ./p2p/discover -run TestUDPv5_lookupE2E -count 500
2022-04-29 01:19:47 +07:00
Andrew Ashikhmin
f9858ff9f2
Add override.terminaltotaldifficulty flag (#4018)
* cmd/utils: initialize f.Value before setting variable

* override.terminaltotaldifficulty flag

* Add OverrideTerminalTotalDifficulty to default_flags
2022-04-28 19:01:51 +02:00
battlmonstr
4b3eb0ffac
Observer: fix panic on clean start (#4002) (#4017)
Problem: (nil, nil) from CountPingErrors was not handled.
This happens if the node is not in the db (a bootstrap node),
and was never crawled before.
2022-04-28 12:46:33 +02:00
Alex Sharov
76c36c2c09
typed sender (#4016)
* save

* save
2022-04-28 15:35:14 +07:00
Alex Sharov
352869fc3a
rename field "type" (#4015)
* save

* save

* save
2022-04-28 15:02:06 +07:00
ledgerwatch
bd3b734027
[integration tool] Clean BorReceipt when reset state (#4013)
* Update reset_state.go

* Update reset_state.go
2022-04-28 14:59:04 +07:00
Alex Sharov
eda385eb28
Handle system-txn in block_reader (#4012)
* reduce downloader deps

* reduce downloader deps

* save

* reduce downloader deps
2022-04-28 13:08:27 +07:00
Alex Sharov
831da9ba41
reduce downloader deps (#4011) 2022-04-28 12:42:14 +07:00
Alex Sharov
2655d57288
reduce downloader deps (#4010)
* reduce downloader deps

* reduce downloader deps
2022-04-28 12:13:30 +07:00
Alex Sharov
43ddea2adf
Torrent: maxpeers flag were used incorrectly 2022-04-28 11:38:16 +07:00
Alex Sharov
53d7b6d8c2
Fix empty "Tables" log line (#4008)
* save

* save

* save
2022-04-28 10:46:41 +07:00
Alex Sharov
8b8c442dc6
Open shorter logs #400 2022-04-28 10:11:07 +07:00
Alex Sharov
d0ce0df1ab
Open only existing torrent files (#4007)
* save

* save

* save

* save

* save
2022-04-28 10:10:40 +07:00
Alex Sharov
d2ce562034
downloader stuck on 99.9% fix #4004 2022-04-28 09:28:44 +07:00
battlmonstr
c6649f584b
p2p: refactor MaxPendingPeers handling (#3981)
* use semaphore instead of a chan struct{}
* move MaxPendingPeers default value to DefaultConfig.P2P
* log Error if Accept fails
* replace quit channel with context
2022-04-28 09:21:52 +07:00
battlmonstr
7558730a54
p2p: speed-up TestUDPv4_LookupIterator (#4000)
The test was slow, because it was trying to find
predefined nodeIDs (lookupTestnet) by generating random keys
and trying to find their neighbours
until it hits all nodes of the lookupTestnet.
In addition each FindNode response was waited for 0.5 sec (respTimeout).
This could take up to 30 sec and fail the test suite.

A fake random key generator is now used during the test.
It issues the expected keys, and the lookup converges quickly.
The reply timeout is reduced for the test.
Now it normally takes less than.1 sec.
2022-04-28 09:18:42 +07:00
Alex Sharov
ea8a347ece
Downloader: calc stat inside, add --torrent.download.slots and limit downloads inside (#3986)
* save

* save

* save

* save

* save

* save

* save

* save

* save
2022-04-28 09:10:00 +07:00
ledgerwatch
7b24090408
Update skip_analysis.go (#4003) 2022-04-27 21:12:42 +01:00
ledgerwatch
ad4182ca36
Re-introduced cleanup of temporary table (#3999)
* Re-introduced cleanup of temporary table

* Fix sign

* Fix lint

* Fix lint

* Revert

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-04-27 19:11:15 +01:00
Andrew Ashikhmin
c9b26c23b3
Check that safe & finalized blocks are canonical for no-op forkChoice (#3997)
* Place finishHandlingForkChoice after startHandlingForkChoice

* forkChoiceMessage -> forkChoice

* Check that safe & finalized blocks are canonical for no-op forkChoice
2022-04-27 17:23:13 +02:00
Andrew Ashikhmin
6c9d515968
No NewBlock gossip after Merge (#3995) 2022-04-27 14:03:06 +02:00
Alex Sharov
8de3e8d0e9
TxLookup fix 2 (#3994)
* save

* save

* tolerate some fails

* tolerate some fails

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-27 12:37:08 +01:00
ledgerwatch
5ec90a13aa
Update to erigon-lib main (#3992)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-04-27 09:09:48 +01:00
Alex Sharov
b25cbb439c
save (#3983) 2022-04-27 07:06:12 +01:00
Alex Sharov
0a31835943
Update README.md (#3989) 2022-04-27 12:29:25 +07:00