Commit Graph

15670 Commits

Author SHA1 Message Date
Alex Sharov
f54628b7ba
remove metrics package, step 1 (#4094) 2022-05-07 14:52:04 +07:00
ledgerwatch
64684034d6
p2p: define DiscReason as uint8 (#4090)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-06 16:19:53 +01:00
ledgerwatch
ba987cf262
Remove preverified hashes (#4088)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-06 15:15:01 +01:00
ledgerwatch
3dc77e7d24
Revert changes in decompressor (#4089)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-06 15:14:19 +01:00
Alex Sharov
7f60171ae2
Revert "state_processor: fix ignored SkipAnalysis() result (#4046)" (#4087)
This reverts commit cf44803621.
2022-05-06 15:24:57 +07:00
Andrew Ashikhmin
f900dbadee
[Docs] Add PoS downloader diagram (#4084)
* Extra comment for HeadersPOS

* Add PoS downloader diagram
2022-05-06 09:55:31 +02:00
Alex Sharov
f480865a26
Downloader atomic snapshot dir, step 1 (#4085)
* save

* save

* save
2022-05-06 09:59:23 +07:00
battlmonstr
0fc99b7c55
rpcdaemon: optimize tests (#4082)
* reuse the generated test blockchain across tests
* copy ChainPack to ensure test isolation

This improves the speed from 10s to 4s.

The package tests timeout can be reduced to 5s:

    go test ./cmd/rpcdaemon/commands -count 1 --timeout 5s
2022-05-06 08:54:26 +07:00
battlmonstr
bc43a3f36a
CI: more caching (#4083)
Cache "go-build" containing cached build artifacts from the Go build system.
This saves up to:
  - 6 min on Linux (from 10 min to 4 min)
  - 3 min on macOS  (from 13 min to 10 min)
  - 7 min on Windows (from 27 min to 20 min)

Cache Windows deps (mingw, cmake).
This saves 6,5 min on Windows builds (from 20 min to 13,5 min)
2022-05-06 08:54:05 +07:00
ledgerwatch
14557a2348
[erigon2] Support for binary tree commitments (#4077)
* binary tree

* Binary commitment tree

* [erigon2] Bin tree support

* Point to latest erigon-lib

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-05 13:54:29 +01:00
battlmonstr
a0af7c0567
CI: run integration tests on Windows (#4076) 2022-05-05 15:59:54 +07:00
battlmonstr
a5683fe5f4
p2p: TestUDPv4_LookupIterator failures workaround (#4079)
--- FAIL: TestUDPv4_LookupIterator (1.36s)
155
    v4_lookup_test.go:168: handlePacket error: "unsolicited reply"
156
2022-05-05 13:27:31 +07:00
ledgerwatch
77441916fd
Update header_algos.go (#4078) 2022-05-04 19:41:02 +01:00
battlmonstr
7ee46ea2b5
CI: run integration tests on trunk after PR is merged (#4075)
Running on PR close event tests the PR commit, not the final merged commit.
The final commit is tested by "push" event, but it appears as "skipped" in the list of devel ccmmits,
because "push" event was skipped by "if".
2022-05-04 18:41:32 +02:00
Alex Sharov
152998721a
Torrent: increase network request size (#4067)
* save

* save
2022-05-04 18:18:35 +07:00
Alex Sharov
b71371633a
speedup logIndex test (#4068) 2022-05-04 18:17:15 +07:00
Andrew Ashikhmin
4529cc308d
Small performance optimization (hash already calculated) (#4053) 2022-05-04 10:58:26 +02:00
Giulio rebuffo
6927ffc54b
penalize naughty peers on PoS (#4060)
* penalize naughty peers

* lint
2022-05-04 10:39:34 +02:00
ledgerwatch
f634314226
Update header_algos.go 2022-05-04 08:33:42 +01:00
ledgerwatch
158a738ad0
Change dev version back to 2022.99.99-dev (#4065)
* Update version.go

* Fix lint

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-05-04 08:09:23 +01:00
ledgerwatch
7c2a7150bb
Reverse relaxation of header downloader (#4064)
* Undo headers relaxation change

* Undo headers relaxation change

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-05-04 07:46:52 +01:00
Alex Sharov
f590bf682f
RPCDaemon - open snapshots only when they are ready (and indices ready). 2022-05-04 12:55:58 +07:00
Alex Sharov
beafe7db65
Test that torrent port is open for TCP and UDP (#4062) 2022-05-04 10:58:58 +07:00
battlmonstr
c9a1c93b44
tests: split slow integration tests (#4048) 2022-05-04 10:35:59 +07:00
Alex Sharov
71b819bad1
fix nil-pointer download (#4061) 2022-05-04 09:46:36 +07:00
battlmonstr
a1d0ff3281
p2p: TestUDPv4_Lookup - unsolicited reply error (#4056)
The UDP test must be closed after the serveTestnet exits.
If it happens before, the serveTestnet encounters this error.
(it tries to emulate a packet receival after closing the transport)

FindNode triggers a Ping in ensureBond.
This causes an extra Sleep for "ping back".
Don't wait for this in tests.

Close v5 tests.

The requests may also timeout if a lot of them queue up in the udpTest.pipe,
and serveTestnet is slow to process them.
Increase replyTimeout a bit to prevent that.
2022-05-03 22:07:50 +01:00
ledgerwatch
18b51b1756
Increase max DB size to 8 Tb for chain data only (#4055)
* Update node.go

* Update node.go
2022-05-03 18:13:08 +01:00
ledgerwatch
4e683e1a34
Revert "Speed up docker image build by use layer cache (#4038)" (#4054)
This reverts commit e758fb800b.
2022-05-03 17:00:52 +01:00
ledgerwatch
f297a28e6d
More relax inclusion of headers in the downloader (#4050)
* More relax inclusion of headers in the downloader

* Fix

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-03 12:05:54 +01:00
ledgerwatch
1e5e8d69ce
Update skip_analysis.go (#4052) 2022-05-03 12:05:44 +01:00
battlmonstr
2e4947bbfb
p2p: improve test TestTable_findnodeByID (#4047)
* refactor test
* add a fast fixed examples test for the main suite
* split slow test for the integration suite
2022-05-03 08:32:54 +01:00
Groute
cf44803621
state_processor: fix ignored SkipAnalysis() result (#4046)
`cfg` is not a pointer
2022-05-02 18:56:49 +01:00
EXEC
e758fb800b
Speed up docker image build by use layer cache (#4038)
* speed up docker image build by use layer cache

* rearrenge Dockerfile

* enable docker layer cache in github action
2022-05-02 11:55:16 +07:00
ledgerwatch
f9d7cb5ca9
Cleanup isBor (#4045)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-01 11:25:42 +01:00
ledgerwatch
14cbc01683
Fix for Bor (Polygon) (#4044)
* print branchHash

* Print state changes

* Print val

* Fix for author

* Remove prints

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-01 08:44:47 +01:00
Alex Sharov
e68879810e
make sure stage_headers --reset doesn't left garbage in bodies table #4043 2022-05-01 11:38:35 +07:00
Alex Sharov
533970d31c
trace read parent header from snapshot and lru #4042 2022-05-01 10:35:30 +07:00
Alex Sharov
c896807bfe
index segments by maximum by 2 workers #4041 2022-05-01 09:35:18 +07:00
EXEC
47f492663e
eth/filters: Fix filterLogs() (#4036) 2022-04-30 15:46:40 +01:00
ledgerwatch
e0d7998eb0
Truncate bor receipts on unwind (#4033)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-30 15:46:08 +01:00
Alex Sharov
93ab7f5d82
save (#4032) 2022-04-30 11:43:07 +07:00
Alex Sharov
a13c5ba904
Fix non-starting download (#4031)
* save

* save

* save

* save
2022-04-30 11:42:36 +07:00
Giulio rebuffo
af5bdceb14
added ovveride merge fork block (#4027) 2022-04-29 18:27:17 +02:00
Alex Sharov
77560b6732
More careful handle of sequences in stage_headers --reset (#4023)
* save

* save

* save

* save
2022-04-29 14:37:02 +07:00
Alex Sharov
38e8706c91
Docker build: make db-tools to depend on git-submodules (#4024)
* save

* save

* save

* save

* save
2022-04-29 14:07:39 +07:00
ledgerwatch
285c782b1b
More efficient header verification of headers for Parlia when snapshots are used (#3998)
* Update stageloop.go

* Print

* Consider snapshot headers as parlia checkpoints

* Not fail after not loading snapshot

* Lazy snapshots

* Print number of validators

* More printing

* Use epoch instead of checkpoint interval

* Reduce logging

* Fix compilation

* Remove trace jump dest

* Fix lint

* Not store snapshots every epoch

* Separate snapshot for verification and finalisation

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-29 07:10:31 +01:00
Alex Sharov
6903587b11
Add link about rqspbery po (#4022) 2022-04-29 07:23:40 +07:00
battlmonstr
bc2e9e7b72
p2p: crawler-friendly handshake (#3982)
* exchange RLPx Hello even when maxpeers limit is reached
* bump MaxPendingPeers to increase the default handshake queue
  (and the likelyhood of Hello exchange)
2022-04-28 23:21:22 +01:00
gaia
7e07a3149a
Added Goerli Full Node Space Requirements (#4021) 2022-04-28 19:42:30 +01:00
battlmonstr
17fb707f80
p2p: fix flaky TestUDPv5_lookupE2E (#4020)
The test was flaky, because of the "endpoint prediction".
The test starts 5 nodes one by one.
Node 0 is used as a bootstrap node for nodes 1-4.
When it is about to add, say, node 3, nodes 0 and 1 might already have had a chance to communicate,
and updateEndpoints() deletes the node 0 UDP port, because fallbackUDP port was not configured.

In this case node 3 would get a bootstrap node 0 without a port and lead to an error:

    v5_udp_test.go:110: bad bootstrap node "enr:...": missing UDP port

The problem was reproducible by this command:

    go test ./p2p/discover -run TestUDPv5_lookupE2E -count 500
2022-04-29 01:19:47 +07:00