Commit Graph

12977 Commits

Author SHA1 Message Date
Alex Sharov
79815e4298
include_lmdb_stat_tool (#1206) 2020-10-08 08:11:36 +01:00
Alex Sharov
9ff9a1a486
a (#1205) 2020-10-08 11:34:28 +07:00
ledgerwatch
4b5a333583
Revert the context unbundling change (#1203) 2020-10-07 22:53:04 +01:00
ledgerwatch
d912c9929e
No prefetch on remote cursors in RPC daemon (#1201) 2020-10-07 21:50:03 +01:00
ledgerwatch
1af6cbe37b
Revert "Download/seed headers and block bodies via BitTorrent (#1195)" (#1202)
This reverts commit 94360212cb.
2020-10-07 21:49:44 +01:00
ledgerwatch
d7c570ccbe
Prevent block_fetcher from accessing the database (#1200) 2020-10-07 18:58:09 +01:00
ledgerwatch
94360212cb
Download/seed headers and block bodies via BitTorrent (#1195)
* save state

* torrent experiments

* torrent experiment passed

* fixes after merge

* snapshot headers processing passed

* save state

* save state

* download headers works after snapshot processing

* save state

* save state

* save state

* save state

* add lazy load tx to snapshots, increase number of trackers

* save state

* speedup getting info

* change logging

* move to turbo package

* save state

* save state

* save state

* cleanup

* save state

* add test test

* save state

* lmdb debugging

* fix readonly mode

* save state

* fix build

* sync works

* save state

* save state

* save state

* allow cmd stages stageSenders use snapshots

* debugging failed hashing

* remove experimental tests

* remove torrent experimental tests

* fix lint

* extract snapshot wrapper

* metainfo checker

* add remote seeder

* add logs

* update gomod

* remove useless code

* fix lint&remove useless code

* extract verify snapshot to separated command

* skip debug test

* fix test

* change type of seedSnapshot flag

* add eth logger to torrent lib

* skip debug test

* add Close method

* review fixes

* fix lint

Co-authored-by: b00ris <b00ris@mail.ru>
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2020-10-07 13:15:49 +01:00
Alex Sharov
3d0b6e9f85
save progress (#1199) 2020-10-07 18:23:51 +07:00
Alex Sharov
09d0020669
build docker on ci (#1198)
* build docker on ci

* setup docker

* build docker on ci
2020-10-07 11:12:10 +01:00
Thomas Jay Rush
7bd7075984
Replacing auto generated assets.go (#1197) 2020-10-07 08:48:21 +01:00
ledgerwatch
bdb0155856
Revert "Add sync by bittorrent snapshots (#1160)" (#1194)
This reverts commit 4ebade3583.
2020-10-06 22:31:57 +01:00
ledgerwatch
70ebf59642
Context cleanup and make context independent (#1193) 2020-10-06 22:07:57 +01:00
ledgerwatch
834eaedc00
pass_root_ctx_to_p2p_server (#1192)
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2020-10-06 20:25:01 +01:00
b00ris
4ebade3583
Add sync by bittorrent snapshots (#1160)
* save state

* torrent experiments

* torrent experiment passed

* fixes after merge

* snapshot headers processing passed

* save state

* save state

* download headers works after snapshot processing

* save state

* save state

* save state

* save state

* add lazy load tx to snapshots, increase number of trackers

* save state

* speedup getting info

* change logging

* move to turbo package

* save state

* save state

* save state

* cleanup

* save state

* add test test

* save state

* lmdb debugging

* fix readonly mode

* save state

* fix build

* sync works

* save state

* save state

* save state

* allow cmd stages stageSenders use snapshots

* debugging failed hashing

* remove experimental tests

* remove torrent experimental tests

* fix lint

* extract snapshot wrapper

* metainfo checker

* add remote seeder

* add logs

* update gomod

* remove useless code

* fix lint&remove useless code

* extract verify snapshot to separated command

* skip debug test

* fix test

* change type of seedSnapshot flag

* add eth logger to torrent lib

* skip debug test

* add Close method

* review fixes

* fix lint

Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
Co-authored-by: Alexey Akhunov <akhounov@gmail.com>
2020-10-06 20:24:48 +01:00
Giulio rebuffo
9cb944f056
added entries about rpcdaemon methods (#1187) 2020-10-06 17:14:22 +01:00
Alexey Akhunov
eb5e01ff5d Do not cancel context when closing remote cursor 2020-10-06 17:11:30 +01:00
Igor Mandrigin
70f6ec3b49 post-rebase fixes 2020-10-06 14:12:09 +02:00
Péter Szilágyi
b706d20f85 params: release Geth v1.9.22
# Conflicts:
#	params/version.go
2020-10-06 14:12:09 +02:00
rene
8a12d561f2 cmd/devp2p: add eth protocol test suite (#21598)
This change adds a test framework for the "eth" protocol and some basic
tests. The tests can be run using the './devp2p rlpx eth-test' command.
# Conflicts:
#	core/forkid/forkid.go
#	eth/discovery.go
#	eth/handler.go
#	eth/helper_test.go
#	eth/protocol_test.go
2020-10-06 14:12:09 +02:00
Péter Szilágyi
3ff949b7d0 params: update CHTs for Geth v1.9.22 2020-10-06 14:12:09 +02:00
rene
422e45e89c cmd/devp2p/internal/ethtest: lower protocol version to 64 (#21604)
# Conflicts:
#	cmd/devp2p/internal/ethtest/suite.go
2020-10-06 14:12:09 +02:00
rene
538aa40b5f cmd/devp2p/internal/ethtest: update version in handshake (#21603)
# Conflicts:
#	cmd/devp2p/internal/ethtest/suite.go
2020-10-06 14:12:09 +02:00
Marius van der Wijden
1f5d30dfb1 internal/ethapi: fix nil deref + fix estimateGas console bindings (#21601)
* tried to fix

* fix for js api

* fix for nil pointer ex

* rev space

* rev space

* input call formatter
2020-10-06 14:12:09 +02:00
gary rong
f4abf1d559 trie: extend range proof (#21250)
* trie: support non-existent right proof

* trie: improve test

* trie: minor linter fix

Co-authored-by: Péter Szilágyi <peterke@gmail.com>
# Conflicts:
#	trie/proof.go
#	trie/proof_test.go
2020-10-06 14:12:09 +02:00
Marius van der Wijden
08e006298d internal/ethapi: add optional parameter blockNrOrHash to estimateGas (#21545)
This allows users to estimate gas on top of arbitrary blocks as well as pending and latest.
Tracing on pending is useful for most users as it takes into account the current txpool while
tracing on latest might be useful for users that have little to know knowledge of the current
transactions in the network.

If blockNrOrHash is not specified, estimateGas defaults to pending
2020-10-06 14:12:09 +02:00
gary rong
c7da6ddb54 trie: support empty range proof (#21199)
# Conflicts:
#	trie/proof.go
#	trie/proof_test.go
2020-10-06 14:12:09 +02:00
gary rong
99033c6c57 trie: fix gaped range proof test case (#21484)
# Conflicts:
#	trie/proof_test.go
2020-10-06 14:12:09 +02:00
Binacs
f4397a3485 cmd/clef, cmd/geth: use SplitAndTrim from cmd/utils (#21579)
# Conflicts:
#	cmd/geth/retesteth.go
#	cmd/utils/flags.go
2020-10-06 14:12:09 +02:00
rene
d57fb49ed3 p2p: move rlpx into separate package (#21464)
This change moves the RLPx protocol implementation into a separate package,
p2p/rlpx. The new package can be used to establish RLPx connections for
protocol testing purposes.

Co-authored-by: Felix Lange <fjl@twurst.com>
# Conflicts:
#	p2p/rlpx/rlpx.go
#	p2p/rlpx/rlpx_test.go
#	p2p/server_test.go
2020-10-06 14:12:09 +02:00
Marius van der Wijden
6149347099 mobile: better api for java users (#21580)
* (mobile): Adds string representations for types

* mobile: better interfaces add stringer to types

Co-authored-by: sarath <sarath@melvault.com>
# Conflicts:
#	go.mod
#	go.sum
#	mobile/common.go
#	mobile/geth.go
#	mobile/types.go
2020-10-06 14:12:09 +02:00
Osoro Bironga
2d81899bd9 accounts/abi: improve documentation and names (#21540)
* accounts: abi/bid/backends; cleaned doc errors, camelCase refactors and anonymous variable assignments

* acounts/abi/bind: doc errors, anonymous parameter assignments

* accounts/abi: doc edits, camelCase refactors

* accounts/abi/bind: review fix

* reverted name changes

* name revert

Co-authored-by: Osoro Bironga <osoro@doctaroo.com>
2020-10-06 14:12:09 +02:00
Guillaume Ballet
822244dcd4 core: fix a typo in comment (#21439)
# Conflicts:
#	core/block_validator.go
2020-10-06 14:12:09 +02:00
Péter Szilágyi
0bdcf2cc71 eth/downloader: dynamically move pivot even during chain sync
# Conflicts:
#	eth/downloader/downloader.go
2020-10-06 14:12:09 +02:00
Giuseppe Bertone
33f3cbacf4 cmd/geth: added counters to the geth inspect report (#21495)
* database: added counters

* Improved stats for ancient db

* Small improvement

* Better message and added percentage while counting receipts

* Fast counting for receipts

* added info message

* Show both receips itemscount  from ancient db and counted receipts

* Fixed default case

* Removed counter for receipts in ancient store

* Removed counting of receipts present in leveldb
# Conflicts:
#	core/rawdb/database.go
2020-10-06 14:12:09 +02:00
Marius van der Wijden
1f0014a34e cmd/utils: use preconfigured testnet flags instead of networkid (#21561)
* cmd/utils: use preconfigured testnet flags instead of networkid

* cmd/utils: shorter description

Co-authored-by: Martin Holst Swende <martin@swende.se>

* Update flags.go

Co-authored-by: Martin Holst Swende <martin@swende.se>
# Conflicts:
#	cmd/utils/flags.go
2020-10-06 14:12:09 +02:00
Marius van der Wijden
f6c97d1df1 tests/fuzzers/abi: add fuzzer for fuzzing package accounts/abi (#21217)
* tests/fuzzers/abi: added abi fuzzer

* accounts/abi: fixed issues found by fuzzing

* tests/fuzzers/abi: update fuzzers, added repro test

* tests/fuzzers/abi: renamed abi_fuzzer to abifuzzer

* tests/fuzzers/abi: updated abi fuzzer

* tests/fuzzers/abi: updated abi fuzzer

* accounts/abi: minor style fix

* go.mod: added go-fuzz dependency

* tests/fuzzers/abi: updated abi fuzzer

* tests/fuzzers/abi: make linter happy

* tests/fuzzers/abi: make linter happy

* tests/fuzzers/abi: comment out false positives
# Conflicts:
#	go.mod
#	go.sum
2020-10-06 14:12:09 +02:00
gary rong
1240e7bcac les/lespay/server: bump database version (#21571)
# Conflicts:
#	les/lespay/server/clientdb.go
2020-10-06 14:12:09 +02:00
Vinod Damle
9c65cbd46a params: allow setting Petersburg block before chain head (#21473)
* Allow setting PetersburgBlock before chainhead

if it is at the same block as ConstantinopleBlock

* Add a negative test
2020-10-06 14:12:09 +02:00
Mason Fischer
cd6db05083 ethclient: fix BlockNumber (#21565)
It didn't actually work because it called a method that doesn't
exist. This fixes it also adds a test.

Co-authored-by: Felix Lange <fjl@twurst.com>
2020-10-06 14:12:09 +02:00
Giuseppe Bertone
1af24a80bd core/rawdb: single point of maintenance for writing and deleting tx lookup indexes (#21480)
# Conflicts:
#	core/blockchain.go
#	core/rawdb/accessors_indexes.go
#	core/rawdb/accessors_indexes_test.go
#	core/rawdb/chain_iterator.go
#	light/txpool.go
2020-10-06 14:12:09 +02:00
Kirill Elagin
a34a0b90c0 COYPING: restore the full text text of GPL (#21568)
When the license was added to the repository, its text was changed (some
sections at the end removed) and, worse, the authors of go-ethereum
tried to claim copyright on the license text.

The correct way to apply GPL to a project is to copy it verbatim.
This change reverts the text of the GPL to the original.
2020-10-06 14:12:09 +02:00
Martin Holst Swende
c0a60c5f44 eth/tracers: regenerate assets from #21549 (#21564)
# Conflicts:
#	eth/tracers/internal/tracers/assets.go
2020-10-06 14:12:09 +02:00
Felföldi Zsolt
f4d9f05acf les, les/lespay/server: refactor client pool (#21236)
* les, les/lespay/server: refactor client pool

* les: use ns.Operation and sub calls where needed

* les: fixed tests

* les: removed active/inactive logic from peerSet

* les: removed active/inactive peer logic

* les: fixed linter warnings

* les: fixed more linter errors and added missing metrics

* les: addressed comments

* cmd/geth: fixed TestPriorityClient

* les: simplified clientPool state machine

* les/lespay/server: do not use goroutine for balance callbacks

* internal/web3ext: fix addBalance required parameters

* les: removed freeCapacity, always connect at minCapacity initially

* les: only allow capacity change with priority status

Co-authored-by: rjl493456442 <garyrong0905@gmail.com>
# Conflicts:
#	cmd/geth/les_test.go
#	les/api.go
#	les/api_test.go
#	les/clientpool.go
#	les/clientpool_test.go
#	les/metrics.go
#	les/peer.go
#	les/server.go
#	les/server_handler.go
#	les/test_helper.go
#	les/utils/expiredvalue.go
2020-10-06 14:12:09 +02:00
Felix Lange
79f7f2853f rlp: add SplitUint64 (#21563)
This can be useful when working with raw RLP data.
2020-10-06 14:12:09 +02:00
Julian Koh
db4861b9f9 js/tracers: make calltracer report value in selfdestructs (#21549) 2020-10-06 14:12:09 +02:00
Felföldi Zsolt
d55e519f23 p2p/nodestate: ensure correct callback order (#21436)
This PR adds an extra guarantee to NodeStateMachine: it ensures that all
immediate effects of a certain change are processed before any subsequent
effects of any of the immediate effects on the same node. In the original
version, if a cascaded change caused a subscription callback to be called
multiple times for the same node then these calls might have happened in a
wrong chronological order.

For example:

- a subscription to flag0 changes flag1 and flag2
- a subscription to flag1 changes flag3
- a subscription to flag1, flag2 and flag3 was called in the following order:

   [flag1] -> [flag1, flag3]
   [] -> [flag1]
   [flag1, flag3] -> [flag1, flag2, flag3]

This happened because the tree of changes was traversed in a "depth-first
order". Now it is traversed in a "breadth-first order"; each node has a
FIFO queue for pending callbacks and each triggered subscription callback
is added to the end of the list. The already existing guarantees are
retained; no SetState or SetField returns until the callback queue of the
node is empty again. Just like before, it is the responsibility of the
state machine design to ensure that infinite state loops are not possible.
Multiple changes affecting the same node can still happen simultaneously;
in this case the changes can be interleaved in the FIFO of the node but the
correct order is still guaranteed.

A new unit test is also added to verify callback order in the above scenario.
# Conflicts:
#	les/serverpool.go
#	p2p/nodestate/nodestate.go
#	p2p/nodestate/nodestate_test.go
2020-10-06 14:12:09 +02:00
Shude Li
3e6820d863 Dockerfile: unexpose port 8547 as GraphQL was merged into HTTP endpoint (#21556)
# Conflicts:
#	Dockerfile
#	Dockerfile.alltools
2020-10-06 14:12:09 +02:00
Guillaume Ballet
20066ac3d1 p2p/discover: fix typo in comments (#21554) 2020-10-06 14:12:09 +02:00
Marius van der Wijden
0cc7aba2b7 miner: fix regression, add test for starting while download (#21547)
Fixes a regression introduced in #21536
2020-10-06 14:12:09 +02:00
Marius van der Wijden
ca6b1bcea5 miner: use channels instead of atomics in update loop (#21536)
This PR changes several different things:

- Adds test cases for the miner loop
- Stops the worker if it wasn't already stopped in worker.Close()
- Uses channels instead of atomics in the miner.update() loop

Co-authored-by: Felix Lange <fjl@twurst.com>
# Conflicts:
#	miner/miner.go
2020-10-06 14:12:09 +02:00