go-pulse/cmd/devp2p
Martin Holst Swende f62c58f8de
trie: make rhs-proof align with last key in range proofs (#28311)
During snap-sync, we request ranges of values: either a range of accounts or a range of storage values. For any large trie, e.g. the main account trie or a large storage trie, we cannot fetch everything at once.

Short version; we split it up and request in multiple stages. To do so, we use an origin field, to say "Give me all storage key/values where key > 0x20000000000000000". When the server fulfils this, the server provides the first key after origin, let's say 0x2e030000000000000 -- never providing the exact origin. However, the client-side needs to be able to verify that the 0x2e03.. indeed is the first one after 0x2000.., and therefore the attached proof concerns the origin, not the first key.

So, short-short version: the left-hand side of the proof relates to the origin, and is free-standing from the first leaf.

On the other hand, (pun intended), the right-hand side, there's no such 'gap' between "along what path does the proof walk" and the last provided leaf. The proof must prove the last element (unless there are no elements).

Therefore, we can simplify the semantics for trie.VerifyRangeProof by removing an argument. This doesn't make much difference in practice, but makes it so that we can remove some tests. The reason I am raising this is that the upcoming stacktrie-based verifier does not support such fancy features as standalone right-hand borders.
2023-10-13 16:05:29 +02:00
..
internal trie: make rhs-proof align with last key in range proofs (#28311) 2023-10-13 16:05:29 +02:00
crawl.go cmd/devp2p: use bootnodes as crawl input (#28139) 2023-09-19 14:18:29 +02:00
discv4cmd.go cmd/devp2p: use bootnodes as crawl input (#28139) 2023-09-19 14:18:29 +02:00
discv5cmd.go cmd/devp2p: use bootnodes as crawl input (#28139) 2023-09-19 14:18:29 +02:00
dns_cloudflare.go cmd: use errrors.New instead of empty fmt.Errorf (#27329) 2023-05-24 12:21:29 +02:00
dns_route53_test.go cmd/devp2p: fix comparison of TXT record value (#22572) 2021-03-25 13:32:32 +02:00
dns_route53.go all: update golang/x/ext and fix slice sorting fallout (#27909) 2023-08-12 00:04:12 +02:00
dnscmd.go cmd: use errrors.New instead of empty fmt.Errorf (#27329) 2023-05-24 12:21:29 +02:00
enrcmd.go cmd: use errrors.New instead of empty fmt.Errorf (#27329) 2023-05-24 12:21:29 +02:00
keycmd.go cmd: use errrors.New instead of empty fmt.Errorf (#27329) 2023-05-24 12:21:29 +02:00
main.go cmd/devp2p, cmd/geth: add version in --help output (#26895) 2023-03-15 14:34:36 +01:00
nodeset.go all: update golang/x/ext and fix slice sorting fallout (#27909) 2023-08-12 00:04:12 +02:00
nodesetcmd.go core/forkid: skip genesis forks by time (#28034) 2023-09-04 09:32:14 -04:00
README.md cmd, core, params: add support for the Holesky testnet (#28007) 2023-08-25 18:11:40 +03:00
rlpxcmd.go cmd: use errrors.New instead of empty fmt.Errorf (#27329) 2023-05-24 12:21:29 +02:00
runtest.go cmd: migrate to urfave/cli/v2 (#24751) 2022-06-27 18:22:36 +02:00

The devp2p command

The devp2p command line tool is a utility for low-level peer-to-peer debugging and protocol development purposes. It can do many things.

ENR Decoding

Use devp2p enrdump <base64> to verify and display an Ethereum Node Record.

Node Key Management

The devp2p key ... command family deals with node key files.

Run devp2p key generate mynode.key to create a new node key in the mynode.key file.

Run devp2p key to-enode mynode.key -ip 127.0.0.1 -tcp 30303 to create an enode:// URL corresponding to the given node key and address information.

Maintaining DNS Discovery Node Lists

The devp2p command can create and publish DNS discovery node lists.

Run devp2p dns sign <directory> to update the signature of a DNS discovery tree.

Run devp2p dns sync <enrtree-URL> to download a complete DNS discovery tree.

Run devp2p dns to-cloudflare <directory> to publish a tree to CloudFlare DNS.

Run devp2p dns to-route53 <directory> to publish a tree to Amazon Route53.

You can find more information about these commands in the DNS Discovery Setup Guide.

Node Set Utilities

There are several commands for working with JSON node set files. These files are generated by the discovery crawlers and DNS client commands. Node sets also used as the input of the DNS deployer commands.

Run devp2p nodeset info <nodes.json> to display statistics of a node set.

Run devp2p nodeset filter <nodes.json> <filter flags...> to write a new, filtered node set to standard output. The following filters are supported:

  • -limit <N> limits the output set to N entries, taking the top N nodes by score
  • -ip <CIDR> filters nodes by IP subnet
  • -min-age <duration> filters nodes by 'first seen' time
  • -eth-network <mainnet/goerli/sepolia/holesky> filters nodes by "eth" ENR entry
  • -les-server filters nodes by LES server support
  • -snap filters nodes by snap protocol support

For example, given a node set in nodes.json, you could create a filtered set containing up to 20 eth mainnet nodes which also support snap sync using this command:

devp2p nodeset filter nodes.json -eth-network mainnet -snap -limit 20

Discovery v4 Utilities

The devp2p discv4 ... command family deals with the Node Discovery v4 protocol.

Run devp2p discv4 ping <enode/ENR> to ping a node.

Run devp2p discv4 resolve <enode/ENR> to find the most recent node record of a node in the DHT.

Run devp2p discv4 crawl <nodes.json path> to create or update a JSON node set.

Discovery v5 Utilities

The devp2p discv5 ... command family deals with the Node Discovery v5 protocol. This protocol is currently under active development.

Run devp2p discv5 ping <ENR> to ping a node.

Run devp2p discv5 resolve <ENR> to find the most recent node record of a node in the discv5 DHT.

Run devp2p discv5 listen to run a Discovery v5 node.

Run devp2p discv5 crawl <nodes.json path> to create or update a JSON node set containing discv5 nodes.

Discovery Test Suites

The devp2p command also contains interactive test suites for Discovery v4 and Discovery v5.

To run these tests against your implementation, you need to set up a networking environment where two separate UDP listening addresses are available on the same machine. The two listening addresses must also be routed such that they are able to reach the node you want to test.

For example, if you want to run the test on your local host, and the node under test is also on the local host, you need to assign two IP addresses (or a larger range) to your loopback interface. On macOS, this can be done by executing the following command:

sudo ifconfig lo0 add 127.0.0.2

You can now run either test suite as follows: Start the node under test first, ensuring that it won't talk to the Internet (i.e. disable bootstrapping). An easy way to prevent unintended connections to the global DHT is listening on 127.0.0.1.

Now get the ENR of your node and store it in the NODE environment variable.

Start the test by running devp2p discv5 test -listen1 127.0.0.1 -listen2 127.0.0.2 $NODE.

Eth Protocol Test Suite

The Eth Protocol test suite is a conformance test suite for the eth protocol.

To run the eth protocol test suite against your implementation, the node needs to be initialized as such:

  1. initialize the geth node with the genesis.json file contained in the testdata directory
  2. import the halfchain.rlp file in the testdata directory
  3. run geth with the following flags:
geth --datadir <datadir> --nodiscover --nat=none --networkid 19763 --verbosity 5

Then, run the following command, replacing <enode> with the enode of the geth node:

devp2p rlpx eth-test <enode> cmd/devp2p/internal/ethtest/testdata/chain.rlp cmd/devp2p/internal/ethtest/testdata/genesis.json

Repeat the above process (re-initialising the node) in order to run the Eth Protocol test suite again.

Eth66 Test Suite

The Eth66 test suite is also a conformance test suite for the eth 66 protocol version specifically. To run the eth66 protocol test suite, initialize a geth node as described above and run the following command, replacing <enode> with the enode of the geth node:

devp2p rlpx eth66-test <enode> cmd/devp2p/internal/ethtest/testdata/chain.rlp cmd/devp2p/internal/ethtest/testdata/genesis.json