Commit Graph

4026 Commits

Author SHA1 Message Date
Giulio rebuffo
5a7aaeb8fe
Better memory management when peering (#5582)
* better memory management with peers

* better memory management with peers

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-30 20:21:48 +02:00
Giulio rebuffo
98ceb7cc9c
separation of handlers (#5581)
Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-30 19:07:13 +02:00
Giulio rebuffo
3f1d5a4c92
Support for Goerli/Sepolia/Mainnet Fork ids on Consensus Layer (#5575)
* added proper chain config

* updated configs

* save progress

* fix lint

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-30 00:20:09 +02:00
ledgerwatch
7018c5e746
Ergonomic fixes for POS (#5574)
* Various POS fixes

* More quiet

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-09-29 22:17:16 +01:00
a
9f6fd488d2
[cl lightclient] - packet decoding & ssz code generation (#5558)
* added subscription to gossip

* added all handlers with logs

* disconnecting from peers with goodbye message received

* added time out for stream

* wip

* Remove unused

* remove extra structs

* status handler

* minor clean up

* add structs for altair light client

* begin writing out altair light client sync protocol to figure out what other structs are needed

* remove sszgen

* cleanup pt 1

* cleanup pt 2

* remove go 1.19 function

* less ambigious variable name

* run go fmt

* rename snappy_ssz to ssz_snappy to better align with wire name

* move more structs over

* poof set deadline

Co-authored-by: Enrique Jose Avila Asapche <eavilaasapche@gmail.com>
Co-authored-by: a <a@a.a>
2022-09-29 19:07:57 +02:00
Enrique Jose Avila Asapche
93add6cacf
Gossip subscription (#5567)
* added subscription to topics

* keeping track of topic subscription

* subscribing to beaconBlock

* listening to messages

* ops

* not processing our own messages

* ops
2022-09-29 13:39:42 +02:00
ledgerwatch
49aeb53988
Fail newPayload if execution is unsuccessful (#5553)
* Fail newPayload if execution is unsuccessful

* fix linter

* fix message

* no self-hosted

* try force ci

* back to unbuntu

* Remove unnecessary unwinds

* Fix canonicalising

* Quiet logs for in-memory exec

* Remove experimental overlay flag

* Fix sync test

* Fix test

* Fix lint

* Print hash in the end of the cycle

* Not notify headers if list is empty

* Supress timings and tables logs when no change in progress

* Reduce logging

* fix

* better log for pos download

* Better newPayload and forkChoice messages

* Fix lint

* simplify

* No duplication of download messages

* Reverse log for extension

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Igor Mandrigin <i@mandrigin.ru>
2022-09-29 06:38:13 +01:00
Alex Sharov
f4a7d2cf6d
erigon3: build .vi after download (#5568) 2022-09-29 12:14:51 +07:00
Enrique Jose Avila Asapche
c2a1558923
changed erigon logs fields (#5476)
* changed erigon logs fields

* lint

* Update erigon_receipts.go (#5485)

* lint

Co-authored-by: a <edward9.lee@gmail.com>
2022-09-28 20:46:42 +01:00
Enrique Jose Avila Asapche
f4c6e45f45
returning validator in POS trace (#5477) 2022-09-28 20:45:52 +01:00
Håvard Anda Estensen
23d21f3b44
Enable unconvert linter (#5566) 2022-09-28 15:10:38 +01:00
Giulio rebuffo
f9c9ee5d07
Made handlers disconnection better. (#5556)
* made handlers a bit better

* made handlers a bit better

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-28 13:39:55 +02:00
bgelb
c28b1d230b
run traceCall on top of state resulting from fully executed baseblock a.k.a. starting state of blockNumber+1 (#5555) 2022-09-28 08:30:58 +01:00
Alex Sharov
3c5625c72a
Revert "Revert "apply --db.read.concurrency flag value when open embedded db "" (#5559) 2022-09-28 13:48:43 +07:00
Alex Sharov
e4ad73bcb4
erigon3: agg to use workers for compress and merge (#5561) 2022-09-28 13:05:26 +07:00
Alex Sharov
6d07443ca5
erigon3: remote rpcdaemon used wrong agg dir #5562 2022-09-28 12:36:53 +07:00
Giulio rebuffo
62d4552b03
Updated go-verkle library (#5548)
* updated go verkle

* updated go verkle

* now it is well adapted

* accessories

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-27 22:45:48 +02:00
Enrique Jose Avila Asapche
123d7379cc
Gossip lightclient (#5549)
* added subscription to gossip

* added all handlers with logs

* disconnecting from peers with goodbye message received

* added time out for stream
2022-09-27 22:34:06 +02:00
ledgerwatch
325bff181e
Revert "apply --db.read.concurrency flag value when open embedded db" (#5550)
This reverts commit f654ee0dc2.
2022-09-27 15:24:22 +01:00
Enrique Jose Avila Asapche
a968c7ed5b
cleaned up storage and retrieval of state sync receipts (#5379)
* cleaned up storage and retrieval of state sync receipts

* added ctx to the error and got rid of unused var

* missing one

* small change

* log error

* ops

* read header number

* checking if status is succesful

* nil ptr err
2022-09-27 11:39:58 +01:00
Alex Sharov
4c2611c03e
erigon3: eth_getLogs support logIndex field (#5544) 2022-09-27 16:08:45 +07:00
Alex Sharov
f654ee0dc2
apply --db.read.concurrency flag value when open embedded db 2022-09-27 12:08:24 +07:00
Alex Sharov
e26243f14c
erigon3: fix state reconstitution segfault #5537 2022-09-27 11:40:47 +07:00
Alex Sharov
2276f438aa
downloader: fix log progress race #5535 2022-09-27 10:57:00 +07:00
Alex Sharov
9cac57bcc9
erigon3: set seedable files to 32 steps #5534 2022-09-27 10:51:14 +07:00
Alex Sharov
fb44051a82
erigon3: move temporary db creation inside Recon22 (#5533) 2022-09-27 10:41:30 +07:00
Giulio rebuffo
b47b13c1ff
added handler for ping p2p method (#5530)
* added handlers

* updated mod and sum

* ops

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-26 22:34:31 +02:00
Artem Tsebrovskiy
82d0dcfbe9
E23 commitment (#4947)
* erigon23 commitment

fixed mainnet genesis roothash, get back with update processing

erigon23 replay after restart, index lookup fix

bumped erigon-lib

* bumped erigon-lib ver
2022-09-26 19:09:10 +01:00
Alex Sharov
c64e7fe7ab
erigon3 test fix (#5522) 2022-09-26 13:34:46 +07:00
Alex Sharov
cb60382e6d
erigon3: rename "history.v2" to "history.v3" to avoid naming miss-match with "erigon3" (#5519) 2022-09-26 10:54:42 +07:00
Alex Sharov
72a4225478
erigon22: reconstitute optimize #5505 (#5505) 2022-09-26 09:13:44 +07:00
Enrique Jose Avila Asapche
511a5373f6
Config flag upgrade (#5491)
* allowing different values other than strings

* updated readme

* ops

* better error msg
2022-09-26 09:10:14 +07:00
Alex Sharov
fdb83de6f5
erigon22: authapi to use aggregator22 (#5506)
* save

* save
2022-09-26 09:09:30 +07:00
Giulio rebuffo
6d6e511b0f
added ENR setup for subnets (#5511)
Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-25 22:41:51 +02:00
Giulio rebuffo
e4362cce1c
licensed lightclient (#5509)
Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-25 21:01:39 +02:00
Enrique Jose Avila Asapche
abfa374165
LightClient P2P refactoring (#5507)
* separated convertions into utils.go

* added log to bad peers

* more verbose errors and names

* warn when banning bad peer

* has and get in function name

* space

* lint

* ops

* little rename

* deleted unused func

* revert
2022-09-25 20:39:09 +02:00
Giulio rebuffo
b940eae2e0
lightclient actually gets peers lol (#5502)
Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-25 02:14:10 +02:00
Enrique Jose Avila Asapche
b7606dcccb
added networkConfig.go (#5501)
* added networkConfig.go and mainnet config

* added goerli and sepolia networkConfig

* using map

* renaming to poop

* proper name

* fixed a bunch of stuff

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-24 22:09:04 +02:00
Giulio rebuffo
0fb982bfeb
Added p2p connection and libp2p host to Erigon Lightclient (#5500)
* added p2p connection and libp2p host

* added p2p connection and libp2p host

* oooops

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-24 20:48:56 +02:00
Giulio rebuffo
71112c1aae
Added discovery and connection to consensus layer bootnodes (#5497)
* added peer discovery functionality

* added discovery and connection to consensus layer bootnodes

* lint

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-24 16:44:34 +02:00
Giulio rebuffo
622d355f5a
first commit (#5493)
Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-24 01:53:27 +02:00
Giulio rebuffo
557db2390f
added dump verkle trie to text file (#5486)
Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-23 11:09:03 +02:00
Giulio rebuffo
11db9f4ea4
Added Verkle tree based stagedsync as a prototype (Activates if CancunBlock == 0) (#5483)
* added prototype of verkle tree stages in Erigon, activation set at Cancun

* ops

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-22 23:29:44 +02:00
Giulio rebuffo
a9bde213d9
Introduced separate buckets for Verkle tries (#5480)
* updated Erigon lib

* updated Erigon lib

* added proper verkle database buckets

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-22 19:03:57 +02:00
Giulio rebuffo
1b5d102527
packaged verkle-trie pkg (#5471)
Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-22 17:34:50 +02:00
Giulio rebuffo
bf768a4278
Adapted verkle tree generation in preperation of Beverly Hills (#5459)
* fixed increment

* removed useless code

* Adapted verkle tree generation in preperation of Beverly Hills

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-22 00:33:48 +02:00
jiang
09db0c8d43
open erigon_blockNumber API (#5454)
open `erigon_blockNumber`  feature API that has been implemented
2022-09-21 19:30:01 +07:00
Krishna Upadhyaya
bac6b071ab
use HeimdallURL flag instead of hardcoded value (#5452) 2022-09-21 14:55:11 +07:00
ledgerwatch
46f8d891d5
clean up erigon2.2 prototype (#5446)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-09-20 18:50:14 +01:00
Artem Tsebrovskiy
2b6d206497
added separated user/error log files to erigon 22/23 (#5156)
* added separated user/error log files to erigon 22/23

* added variable prefix to log file name

* updated log dependency
2022-09-20 16:51:09 +01:00
hexoscott
705673c336
increased logging around POS mining (#5442) 2022-09-20 13:15:56 +01:00
Alex Sharov
54343d1d69
save (#5439) 2022-09-20 13:09:24 +01:00
Alex Sharov
c782064582
erigon22: rpc fixes (#5437) 2022-09-20 14:01:54 +07:00
Enrique Jose Avila Asapche
e53fec1977
appending log into erigonLogs (#5419)
* appending log into erigonLogs

* Revert "appending log into erigonLogs"

This reverts commit 37ceb2fa3da156977bba764d7d9e77f27ae360d7.

* ops
2022-09-19 16:25:10 +03:00
Andrew Ashikhmin
775d4a225b
Don't check TerminalBlockHash in exchangeTransitionConfiguration (#5428) 2022-09-19 13:05:45 +02:00
Andrew Ashikhmin
7561a74af3
Remove terminal PoW block overrides (#5420) 2022-09-19 10:33:18 +02:00
Alex Sharov
c1bb4bc734
exec22: stagedsync test v1 (#5425)
* save

* save
2022-09-19 12:17:36 +07:00
Alex Sharov
9fb8a190bc
erigon22: folder snapshots/history (#5351) 2022-09-18 17:41:01 +07:00
Enrique Jose Avila Asapche
7b1bf44ce6
dont check for block reward or uncles if we are tracing POS (#5410)
* dont check for block reward or uncles if we are tracing POS

* comparing chainConfig to header difficulty

* fixed test

* difficulty == 0 then we are POS
2022-09-17 22:04:37 +01:00
ledgerwatch
43f592ed0e
Fixes for trace_block (#5402)
* Fixes for trace_block

* Print

* Print

* extra bodies

* extra bodies

* Add canonical check

* First fix for bodies mismatch

* More cleanup

* Advance progress

* Reset snapshots in integration

* Cleanup

* Way to reset snapshots stage

* Not reset sequence if not needed

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-09-17 12:53:27 +01:00
Temirlan
44266a9237
rcpdaemon, erigon: add --rpc.evmtimeout flag (#5395) 2022-09-17 13:25:27 +07:00
Giulio rebuffo
52d76977ca
Correct Verkle trie generation (#5399)
* log msg

* refactor

* use of delete

* fixed verkle tree incremental

* ops

* ops

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-16 15:11:13 +02:00
ledgerwatch
caeba44728
[erigon22] fix state reconstitution (testing on BSC) (#5391)
* Fix NPE in Parlia integration

* Fix state reconstitution for integration

* Update to latest erigon-lib

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-09-16 10:41:01 +01:00
Alex Sharov
10039f0431
erigon22: workers correct rollback #5387 2022-09-16 11:17:56 +07:00
Amit Panghal
15ad43e100
fix trace_block response for post merge blocks (#5361)
* fix trace_block response for post merge blocks

* fix difficulty call

* fix types and other compile issues

* run go fmt
2022-09-15 12:20:41 +01:00
Enrique Jose Avila Asapche
0c64c3f2c7
added a way to get latest executed block post POS (#5343)
* added a way to get latest executed block post POS

* added erigon_ExecutedBlockNumber into readme

* optional rpc.BlockNumber

* better message

* updated readme
2022-09-14 13:56:31 +03:00
Giulio rebuffo
bca221bf85
Refactored verkle tree state writer (#5357)
* verkle stuff

* added verkle writer

* added more stuff to verkle trees

* added tool for incremental prom.

* lint

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-13 15:05:58 +02:00
Alex Sharov
ad219d7e11
integration --chain bsc pass db #5349 2022-09-13 14:24:54 +07:00
Andrew Ashikhmin
610e648dc4
Kill Kiln (#5339) 2022-09-12 12:59:33 +02:00
Giulio rebuffo
99fbbb545b
Added complete verkle trie regeneration (#5310)
* verkle generation

* better UX

* q

* better verkle stuff

* for

* for o

* lint

* direct vtree

* addee verkle trees incremental promotion

* lint

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-10 20:00:03 +02:00
Alex Sharov
d1ddb5ee82
erigon22: fix txn overlap (#5327)
* save

* save
2022-09-10 11:26:58 +07:00
Alex Sharov
f6ca07e215
integration --workers flag (#5326) 2022-09-10 10:37:56 +07:00
Alex Sharov
8813ea87fd
Erigon22: add state reconstitution to stage_exec (#5321) 2022-09-09 14:40:25 +07:00
Chase
927f9e1c56
Add eth_callMany and debug_traceCallMany to README (#5319)
* Add eth_callMany to README

Should have been included in https://github.com/ledgerwatch/erigon/pull/4567

* Update README.md

* Update README.md
2022-09-09 11:18:23 +07:00
Alex Sharov
caa23b9532
erigon22: simplify interhashes stage (#5315) 2022-09-08 14:02:50 +07:00
Alex Sharov
98e69b55f4
--experimental.history.v2 (#5302) 2022-09-07 12:16:31 +07:00
Igor Mandrigin
a0c80ccbee
Fix compatibility of eth_getBlockTransactionCountByHash (#5297)
* fix compatibility of eth_getBlockTransactionCountByHash

* fixup
2022-09-07 12:11:48 +07:00
Alex Sharov
25e615a878
erigon22: historyReader22 and more tests (#5281)
* save

* save
2022-09-05 21:31:00 +07:00
Alex Sharov
6bfd2c3472
erigon22: rpc getLogs and traceFilter (#5277) 2022-09-05 11:33:55 +07:00
Alex Sharov
7874921e73
erigon22: correct incarnation (#5275) 2022-09-05 10:31:17 +07:00
ledgerwatch
da90c9752e
Fix for goerli resync (#5269)
* Fix for goerli resync

* Fix

* Fix lint

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-09-04 14:51:36 +01:00
ledgerwatch
c9ae7310e9
Fix lint (#5270)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-09-04 14:30:59 +01:00
Giulio rebuffo
435de928b7
Separation of Pedersen code, account and storage hashing (#5267)
* separation of pedersen hashing

* added multithreading to accounts

* more workers

* removed err

* ops

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-03 19:55:13 +02:00
Enrique Jose Avila Asapche
8fc7c78620
Bor txlookup (#5260)
* printing

* logging

* spam off

* ops

* clean up

* deleted all bor related stuff in snapshots

* adding bor tx to BorTxLookUp

* added readBorTxLookUp

* getting bor tx from bor lookup

* comments

* deleted bor related stuff

* deleting bor tx

* writing borTxLookUp in stage_txlookup

* using bytes

* little fixes

* updated erigon-lib

* using biEndian

* clean up

* setting bytes for big int

* log

* logging

* more logs

* delete logs
2022-09-02 17:41:58 +03:00
Giulio rebuffo
faebec48c9
Added pedersen hash generator utility in cmd/verkle (#5258)
* added tree key functions for verkle tries

* added tree key functions for verkle tries

* added tree key functions for verkle tries

* Pedersen hash generator

* removed extra functions

* better comment

* ops

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-09-02 15:45:30 +02:00
Max Revitt
5c49726f53
fix(evm): fee and tip calc bug (#5252) 2022-09-02 10:04:49 +07:00
ledgerwatch
693017c554
Cleanup Tevm experimental code (#5259)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-09-01 19:49:29 +01:00
ledgerwatch
73e2d1146e
Cleanup interfaces (#5254)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-09-01 16:44:37 +01:00
Michelangelo Riccobene
590276d3e1
Print peer-id using hex encoding to avoid unprintable characters (#5248) 2022-09-01 15:04:49 +01:00
ledgerwatch
9d88cb59c7
Cleanup interfaces (#5245)
* Cleanup interfaces

* Fix for windows

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-09-01 07:00:29 +01:00
Max Revitt
159e53d503
EVM fix - issue #5077 (#5233)
* fix(evm): output and add makefile command

* fix(evm): correct number type conversion
2022-08-31 07:51:08 +07:00
Nathan (Blaise) Bruer
002aba4686
Add STOP_AFTER_STAGE environ (#5207)
Adds ability to stop after a stage instead of just before a stage.
This will allow users to use something like:
`STOP_AFTER_STAGE=Finish erigon`
And erigon will stop after a full cycle of syncing.
2022-08-31 07:46:27 +07:00
Enrique Jose Avila Asapche
12331e018a
Fix bor txlookup (#5170) 2022-08-30 17:23:16 +03:00
Håvard Anda Estensen
65a0caeb94
Use strings.EqualFold for string comparison (#5227) 2022-08-30 14:37:14 +07:00
Alex Sharov
808180e801
grafana clean (#5226) 2022-08-30 11:30:34 +07:00
Alex Sharov
f0f13dbcf2
grafana clean (#5225) 2022-08-30 11:25:02 +07:00
Enrique Jose Avila Asapche
01dbad0979
Separating ErigonLogs from Logs (#5219) 2022-08-30 09:49:05 +07:00
Max Revitt
4c4baf4bbf
tweak(sentry): downgrade inbound message handling err to debug (#5215) 2022-08-29 19:03:53 +07:00
Alex Sharov
01f2965d8e
erigon22: MakeCanonical must update txNums (#5211) 2022-08-29 11:44:31 +07:00
Alex Sharov
a0af80014c
erigon22: rename historyReader22 to historyReader23 (#5202) 2022-08-27 15:21:02 +07:00