Commit Graph

798 Commits

Author SHA1 Message Date
alex.sharov
6c29cfcd6e e3: more mainnet snapshots 2023-01-19 14:31:03 +07:00
Alex Sharov
0f573a9372
e3: more bsc snapshots (#6623) 2023-01-19 10:04:13 +07:00
ledgerwatch
83b74cbd18
Fix eth_getLogs (#6621)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-01-18 23:41:22 +00:00
Andrew Ashikhmin
f151a52c0e
Withdrawal amount in GWei (#6578)
See https://github.com/ethereum/execution-apis/pull/354 &
https://github.com/ethereum/EIPs/pull/6325.

Prerequisite: https://github.com/ledgerwatch/erigon-lib/pull/832.
2023-01-17 11:22:08 +01:00
Alex Sharov
b248ffe738
e3: new goerli snapshots (#6596) 2023-01-17 15:06:21 +07:00
Alex Sharov
d317722aef
e3: storageRangeAt (#6580) 2023-01-17 14:16:36 +07:00
Alex Sharov
97a769cfc1
e3: increase some defaults (#6592) 2023-01-17 09:14:17 +07:00
hexoscott
7dcbfbc283
reference hash, address, and chain config from lib (#6536) 2023-01-13 18:12:18 +00:00
alex.sharov
5549b706ac kv: paris merge stream 2023-01-13 11:37:05 +07:00
Alex Sharov
41e9356f61
e3: stream.ToBitamp() (#6562) 2023-01-12 09:58:21 +07:00
Alex Sharov
731569bbb7
e3: invalid txnum table (#6540) 2023-01-12 09:31:41 +07:00
Alex Sharov
de42ff09c0
Torrent: reduce network chunk, some routers are unhappy (#6552) 2023-01-11 13:31:14 +07:00
alex.sharov
0f03c622aa STOP_AFTER_RECONSTITUTE=true 2023-01-11 10:16:31 +07:00
Alex Sharov
b299133e0f
e3: locality index, correct metadata size accounting (#6550) 2023-01-11 09:56:46 +07:00
alex.sharov
d8f6ca8485 Revert "mdbx: proper atomic close"
This reverts commit fa5cb45336.
2023-01-10 13:19:50 +07:00
alex.sharov
fa5cb45336 mdbx: proper atomic close 2023-01-10 12:03:19 +07:00
Alex Sharov
7c2ed8e01f
mdbx: v0.12.3 (#6521) 2023-01-10 09:15:18 +07:00
Alex Sharov
f3636c2ad2
kv_temporal: 2nd key for domain (#6533) 2023-01-09 15:16:07 +07:00
ledgerwatch
e8287918ba
Gnosis block snapshots (#6516)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-01-07 12:07:36 +00:00
Alex Sharov
3c7e6b114e
e3: locality index (#6513) 2023-01-07 12:31:00 +07:00
Alex Sharov
4c3bb1cca5
kv_temporal: DomainGet (#6511) 2023-01-06 14:27:54 +07:00
hexoscott
1a09dcbdb3
use set rather than slice for tracking yielded when mining (#6488)
make use of sets when tracking yielded transactions during mining
2023-01-02 13:00:08 +00:00
Alex Sharov
11637a5c7d
e3: force merge snapshots before reconst (#6484) 2023-01-02 10:10:48 +07:00
Alex Sharov
65b66d6be2
make clang happy (#6482) 2023-01-01 11:43:31 +07:00
Alex Sharov
4a9c871628
a bit rename 22 to v3 (#6476) 2022-12-30 21:53:42 +07:00
Alex Sharov
3ebd597912
up log version (#6474) 2022-12-30 20:31:17 +07:00
Alex Sharov
0b900e3004
coherent state cache: change btree type (#6473) 2022-12-30 19:47:46 +07:00
Alex Sharov
c04668d0ff
e3: agg cancel background jobs (#6463) 2022-12-29 15:04:07 +07:00
Alex Sharov
36fc6a3950
kv: db.ReadOnly() method #806 (#6454) 2022-12-28 12:48:57 +07:00
Alex Sharov
ba585f494b
torrent lib version up (#6447) 2022-12-27 12:54:00 +07:00
alex.sharov
17ea11e9a0 mdbx: fix set option error 2022-12-26 21:33:03 +07:00
Alex Sharov
fa6f6038e7
kv: tx.Prefix method (#6441) 2022-12-26 17:58:21 +07:00
Alex Sharov
ab6b4546f5
KV: tx.Range() with stream api (#6437) 2022-12-25 17:41:43 +07:00
Alex Sharov
2133a4fe17
KV: tx.Range() with stream api (#6436) 2022-12-25 17:40:07 +07:00
Alex Sharov
4e26f53a75
e3: return error from inline-apply (#6427) 2022-12-24 17:30:26 +07:00
Alex Sharov
ade933be6b
kv_remote: server to support thread-safe multi-streams per 1 tx (#6402) 2022-12-24 13:11:15 +07:00
Alex Sharov
d7404bc391
e3: correct bsc snapshots (#6411) 2022-12-23 13:06:48 +07:00
Giulio rebuffo
5fd3536ef0
Erigon-cl database schema (#6399) 2022-12-22 19:59:24 +01:00
Alex Sharov
d9b6c84f57
kv_remote: c.Count() (#6403) 2022-12-22 12:44:05 +07:00
Alex Sharov
130ab85bea
e3: kv/temporal prototype 3 (#6395) 2022-12-22 09:37:32 +07:00
Alex Sharov
2711e3a712
e3: verified mainnet snapshots (#6387) 2022-12-20 22:32:30 +07:00
Alex Sharov
cce0f251b4
e3: kv/temporal prototype 2 (#6377) 2022-12-20 09:28:10 +07:00
Alex Sharov
dfa6505f93
e3: kv/temporal prototype (#6367) 2022-12-19 15:38:54 +07:00
Alex Sharov
185141b184
e3: reconst MakeSteps - to check that files are indexed (#6366) 2022-12-19 10:27:39 +07:00
hexoscott
d4623ec9d7
mining updates around txpool yielding (#6342)
Co-authored-by: Alex Sharov <AskAlexSharov@gmail.com>
2022-12-18 08:45:03 +07:00
Alex Sharov
04999c3219
mdbx: relax a bit merge limit (still leave it stronger than default) (#6350) 2022-12-17 20:10:01 +07:00
Alex Sharov
8d32a00558
e3: increase default wal limit (#6347) 2022-12-17 16:55:57 +07:00
Andrew Ashikhmin
0fc2022a0e
Extend fork ID to timestamp-based forks (#6324)
Starting from
[Shanghai](https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/shanghai.md),
forks are based on timestamps rather than block heights (see PR #6238).
This PR extends [EIP-2124](https://eips.ethereum.org/EIPS/eip-2124) Fork
ID to include timestamp-based blocks. See also
https://github.com/ethereum/go-ethereum/pull/25878.

Co-authored-by: Marius van der Wijden <m.vanderwijden@live.de>
2022-12-16 12:08:54 +01:00
ledgerwatch
56e64fcb24
Change block snapshots (#6338)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-12-16 08:38:02 +00:00
ledgerwatch
66c44a739e
Add another mainnet block snapshot range (15.5m - 16m) (#6330)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-12-16 08:24:17 +00:00
Alex Sharov
b2bf12827c
e3: cancel background build (#6323) 2022-12-15 17:18:00 +07:00
Alex Sharov
863e1ed07b
e3: handle "kill -9" during merge, auto-hide history .ef file if not corresponding .v file (#6304) 2022-12-15 13:49:06 +07:00
Alex Sharov
ce9203d80d
e3: more aggressive prune #780 (#6299) 2022-12-14 09:50:48 +07:00
Alex Sharov
fed1be256c
e3: auto-remove useless files (#6298) 2022-12-14 09:03:16 +07:00
hexoscott
c0d2523b06
reset txpool yielded flags before starting mining (#6284) 2022-12-12 17:27:57 +07:00
ledgerwatch
1c3c486d00
Avoid using peers returning empty responses, not sending skeleton requests (#6281)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-12-11 23:03:10 +00:00
ledgerwatch
4ab76849d8
Use old method of peer selection for non-POS networks (#6279)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2022-12-11 15:14:49 +00:00
Alex Sharp
d8ae12b6fd Revert "Add passive peer parameter"
This reverts commit 786179646b.
2022-12-11 12:33:08 +00:00
Alex Sharp
786179646b Add passive peer parameter 2022-12-11 12:32:47 +00:00
ledgerwatch
b5a7faa8db
[e3] Incremental reconstitution (#6270)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-12-10 09:34:17 +00:00
Alex Sharov
b4fd07b671
e3: earlier flush (#6227) 2022-12-10 15:53:58 +07:00
hexoscott
47a6f86f76
use a shared simulated tx when mining (#6253)
This ensures that the filter bad transactions can use the same context
each time, so increases an account nonce in the first batch of
transactions is committed to the simulation just in case the same
account appears in the next batch of transactions.

Also makes use of the new txpool candidate functionality to ensure we're
getting fresh transactions each time.
2022-12-09 21:16:10 +07:00
Giulio rebuffo
0da12e4c94
Verification by root and not by slot (#6243) 2022-12-07 21:26:45 +01:00
Alex Sharov
554a21cf79
mdbx: runtime options are changeable in Ascedee mode (#6232) 2022-12-07 17:10:36 +07:00
Alex Sharov
43934c6f4a
mdbx: expose dirtySpace option (#6231) 2022-12-07 16:39:13 +07:00
Alex Sharov
79f259d902
mdbx bindings: remove txn.RawRead field #769 (#6225) 2022-12-07 13:08:48 +07:00
Alex Sharov
724e93a239
e3: no wal support (#6224) 2022-12-07 12:15:57 +07:00
Alex Sharov
002140daae
mdbx: add BeginRwAsync method (#6221) 2022-12-07 11:19:05 +07:00
alex.sharov
7788802e96 save 2022-12-07 10:32:06 +07:00
Giulio rebuffo
6e76643c09
Added Handshake protocol to Erigon-CL Lightclient and Fullclient (#6206) 2022-12-05 01:25:12 +01:00
Alex Sharov
e3085f9290
e3: experiment with btree "path hint" (#6158) 2022-12-04 18:15:28 +07:00
Alex Sharov
f9c8d556a5
log experiment enabling (#6186) 2022-12-03 12:56:44 +07:00
Alex Sharov
9b65c533c9
e3: optimize incremental hashstate (#6179) 2022-12-03 12:23:01 +07:00
hexoscott
09a01bc6a0
txpool to pull blocks of transactions until no gas remains for the block (#6160)
Moving the txpool transaction pull into the execution phase and looping
until the gas is used up or the txpool runs dry.

Removed the concept of local vs remote transactions as comments/code
showed this split was no longer in use.

Created a `PreparedTxs` collection to satisfy the use case in the
integration tool when mining is active.

Untested locally as I have no way of mining/validating currently.

Co-authored-by: Alex Sharov <AskAlexSharov@gmail.com>
2022-12-03 12:20:47 +07:00
alex.sharov
bae905b573 save 2022-12-02 18:41:36 +07:00
Andrew Ashikhmin
d82c778ab3
Withdrawals part 1 (#6009)
This PR partially implements
[EIP-4895](https://eips.ethereum.org/EIPS/eip-4895): Beacon chain push
withdrawals as operations. The new Engine API methods
(https://github.com/ethereum/execution-apis/pull/195) are implemented.

_Body downloader and saving withdrawals into DB are not implemented
yet!_
2022-12-01 09:15:01 +01:00
Giulio rebuffo
a8ac42f429
updated bls and erigon-lib (#6164) 2022-11-30 14:13:17 +01:00
Alex Sharov
81b438a6e2
e3: option to discard all history writes. useful to test execution performance. (#6157) 2022-11-30 16:06:53 +07:00
Alex Sharov
0f53bd9e93
grpc version up (#6155) 2022-11-30 09:16:02 +07:00
alex.sharov
f238620fdf save 2022-11-30 08:47:09 +07:00
Giulio rebuffo
025839afd5
moved out protobuffers for sentinel (#6145) 2022-11-29 00:00:40 +01:00
Giulio rebuffo
8c38eeda5a
Added skeleton for beacon chain state transition (#6135) 2022-11-27 00:03:58 +01:00
Mike Neuder
eb7e5c2c6e
Adding processSlots functionality and unit test for transitionState and processSlots (#6136)
Part of the CL implementation.
https://github.com/ledgerwatch/erigon/issues/5965
2022-11-26 23:34:17 +01:00
Giulio rebuffo
54d1895542
updated go-verkle (#6126) 2022-11-26 19:36:10 +01:00
Max Revitt
8cbf316e49
dep(erigon-lib): update to version with hotfix for ipv6 detection (#6121)
#6117
2022-11-24 21:34:04 +07:00
Alex Sharov
975c4960c7
mdbx: remove deprecated cmp_suffix32 feature (#6118) 2022-11-24 09:25:34 +07:00
awskii
cd508a65c5
E4 commit key replace (#6109)
https://github.com/ledgerwatch/erigon-lib/pull/684#issuecomment-1321577450
2022-11-22 11:02:43 +00:00
Alex Sharov
9bcd7fe6c3
e3: reduce state write lock (#6096) 2022-11-21 10:38:22 +07:00
Alex Sharov
8afeee56c8
Downloader extract, step2 (#6076) 2022-11-20 10:41:30 +07:00
Alex Sharov
4509f496c6
bsc: new blocks snapshots (#6075) 2022-11-18 03:09:07 +03:00
Alex Sharov
04293ef67a
Revert "e3: more mainnet snapshots" (#6069)
Reverts ledgerwatch/erigon#6068
2022-11-17 06:20:58 +03:00
Alex Sharov
17541b26da
e3: more mainnet snapshots (#6068) 2022-11-17 06:15:53 +03:00
Alex Sharov
7d034d0c79
e3: fix stuck exec after recon (#6059) 2022-11-16 14:22:49 +03:00
Giulio rebuffo
3a2d3be080
Added persistence in LightClient (#6056) 2022-11-15 20:39:18 +01:00
Andrew Ashikhmin
32629bdce4
Upgrade urfave/cli to v2 (#6047)
See also
https://github.com/urfave/cli/blob/main/docs/migrate-v1-to-v2.md
2022-11-14 17:33:57 +01:00
Andrew Ashikhmin
8152d5c7e4
txpool: sync.Mutex instead of RWMutex (#6045)
Pick up https://github.com/ledgerwatch/erigon-lib/pull/735
2022-11-14 12:24:14 +01:00
Andrew Ashikhmin
5b3f2b8c5f
Update interfaces (#6031)
Pick up
813d816908
& https://github.com/ledgerwatch/interfaces/pull/131.
2022-11-11 17:16:39 +01:00
Alex Sharov
90952c4110
e3: wal ram configure (#6023) 2022-11-11 11:28:22 +07:00
ledgerwatch
a4136faad4
Improve state cache performance (#6002)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-11-08 21:47:20 +00:00
hexoscott
636586c1b5
cache state check (#5844)
draft for now to get some early feedback on approach
2022-11-07 13:04:31 +00:00