Commit Graph

1152 Commits

Author SHA1 Message Date
Giulio rebuffo
fd11ffca3d
Added execution .proto (#749) 2022-11-30 11:20:21 +01:00
Alex Sharov
c63b54e470
e3: option to discard all history writes. useful to test execution performance. (#753) 2022-11-30 16:06:51 +07:00
Alex Sharov
7e661f184b
e3: option to discard all history writes. useful to test execution performance. (#752) 2022-11-30 15:33:43 +07:00
Alex Sharov
c793890fdd
grpc version up (#750) 2022-11-30 08:53:22 +07:00
Giulio rebuffo
2d86bff102
Sentinel interfaces (#748) 2022-11-29 00:01:03 +01:00
hexoscott
1e24a738bf
fix for windows tests (#747) 2022-11-28 16:17:27 +07:00
Giulio rebuffo
f776665b21
added BeaconBlocks table (#746) 2022-11-26 23:05:59 +01:00
Max Revitt
3833e2503b
hotfix(downloader): detect ipv6 only on linux #6117 (#745)
Prevent port scan warnings on Hetzner and potentially other hosting
providers by only detecting ipv6 for linux by reading from
/sys/module/ipv6/parameters/disable
2022-11-24 20:43:41 +07:00
Alex Sharov
661ef494cf
mdbx: remove deprecated cmp_suffix32 feature (#744) 2022-11-24 09:10:09 +07:00
Andrew Ashikhmin
f2e3c2eea3
sync.Mutex instead of RWMutex in kvcache (#743)
Follow-up to PR #730
2022-11-22 14:08:32 +01:00
awskii
229b08146b
[WIP] E4 commitment keys replace (#684)
basic implementation of replacing account and storage keys encoded in
commitment branches
2022-11-21 07:39:30 +00:00
Alex Sharov
0eb4f8388a
Downloader extract, step2 (#739) 2022-11-20 10:41:20 +07:00
Alex Sharov
fb0238b6e6
up some deps (#738) 2022-11-16 14:22:28 +03:00
Manav Darji
07fa94278f
txpool: honour nonce while sorting txs (#737)
In context of https://github.com/ledgerwatch/erigon/issues/5694, this PR
fixes the tx ordering logic in the txpool. Also, a relevant change in
erigon is made here: https://github.com/ledgerwatch/erigon/pull/6051.

When the mining module used to query the best transactions, the response
of transactions weren't sorted according to nonce (for same sender
address). This caused the execution to fail (except 1). The txpool
orders the transactions using this underlying `better()` and `worse()`
functions. The `better()` function didn't have a nonce check for the
pending pool, while the `worse()` function had. This PR adds a check
which would compare and put a transaction with lower nonce ahead.

Moreover, on further investigation, these checks were applied for all
types of transactions. It only makes sense compare the nonce for
transactions which has same sender account. Hence, this PR also adds an
additional check along with.
2022-11-16 10:57:17 +03:00
Giulio rebuffo
b0cda9f301
Added light client database tables (#736) 2022-11-15 19:59:55 +01:00
Andrew Ashikhmin
10e842853b
txpool: sync.Mutex instead of RWMutex (#735)
[simplelru](https://github.com/hashicorp/golang-lru/tree/master/simplelru)
is not thread safe. During the `Get` operation, the recentness of the
accessed item is updated, so it is not a pure read-operation. Therefore,
the mutex we need to protect the LRUs in txpool is a full mutex, not
`RLock`. See
https://github.com/ledgerwatch/erigon/issues/4679#issuecomment-1312064790
and https://github.com/ethereum/go-ethereum/pull/26164.

Also, RWMutex has a performance overhead compared with the vanilla one
(see, for example, https://github.com/golang/go/issues/38813).

Kudos to Martin Swende for pointing to the issue.
2022-11-14 11:59:02 +01:00
Andrew Ashikhmin
b810bb6ee0
Update interfaces (#733)
Pick up https://github.com/ledgerwatch/interfaces/pull/131
2022-11-11 16:36:22 +01:00
Alex Sharov
9e1963e40d
e3: wal ram configure (#732) 2022-11-11 11:28:18 +07:00
hexoscott
875b19b2b4
switch to standard lock to help cache perf (#730) 2022-11-08 16:20:47 +00:00
Alex Sharov
19804fd971
e3: tmpdir (#729) 2022-11-07 12:16:56 +07:00
Alex Sharov
bfd3996fa4
e3: parallel miss idx (#728) 2022-11-07 11:42:03 +07:00
hexoscott
4b0ff0ae5e
cache validation check (#700)
draft for now to get early feedback
2022-11-05 14:25:41 +00:00
Max Revitt
ad300d8d66
Send Message - Peer Count (#726)
Adds peer count to SendMessageByMinBlock to allow sending requests to
multiple peers.

Also takes in change to update SnapshotsReply to use only Files slice of
string.
2022-11-03 15:14:11 +00:00
Max Revitt
c6c01e0392
Makefile: fix for mac m1/2 (#725)
Arch name was producing 404 when downloading releases from github for
protoc due to incorrect arch name.
2022-11-03 14:53:06 +00:00
Alex Sharov
b2f53fc10f
e3: prune debug log (#724) 2022-11-03 11:15:14 +07:00
Alex Sharov
f9074c989f
e3: build files sequentially (#723) 2022-11-02 09:44:40 +07:00
Giulio rebuffo
f64d13b0ed
added beaconState bucket (#722) 2022-11-02 01:00:59 +01:00
ledgerwatch
38f29ff4c1
Add modification times to index and decompressor objects (#721)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-11-01 15:39:49 +00:00
ledgerwatch
f0140de612
[txpool] Avoid modifications under just read-lock (#720)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-11-01 13:52:50 +00:00
Alex Sharov
27a814e7a3
e3_seq_exec (#719) 2022-11-01 10:34:50 +07:00
Alex Sharov
689fc4effd
e3: background merge (#718) 2022-11-01 09:55:34 +07:00
Alex Sharov
fe5dd317e5
e3: eth_traceTransaction, eth_replayTransaction, eth_call, ... (#716) 2022-10-31 12:31:31 +07:00
Håvard Anda Estensen
2f2cffd86b
Remove deprectated linter structcheck (#715)
`WARN [runner] The linter 'structcheck' is deprecated (since v1.49.0)
due to: The owner seems to have abandoned the linter. Replaced by
unused.`
2022-10-31 11:40:04 +07:00
Alex Sharov
d72f8346e1
e3: more merge logs (#714) 2022-10-29 21:11:28 +07:00
Alex Sharov
f6029ecbe9
e3: wal preallocate historyKey (#713) 2022-10-29 19:18:42 +07:00
Alex Sharov
088279e588
e3: try move old data from db as early as possible (#712) 2022-10-29 14:57:34 +07:00
Alex Sharov
cbefbfb8eb
e3: add merge logs (#711) 2022-10-29 14:41:55 +07:00
Alex Sharov
aa83e1b11a
e3: less small merges, parallel merge (#710) 2022-10-29 13:21:00 +07:00
Alex Sharov
ad8563c26a
e3: wait group for apply loop (#709) 2022-10-29 11:48:45 +07:00
Alex Sharov
24d530e307
e3: parallel exec, rotate and partial-flush of indices wal - while main thread is idle (#708) 2022-10-28 21:10:46 +07:00
Alex Sharov
725cd95865
E3: parallel exec, apply on roTx (#707) 2022-10-27 16:47:04 +07:00
Alex Sharov
45647a5e42
revert_o2 changes (#706) 2022-10-26 15:18:21 +07:00
Alex Sharov
b671d1a645
revert last mdbx change - because some suspicious bug-report (#705)
for https://github.com/ledgerwatch/erigon/issues/5863
2022-10-26 14:04:28 +07:00
Andrew Ashikhmin
3097828465
txpool: prevent index out of range 2 (#704)
(Continuation of PR #690)

Fixes the following error reported by stickx:

![PXL_20221024_214752470](https://user-images.githubusercontent.com/34320705/197769120-65e01142-4948-4e04-a555-16675ef9d9f7.jpeg)
2022-10-25 14:18:08 +02:00
Alex Sharov
4fec09660e
e3: better prune logs (#703) 2022-10-25 16:06:40 +07:00
Alex Sharov
bfdf6d80c0
up some deps (#702) 2022-10-25 09:27:40 +07:00
Alex Sharov
c1965e9c5a
add DECOMPRESS_CONDENSITY env variable (#701) 2022-10-24 10:00:34 +07:00
Alex Sharov
231fb52d21
E3: par logs (#699) 2022-10-23 15:30:27 +07:00
Alex Sharov
d786c4aab8
fix linter warnings (#698) 2022-10-22 13:19:27 +07:00
Alex Sharov
9819f6af24
eliasfano: To fix checkptr fatal error (#697)
```
 go test -race -run=TestEliasFano ./recsplit/eliasfano32
fatal error: checkptr: converted pointer straddles multiple allocations

goroutine 35 [running]:
runtime.throw({0x13bb5bf?, 0x13446ca?})
	runtime/panic.go:1047 +0x5d fp=0xc000137790 sp=0xc000137760 pc=0x108a13d
runtime.checkptrAlignment(0xa9?, 0x0?, 0x0?)
	runtime/checkptr.go:26 +0x6c fp=0xc0001377b0 sp=0xc000137790 pc=0x1059f8c
github.com/ledgerwatch/erigon-lib/recsplit/eliasfano32.Min({0xc00012c280, 0x40, 0x40})
	github.com/ledgerwatch/erigon-lib/recsplit/eliasfano32/elias_fano.go:324 +0x36f fp=0xc000137868 sp=0xc0001377b0 pc=0x133e66f
github.com/ledgerwatch/erigon-lib/recsplit/eliasfano32.TestEliasFano(0x0?)
	github.com/ledgerwatch/erigon-lib/recsplit/eliasfano32/elias_fano_test.go:58
```
2022-10-22 10:55:19 +07:00