ledgerwatch
5ae9cb7f39
[Devnet tool] side-quest logging step 6 ( #7496 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-05-11 18:59:55 +01:00
a
fd6acd4b31
[Caplin] beginnings of instrumentation ( #7486 )
...
this pr is ready for review, but it is waiting on this PR
https://github.com/VictoriaMetrics/metrics/pull/45
so that we do not need to use a replace directive.
2023-05-11 18:38:56 +02:00
Roberto Bayardo
8356f3a320
use ssz from updated erigon-lib ( #7490 )
...
ssz/clonable interfaces have been moved to erigon-lib so they can be
shared with the txpool code there
2023-05-11 12:54:20 +01:00
a
37da9ec1e3
[caplin] ssz byteobjects ( #7454 )
...
instead of converting from ssz -> struct -> ssz, it may be better to
just stay as ssz, then use methods to read the data.
this pr explores this concept, while maintaining compatiblity with the
existing codebase.
2023-05-10 21:37:50 +02:00
ledgerwatch
20437faaf5
[Devnet tool] side-quest logging step 4 ( #7481 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-05-10 17:12:23 +01:00
Alex Sharov
10b9aa1586
reduce default --db.size.limit from 7 to 3 Tb (to fit defaults of some systems) ( #7479 )
2023-05-10 09:43:23 +07:00
Alex Sharov
299535e7ea
LeakDetector: use it to find which resource was created but not closed (leaked) ( #7457 )
2023-05-08 12:22:26 +07:00
Giulio rebuffo
3b9636644d
fixed cache concurrency issue in BLS ( #7455 )
2023-05-07 14:38:44 +02:00
Giulio rebuffo
5b7643c57b
Added dencun networking ( #7453 )
2023-05-07 01:37:53 +02:00
Andrew Ashikhmin
ac087d8ca5
[interfaces] Header mix_digest -> prev_randao ( #7448 )
...
Pick up https://github.com/ledgerwatch/interfaces/pull/169
2023-05-05 17:58:20 +02:00
Alex Sharov
fe30cf8c6f
up urwafe and docker version ( #7435 )
2023-05-04 10:48:43 +07:00
Roberto Bayardo
d0a6d20ca2
update kzg dependencies ( #7432 )
...
Update to latest erigon-lib which now has the kzg context and update
crate-crypto to latest.
---------
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2023-05-04 10:36:26 +07:00
a
9644e6d220
Implement SpecTests in native go, add fork_choice handler ( #7422 )
...
a few TODO: remain to make this not a draft
---------
Co-authored-by: Giulio <giulio.rebuffo@gmail.com>
2023-05-02 16:19:22 +02:00
Giulio rebuffo
250a0a4a65
Caplin: Remotion of bad peers giving us bad blocks ( #7411 )
2023-04-29 21:32:33 +02:00
Giulio rebuffo
8a3b9e6d17
Added caching for BLS affines ( #7408 )
...
Improved CPU usage by 10x, we just really avoid re-compressing and
re-validating public keys
2023-04-29 02:36:53 +02:00
Alex Sharov
ded8283df7
erigon backup: v0 of sub-command ( #7396 )
2023-04-27 10:42:12 +07:00
Alex Sharov
367f3e9afa
e3: log slow (unclosed) contexts to detect leaks ( #7375 )
2023-04-24 12:52:15 +07:00
Alex Sharov
ae1891491e
up cobra cli ( #7371 )
2023-04-23 14:05:16 +07:00
Alex Sharov
74e08e197d
e3: remove files when no readers ( #7370 )
2023-04-23 11:55:16 +07:00
Alex Sharov
e96036fe33
e3: add CleanDir func ( #7362 )
2023-04-21 10:47:00 +07:00
Alex Sharov
12f08e6cd8
snappy: arm64 support ( #7361 )
...
port of https://github.com/ethereum/go-ethereum/pull/27027
2023-04-21 10:38:59 +07:00
Alex Sharov
a3d0c20303
prometheus client version up ( #7360 )
2023-04-21 10:37:28 +07:00
Alex Sharov
b14ca7508f
e3: remove garbage files ( #7357 )
2023-04-21 09:51:03 +07:00
Alex Sharov
776b780ac6
e3: move staticFilesInRange method to ctx ( #7330 )
2023-04-18 06:04:46 +00:00
Giulio rebuffo
515aedda7b
Added Caplin Phase 1 ( #7290 )
...
* Introduces full beacon validation
* Removes light client
* NOTE: slow on purpose, I want everything to be BLS verified for now.
2023-04-17 18:06:50 +00:00
Alex Sharov
69a3396433
add flag --db.size.limit ( #7325 )
2023-04-17 12:48:57 +00:00
alex.sharov
998e35a176
Revert "save"
...
This reverts commit 89133dce0f
2023-04-17 16:43:29 +07:00
alex.sharov
89133dce0f
save
2023-04-17 16:42:47 +07:00
Alex Sharov
62d1e8a66c
e3: in-general merge must not see "overlaps/deleted" files, but merge of history need access to corresponding index files (even if they marked as deleted or already merged - before kill -9) ( #7321 )
2023-04-17 05:54:29 +00:00
alex.sharov
e7ca92556c
use gohashtree release tag
2023-04-17 09:07:20 +07:00
ledgerwatch
57f051f04c
Update btcd library version ( #7316 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-04-16 09:50:54 +00:00
Andrew Ashikhmin
9b81302d9d
Embed AuRa config into chain Config ( #7307 )
...
Prerequisite: https://github.com/ledgerwatch/erigon-lib/pull/970
2023-04-14 07:51:25 +00:00
Andrew Ashikhmin
96bb5d544b
Remove Parlia ( #7306 )
...
Pre-requisite: https://github.com/ledgerwatch/erigon-lib/pull/969
2023-04-14 06:24:10 +00:00
Andrew Ashikhmin
02f6cac7b7
Move hexutil.Bytes to erigon-lib ( #7305 )
2023-04-13 11:19:02 +00:00
Andrew Ashikhmin
9387abf66b
[interfaces] lower_snake_case field names ( #7293 )
...
Pick up https://github.com/ledgerwatch/interfaces/pull/163
2023-04-12 10:35:54 +00:00
racytech
47fd86e4fb
eip-4844: assigned value to excessDataGas, unused packages removed ( #7289 )
...
`excessDataGas` has been partially made eip-4844 ready, so instead of
passing nils to functions, now it actually assigned to some value (it is
expected to be nil until cancun update).
2023-04-12 05:45:44 +00:00
ledgerwatch
9690228ede
[Diagnostics] Simplify logging settings, introduce correct log rotation with lumberjack ( #7273 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-04-07 21:08:44 +00:00
racytech
6f18ba1458
eip-4844: BlobTx and its components ( #7262 )
...
New transaction type added. This transaction differs from previous
transactions in a network encoding. Network encoding of a new
transaction wraps "regular" transaction with additional data: blobs and
kzgs. The network wrapper will be verified by execution layer using this
extra data.
2023-04-07 20:08:14 +00:00
Alex Sharov
64e7e788b5
e3: print background indexing logs in e2 style (summary of all files progress in 1 line) ( #7256 )
2023-04-05 04:49:02 +00:00
Alex Sharov
9a2702111f
e3: some new mainnet sn files ( #7253 )
2023-04-04 04:51:46 +00:00
Alex Sharov
625b0c5b15
take in account memlimit of cgroups ( #7204 )
...
for cgroups v2 support see:
https://github.com/shirou/gopsutil/issues/1416
2023-04-04 03:29:56 +00:00
ledgerwatch
721f9a49fe
Add more bor snapshots, remove bsc snapshots ( #7249 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-04-03 15:40:40 +00:00
Alex Sharov
d3cc1e152c
switch to lruv2 ( #7238 )
2023-04-03 03:19:30 +00:00
Alex Sharov
527f1da283
hashtree dep up ( #7235 )
...
gohashtree to support go1.20
https://github.com/prysmaticlabs/gohashtree/pull/8
2023-04-02 14:13:54 +00:00
Andrew Ashikhmin
02182ee11a
[erigon-lib] Remove ShardingForkTime in favour of CancunTime ( #7230 )
...
Pick up https://github.com/ledgerwatch/erigon-lib/pull/963
2023-03-31 09:11:09 +00:00
Alex Sharov
a1767861ab
stricter protection against bad dict in decompressor ( #7228 )
2023-03-31 03:17:39 +00:00
Alex Sharov
3008c25c9e
e3: enable simulated backed ( #7218 )
2023-03-30 02:53:06 +00:00
alex.sharov
f3ff8dd438
sqlite version up
2023-03-30 09:15:06 +07:00
Alex Sharov
417a437584
Break dependency of ethcfg package to core/consensus/etc... move genesis struct to 'types' package ( #7206 )
2023-03-29 07:27:06 +00:00
Giulio rebuffo
ab3a1d2ce5
Remove propagation of lightclient updates ( #7192 )
2023-03-27 22:42:40 +00:00
Alex Sharov
cff73b8aec
add constant kv.Unlim=-1 ( #7183 )
2023-03-26 03:18:04 +00:00
Alex Sharov
201572c6f5
enable more linters #954 ( #7179 )
2023-03-25 05:13:27 +00:00
Alex Sharov
7a51a29991
e3: DomainGetAsOf, DomainRange ( #7177 )
2023-03-25 03:51:43 +00:00
Alex Sharov
f4fb329c55
e3: remove some iterator ( #7174 )
2023-03-24 08:36:52 +00:00
Alex Sharov
e2c5984a12
attempt to finx bindtest ( #7167 )
2023-03-23 09:24:25 +00:00
alex.sharov
256bb1fcdb
CI v4
2023-03-23 13:21:46 +07:00
alex.sharov
dfc5f55f53
fix e3 test
2023-03-23 12:20:46 +07:00
Alex Sharov
9001f668a7
go 1.19 atomics ( #7164 )
2023-03-23 05:11:28 +00:00
Alex Sharov
09154c5be0
Go 1.18 drop ( #7159 )
2023-03-23 03:19:07 +00:00
Alex Sharov
223fcd178c
e3: domain range api simplify ( #7158 )
2023-03-22 07:36:03 +00:00
Alex Sharov
0ffaca865e
e3: unionKV limit ( #7157 )
2023-03-22 06:58:01 +00:00
Alex Sharov
753a680cbd
e3: union limit ( #7156 )
2023-03-22 06:38:04 +00:00
Alex Sharov
52cb720cdc
e3: remove settings table ( #7155 )
2023-03-22 05:21:17 +00:00
alex.sharov
8395c39670
domain: to use history api
2023-03-22 11:55:26 +07:00
Alex Sharov
28c1b1d50d
e4: to use serializev3 ( #7154 )
2023-03-22 04:53:49 +00:00
Giulio rebuffo
b129a9415e
Update go deps ( #7138 )
2023-03-19 20:13:53 +00:00
Giulio rebuffo
35a0ba571d
Banning peers sending bad gossip ( #7134 )
2023-03-18 19:45:53 +00:00
Alex Sharov
f027324f01
torrent: suppress some warning ( #7124 )
2023-03-17 03:53:35 +00:00
Alex Sharov
3da0df736f
grpc_middleware_up ( #7123 )
2023-03-17 03:33:59 +00:00
awskii
7cee93aa10
E4 metrics upd ( #7122 )
2023-03-17 00:38:38 +00:00
Alex Sharov
59bc028762
txpool: senders batch commit optimize ( #7118 )
2023-03-16 03:39:58 +00:00
Alex Sharov
157a380be7
e3: history no auto-increment ( #7097 )
2023-03-15 08:03:57 +00:00
alex.sharov
ec76e0c5c1
e3: less merge logs
2023-03-15 13:35:04 +07:00
alex.sharov
f6759518d6
don't show "block number" in txpool logs it confusing users
2023-03-15 11:27:03 +07:00
alex.sharov
94729b1e82
up goprotobuf
2023-03-15 10:26:44 +07:00
Alex Sharov
2ba3b084d7
torrent: don't cancel storage, because lib can't handle such error and can graceful-shutdown anyway ( #7102 )
2023-03-14 08:42:39 +00:00
Alex Sharov
0ef5c76d89
torrent lib version up to remove some warning log ( #7100 )
2023-03-14 07:50:00 +00:00
Alex Sharov
bbe56620a3
move more parts to lru2 ( #7098 )
2023-03-14 07:37:23 +00:00
hexoscott
efd541028c
read metrics config from yaml file ( #7089 )
2023-03-14 00:07:05 +00:00
Alex Sharov
f2d99f9d85
e3: split "changed keys" iterator to simplify ( #7086 )
2023-03-13 08:06:50 +00:00
alex.sharov
470547f07a
erigon-lib up
2023-03-13 11:07:21 +07:00
Alex Sharov
68f264675a
e3: simplify wal ( #7085 )
2023-03-13 02:35:18 +00:00
alex.sharov
2155147417
go mod tidy
2023-03-13 09:33:10 +07:00
Alex Sharov
a44e0afbd6
Downloader main loop wait on close ( #7082 )
2023-03-13 02:12:30 +00:00
alex.sharov
e3f0f99cef
save
2023-03-11 15:37:46 +07:00
awskii
a96293ae8a
e4: added some metrics to code ( #7078 )
2023-03-10 19:21:10 +00:00
Alex Sharov
570c3d65ab
up moq version, up some lru version ( #7069 )
2023-03-10 04:03:32 +00:00
Alex Sharov
d19fcd870b
e3: use iterators composition in invIndex.Range ( #7056 )
2023-03-09 02:26:40 +00:00
Stéphane Loeuillet
fd1a971384
graphql: add Tx Receipts Logs to output ( #7059 )
2023-03-09 02:22:41 +00:00
Alex Sharov
a158b63126
mdbx: RangeDupSort iterator ( #7054 )
2023-03-08 10:16:06 +00:00
Alex Sharov
92c444bc1a
--torrent.staticpeers ( #7052 )
2023-03-08 08:30:00 +00:00
alex.sharov
b48aeef8f1
save
2023-03-07 16:10:25 +07:00
Alex Sharov
34ebf6bbea
up grpc version ( #7043 )
2023-03-07 09:00:07 +00:00
Alex Sharov
b685407175
attempt to fix TestGolangBindings ( #7041 )
2023-03-07 06:14:35 +00:00
Alex Sharov
d4e25daf22
etl: distinct empty values from nil ( #7039 )
...
Reverts ledgerwatch/erigon#7038
2023-03-07 04:19:00 +00:00
Alex Sharov
7206e482da
Revert "etl: distinct empty values from nil" ( #7038 )
...
Reverts ledgerwatch/erigon#6934
2023-03-07 03:22:23 +00:00
Alex Sharov
c5acfd0503
etl: distinct empty values from nil ( #6934 )
2023-03-07 02:33:21 +00:00
hexoscott
77065ee0f3
remove PeerUseless calls ( #7032 )
2023-03-06 18:59:14 +00:00
ledgerwatch
1ab083316b
More block snapshots for ETH mainnet, goerli and gnosis ( #7026 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-03-06 08:58:58 +00:00
Giulio rebuffo
9101fdadcc
Long keys and finalization markers added. ( #7024 )
2023-03-05 19:15:17 +00:00
awskii
e48609ee8d
E4 btree-like indexes ( #6834 )
...
This branch implements support of btree indexes instead of .kvi files.
Kvi also created, but not used during search/lookup, only for size
comparation.
Btree allows to make seek calls, while recsplit indexes does not support
that query.
During initial tests, btree indexes are ~1-3% smaller than recsplit but
avg lookup time bigger up to 1.5us (which compensates with ability to
fetch next key).
BtAlloc
```
337000 searches, last took 5.417µs avg=4.385µs next_access_last[of 10000 keys] 105ns
338000 searches, last took 3.792µs avg=4.385µs next_access_last[of 10000 keys] 103ns
339000 searches, last took 5.125µs avg=4.386µs next_access_last[of 10000 keys] 103ns
340000 searches, last took 4.75µs avg=4.386µs next_access_last[of 10000 keys] 103ns
341000 searches, last took 3.875µs avg=4.386µs next_access_last[of 10000 keys] 104ns
342000 searches, last took 6.042µs avg=4.387µs next_access_last[of 10000 keys] 107ns
343000 searches, last took 3.209µs avg=4.388µs next_access_last[of 10000 keys] 108ns
344000 searches, last took 2.292µs avg=4.393µs next_access_last[of 10000 keys] 113ns
345000 searches, last took 2.417µs avg=4.394µs next_access_last[of 10000 keys] 106ns
346000 searches, last took 2.625µs avg=4.394µs next_access_last[of 10000 keys] 103ns
347000 searches, last took 4.417µs avg=4.397µs next_access_last[of 10000 keys] 104ns
348000 searches, last took 5.458µs avg=4.398µs next_access_last[of 10000 keys] 103ns
349000 searches, last took 4.875µs avg=4.4µs next_access_last[of 10000 keys] 102ns
350000 searches, last took 4.25µs avg=4.4µs next_access_last[of 10000 keys] 104ns
351000 searches, last took 6.25µs avg=4.403µs next_access_last[of 10000 keys] 106ns
352000 searches, last took 3.125µs avg=4.404µs next_access_last[of 10000 keys] 106ns
```
Recsplit
```
354000 searches, last took 1.209µs avg=3.081µs
355000 searches, last took 1.333µs avg=3.076µs
356000 searches, last took 1.541µs avg=3.071µs
357000 searches, last took 1.333µs avg=3.066µs
358000 searches, last took 1.333µs avg=3.062µs
359000 searches, last took 1.167µs avg=3.057µs
360000 searches, last took 1.791µs avg=3.052µs
361000 searches, last took 1.209µs avg=3.048µs
362000 searches, last took 1.375µs avg=3.043µs
363000 searches, last took 1.166µs avg=3.038µs
364000 searches, last took 1.625µs avg=3.033µs
365000 searches, last took 1.125µs avg=3.029µs
366000 searches, last took 1.208µs avg=3.024µs
367000 searches, last took 1.333µs avg=3.019µs
368000 searches, last took 1.791µs avg=3.015µs
369000 searches, last took 1.333µs avg=3.01µs
370000 searches, last took 1.166µs avg=3.006µs
371000 searches, last took 1.125µs avg=3.001µs
372000 searches, last took 1.333µs avg=2.997µs
```
https://github.com/ledgerwatch/erigon-lib/pull/891/files
2023-03-04 03:19:25 +00:00
Andrew Ashikhmin
1dab298db7
Add Prague fork support ( #7005 )
...
Prague is the next EL fork after
[Cancun](https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/cancun.md ).
This change picks up https://github.com/ledgerwatch/erigon-lib/pull/913 ,
adds support of the fork, and moves Verkle trees to it.
2023-03-02 17:51:36 +00:00
Alex Sharov
a4f69abb97
e3: less locks, less casts ( #6991 )
2023-03-01 07:59:56 +00:00
alex.sharov
4fd421a3f0
use correct mdbx version in go.mod
2023-03-01 13:13:57 +07:00
alex.sharov
85df06ca26
remove zstd dependency
2023-03-01 12:57:15 +07:00
Alex Sharov
8bffe4499b
e3: less wal locks ( #6971 )
2023-02-27 07:03:00 +00:00
Alex Sharov
1a141a6219
mdbx: more funcs ( #6961 )
2023-02-26 02:29:48 +00:00
Alex Sharov
fae889f815
e3: index readers pool ( #6954 )
2023-02-26 02:04:46 +00:00
Alex Sharov
2a8eec51bc
e3: eliasfano iterator.seek() ( #6944 )
2023-02-24 13:39:19 +00:00
Alex Sharov
58236d62bb
e3: optimize iterators, step1 ( #6937 )
2023-02-24 10:32:50 +07:00
Alex Sharov
97d6cd5c11
e3: more mainnet snapshots ( #6942 )
2023-02-24 10:29:50 +07:00
ledgerwatch
9c9449a059
Mock of Erigon support - step 1 ( #6930 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-02-22 12:38:22 +00:00
Alex Sharov
a19d1b59c5
Pool and RPCBlocksCache: to use generic lru ( #6928 )
2023-02-22 07:50:00 +00:00
Alex Sharov
be4f5cf078
mdbx: to support empty key/values #6923 ( #6927 )
2023-02-22 07:04:48 +00:00
Alex Sharov
7f0abb8250
downloader: suspend cancelation warning #899 ( #6926 )
2023-02-22 11:32:19 +07:00
Alex Sharov
309b4812d3
mdbx: to support empty key/values ( #6923 )
2023-02-22 04:10:57 +00:00
Alex Sharov
510993f09f
libp2p pubsub panic fix ( #6924 )
...
see: https://github.com/libp2p/go-libp2p-pubsub/pull/522
2023-02-22 03:07:17 +00:00
Stéphane Loeuillet
195a72bf74
Initial GraphQL interface implementation ( #6821 )
...
That's an initial PR mostly for code review, not ready for production
use
Got basic GraphQL working when querying a single block
---------
Co-authored-by: Alex Sharov <AskAlexSharov@gmail.com>
2023-02-20 11:23:06 +00:00
Alex Sharov
2b0d0d8811
EliasFano: Search to touch only UpperBits array ( #6904 )
2023-02-20 06:42:37 +00:00
Alex Sharov
c3325b989f
torrent lib version up ( #6903 )
2023-02-20 04:43:03 +00:00
dependabot[bot]
3b68ccd823
build(deps): bump golang.org/x/net from 0.6.0 to 0.7.0 ( #6896 )
...
Bumps [golang.org/x/net](https://github.com/golang/net ) from 0.6.0 to
0.7.0.
<details>
<summary>Commits</summary>
<ul>
<li><a
href="8e2b117aee547e7edf3839940adcaahttps://github.com/golang/net/compare/v0.6.0...v0.7.0 ">compare
view</a></li>
</ul>
</details>
<br />
[](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores )
Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)
- `@dependabot use these labels` will set the current labels as the
default for future PRs for this repo and language
- `@dependabot use these reviewers` will set the current reviewers as
the default for future PRs for this repo and language
- `@dependabot use these assignees` will set the current assignees as
the default for future PRs for this repo and language
- `@dependabot use this milestone` will set the current milestone as the
default for future PRs for this repo and language
You can disable automated security fix PRs for this repo from the
[Security Alerts
page](https://github.com/ledgerwatch/erigon/network/alerts ).
</details>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-18 10:29:20 +07:00
Giulio rebuffo
df1563b401
Passing all finality consensus-spec-tests for altair/bellatrix ( #6894 )
2023-02-17 17:57:05 +00:00
Alex Sharov
433f031db3
trackers up ( #6890 )
2023-02-17 02:38:25 +00:00
alex.sharov
349bdb7a4f
e3: less mainnet snapshots
2023-02-15 19:23:18 +07:00
alex.sharov
ada7ab2da8
e3: remove some snaps
2023-02-14 09:45:20 +07:00
Alex Sharov
999899d66d
e3: read files list from db ( #6833 )
2023-02-13 05:17:01 +00:00
Alex Sharov
d5bb42453a
Update lib-p2p to support golang 1.20 ( #6848 )
2023-02-12 11:23:33 +00:00
Alex Sharov
de17e82375
e3: reduce buildIndex ctx scope ( #6850 )
2023-02-12 16:24:39 +07:00
Alex Sharov
acd76ea520
e3: temporary remove semaphore ( #6849 )
2023-02-12 16:06:28 +07:00
ledgerwatch
ee83447fa1
CL lightclient to create memdb in the tmpdir which gets cleaned up on… ( #6829 )
...
… startup
---------
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-02-11 20:44:51 +00:00
Alex Sharov
c6f6aab542
e3: more mainnet snapshots ( #6839 )
2023-02-11 09:38:04 +07:00
Giulio rebuffo
1b862a7c31
Added processing of sync committee updates ( #6836 )
2023-02-10 16:17:12 +00:00
Alex Sharov
7c9f30d25b
e3: return list of e3 files by grpc ( #6827 )
2023-02-10 13:45:33 +07:00
Alex Sharov
983db55dc5
Downloader: "incomplete" markers are more important than "complete", so commit them with fsync ( #6825 )
2023-02-10 13:20:19 +07:00
Alex Sharov
98a8ca50fe
erigon3 snapshots version 3 ( #6811 )
2023-02-09 13:51:51 +07:00
Alex Sharov
c31824ee17
less logs ( #6813 )
2023-02-09 13:27:45 +07:00
Alex Sharov
ec52990c43
e3: Thread safe reopen folder ( #6810 )
2023-02-09 12:11:40 +07:00
Alex Sharov
a75a948beb
e3: MakeContext must not see garbage files (deleted, overlapped, etc...). make it cheaper. ( #6803 )
2023-02-08 12:50:47 +07:00
Giulio rebuffo
a585ae4894
Added Optimizations to Beacon state transition. ( #6792 )
2023-02-07 17:44:37 +01:00
Alex Sharov
4cae1b94e9
switch sentinel to native go errors ( #6782 )
2023-02-06 10:15:52 +07:00
Alex Sharov
dede1a2c9e
e3: more mergeFiles tests, refcnt for LocalityIndex ( #6765 )
2023-02-06 09:05:29 +07:00
ledgerwatch
bf24018205
Add support for eth/68 ( #6764 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
Co-authored-by: Alex Sharp <alexsharp@surfer-172-29-1-65-hotspot.internet-for-guests.com>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-02-01 22:21:31 +00:00
Anshal Shukla
b70e8d7955
fix race condition in snapshot_test ( #6761 )
...
The Read method of math package used in randomAddress function is not
thread safe, instead I've used crand package which is used by matic and
is a fork of thread safe crypto package.
2023-02-01 22:15:19 +00:00
Andrew Ashikhmin
afe8a84dc4
[erigon-lib] Fix index out of range in TxPool.best ( #6762 )
...
Pick up https://github.com/ledgerwatch/erigon-lib/pull/876
2023-02-01 16:48:13 +01:00
Alex Sharov
aaec53857f
e3: last reader to close/remove merged files (marked as canDelete) inside tx.Rollback() ( #6738 )
2023-02-01 15:44:13 +07:00
Alex Sharov
dfca60c054
e3: indices wal - to reuse etl collector ( #6757 )
2023-02-01 10:02:29 +07:00
Anshal Shukla
a4f8175136
Bor file structure updated ( #6167 )
...
Updated bor consensus folder structure
2023-01-31 14:00:57 +05:30
Giulio rebuffo
1436060fd8
added sync aggregate method for processing ( #6740 )
2023-01-30 14:39:56 +01:00
Alex Sharov
939587bdab
E3: small rename ( #6735 )
2023-01-29 10:58:17 +07:00
Alex Sharov
9287a2202b
e3: eth_getModifiedAccountsByNumber ( #6733 )
2023-01-29 10:10:39 +07:00
Alex Sharov
2998aa6386
e3: debug_accountRange ( #6726 )
2023-01-28 12:03:24 +07:00
Alex Sharov
6933b0d169
grpc minor version up ( #6724 )
2023-01-27 20:20:29 +07:00
Alex Sharov
5b703749bd
e3: ots underflow fixes ( #6721 )
2023-01-27 14:41:11 +07:00
Alex Sharov
171a965faa
e3: ots some underflow fixes ( #6720 )
2023-01-27 14:16:09 +07:00
Alex Sharov
b99e4abb3e
move math big constants to erigon-lib ( #6719 )
2023-01-27 11:39:34 +07:00
Andrew Ashikhmin
ee7fd4183d
Always penalize useless peers ( #6710 )
...
Should help us to drop useless peers on shadow forks and PoS chains in
general.
2023-01-26 14:14:20 +01:00
Andrew Ashikhmin
d12fda5cbd
Switch AccessList, IntrinsicGas, SafeAdd/Mul to erigon-lib ( #6709 )
...
Reduce code duplication.
2023-01-26 12:26:12 +01:00
Alex Sharov
30fefd1fe1
e3: trace_filter on iter ( #6707 )
2023-01-26 17:24:29 +07:00
Alex Sharov
79b42c9dc0
e3: ots_getContractCreator ( #6705 )
2023-01-26 16:34:52 +07:00
Alex Sharov
3aec07f4b4
e3: cleanup locality idx ( #6701 )
2023-01-26 10:41:32 +07:00
Alex Sharov
3067baf457
up interfaces version ( #6700 )
2023-01-26 09:42:36 +07:00
Andrew Ashikhmin
20a865b79f
Update gohashtree ( #6697 )
...
Should hopefully fix Issue #6682 (pick up
92b1d05ae9
2023-01-25 23:12:34 +01:00
Alex Sharov
82c478a419
e3: getLogs on iterators ( #6683 )
2023-01-25 16:29:41 +07:00
Alex Sharov
c28c96bea7
allow enable snapshot sync by cli flag ( #6693 )
2023-01-25 09:53:43 +07:00
alex.sharov
78f31019f6
e3: move txnum to erigon-lib
2023-01-22 20:05:01 +07:00
Alex Sharov
4fbbdf9186
e3: move txnum to erigon-lib ( #6663 )
2023-01-22 19:39:33 +07:00
Alex Sharov
0ee8c175d9
e3: simplify history reader ( #6659 )
2023-01-22 16:42:24 +07:00
Alex Sharov
dcb5c5c089
e3: ots_searchTransactionsBefore ( #6657 )
2023-01-22 15:36:51 +07:00
Alex Sharov
57b1bdd54c
e3: rename "stream" to "iter" ( #6651 )
2023-01-21 11:11:47 +07:00
Alex Sharov
2a9ae52c9e
grpc version up ( #6648 )
2023-01-21 10:58:16 +07:00
ledgerwatch
04539d5f92
Rollback mdbx to previous version ( #6643 )
...
To eliminate a probably cause of issues related to `tx.Put` and
`tx.Append` getting stuck
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-01-20 21:32:20 +00:00
Andrew Ashikhmin
9927ca3171
Unify Engine API V1 & V2 methods ( #6638 )
...
Reduce code duplication.
Prerequisite: https://github.com/ledgerwatch/erigon-lib/pull/841 .
2023-01-20 18:43:08 +01:00
Alex Sharov
b71725ecb3
e3: reverse/limited iterators, stream tooling ( #6637 )
2023-01-20 18:08:20 +07:00
alex.sharov
d6c330f91b
e3: remove last snapshot
2023-01-20 09:28:02 +07:00
alex.sharov
6c29cfcd6e
e3: more mainnet snapshots
2023-01-19 14:31:03 +07:00
Alex Sharov
0f573a9372
e3: more bsc snapshots ( #6623 )
2023-01-19 10:04:13 +07:00
ledgerwatch
83b74cbd18
Fix eth_getLogs ( #6621 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-01-18 23:41:22 +00:00
Andrew Ashikhmin
f151a52c0e
Withdrawal amount in GWei ( #6578 )
...
See https://github.com/ethereum/execution-apis/pull/354 &
https://github.com/ethereum/EIPs/pull/6325 .
Prerequisite: https://github.com/ledgerwatch/erigon-lib/pull/832 .
2023-01-17 11:22:08 +01:00
Alex Sharov
b248ffe738
e3: new goerli snapshots ( #6596 )
2023-01-17 15:06:21 +07:00
Alex Sharov
d317722aef
e3: storageRangeAt ( #6580 )
2023-01-17 14:16:36 +07:00
Alex Sharov
97a769cfc1
e3: increase some defaults ( #6592 )
2023-01-17 09:14:17 +07:00
hexoscott
7dcbfbc283
reference hash, address, and chain config from lib ( #6536 )
2023-01-13 18:12:18 +00:00
alex.sharov
5549b706ac
kv: paris merge stream
2023-01-13 11:37:05 +07:00
Alex Sharov
41e9356f61
e3: stream.ToBitamp() ( #6562 )
2023-01-12 09:58:21 +07:00
Alex Sharov
731569bbb7
e3: invalid txnum table ( #6540 )
2023-01-12 09:31:41 +07:00
Alex Sharov
de42ff09c0
Torrent: reduce network chunk, some routers are unhappy ( #6552 )
2023-01-11 13:31:14 +07:00
alex.sharov
0f03c622aa
STOP_AFTER_RECONSTITUTE=true
2023-01-11 10:16:31 +07:00
Alex Sharov
b299133e0f
e3: locality index, correct metadata size accounting ( #6550 )
2023-01-11 09:56:46 +07:00
alex.sharov
d8f6ca8485
Revert "mdbx: proper atomic close"
...
This reverts commit fa5cb45336
2023-01-10 13:19:50 +07:00
alex.sharov
fa5cb45336
mdbx: proper atomic close
2023-01-10 12:03:19 +07:00
Alex Sharov
7c2ed8e01f
mdbx: v0.12.3 ( #6521 )
2023-01-10 09:15:18 +07:00
Alex Sharov
f3636c2ad2
kv_temporal: 2nd key for domain ( #6533 )
2023-01-09 15:16:07 +07:00
ledgerwatch
e8287918ba
Gnosis block snapshots ( #6516 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-01-07 12:07:36 +00:00
Alex Sharov
3c7e6b114e
e3: locality index ( #6513 )
2023-01-07 12:31:00 +07:00
Alex Sharov
4c3bb1cca5
kv_temporal: DomainGet ( #6511 )
2023-01-06 14:27:54 +07:00
hexoscott
1a09dcbdb3
use set rather than slice for tracking yielded when mining ( #6488 )
...
make use of sets when tracking yielded transactions during mining
2023-01-02 13:00:08 +00:00
Alex Sharov
11637a5c7d
e3: force merge snapshots before reconst ( #6484 )
2023-01-02 10:10:48 +07:00
Alex Sharov
65b66d6be2
make clang happy ( #6482 )
2023-01-01 11:43:31 +07:00
Alex Sharov
4a9c871628
a bit rename 22 to v3 ( #6476 )
2022-12-30 21:53:42 +07:00
Alex Sharov
3ebd597912
up log version ( #6474 )
2022-12-30 20:31:17 +07:00
Alex Sharov
0b900e3004
coherent state cache: change btree type ( #6473 )
2022-12-30 19:47:46 +07:00
Alex Sharov
c04668d0ff
e3: agg cancel background jobs ( #6463 )
2022-12-29 15:04:07 +07:00
Alex Sharov
36fc6a3950
kv: db.ReadOnly() method #806 ( #6454 )
2022-12-28 12:48:57 +07:00
Alex Sharov
ba585f494b
torrent lib version up ( #6447 )
2022-12-27 12:54:00 +07:00
alex.sharov
17ea11e9a0
mdbx: fix set option error
2022-12-26 21:33:03 +07:00
Alex Sharov
fa6f6038e7
kv: tx.Prefix method ( #6441 )
2022-12-26 17:58:21 +07:00
Alex Sharov
ab6b4546f5
KV: tx.Range() with stream api ( #6437 )
2022-12-25 17:41:43 +07:00
Alex Sharov
2133a4fe17
KV: tx.Range() with stream api ( #6436 )
2022-12-25 17:40:07 +07:00
Alex Sharov
4e26f53a75
e3: return error from inline-apply ( #6427 )
2022-12-24 17:30:26 +07:00
Alex Sharov
ade933be6b
kv_remote: server to support thread-safe multi-streams per 1 tx ( #6402 )
2022-12-24 13:11:15 +07:00
Alex Sharov
d7404bc391
e3: correct bsc snapshots ( #6411 )
2022-12-23 13:06:48 +07:00
Giulio rebuffo
5fd3536ef0
Erigon-cl database schema ( #6399 )
2022-12-22 19:59:24 +01:00
Alex Sharov
d9b6c84f57
kv_remote: c.Count() ( #6403 )
2022-12-22 12:44:05 +07:00
Alex Sharov
130ab85bea
e3: kv/temporal prototype 3 ( #6395 )
2022-12-22 09:37:32 +07:00
Alex Sharov
2711e3a712
e3: verified mainnet snapshots ( #6387 )
2022-12-20 22:32:30 +07:00
Alex Sharov
cce0f251b4
e3: kv/temporal prototype 2 ( #6377 )
2022-12-20 09:28:10 +07:00
Alex Sharov
dfa6505f93
e3: kv/temporal prototype ( #6367 )
2022-12-19 15:38:54 +07:00
Alex Sharov
185141b184
e3: reconst MakeSteps - to check that files are indexed ( #6366 )
2022-12-19 10:27:39 +07:00
hexoscott
d4623ec9d7
mining updates around txpool yielding ( #6342 )
...
Co-authored-by: Alex Sharov <AskAlexSharov@gmail.com>
2022-12-18 08:45:03 +07:00
Alex Sharov
04999c3219
mdbx: relax a bit merge limit (still leave it stronger than default) ( #6350 )
2022-12-17 20:10:01 +07:00
Alex Sharov
8d32a00558
e3: increase default wal limit ( #6347 )
2022-12-17 16:55:57 +07:00
Andrew Ashikhmin
0fc2022a0e
Extend fork ID to timestamp-based forks ( #6324 )
...
Starting from
[Shanghai](https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/shanghai.md ),
forks are based on timestamps rather than block heights (see PR #6238 ).
This PR extends [EIP-2124](https://eips.ethereum.org/EIPS/eip-2124 ) Fork
ID to include timestamp-based blocks. See also
https://github.com/ethereum/go-ethereum/pull/25878 .
Co-authored-by: Marius van der Wijden <m.vanderwijden@live.de>
2022-12-16 12:08:54 +01:00
ledgerwatch
56e64fcb24
Change block snapshots ( #6338 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-12-16 08:38:02 +00:00
ledgerwatch
66c44a739e
Add another mainnet block snapshot range (15.5m - 16m) ( #6330 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-12-16 08:24:17 +00:00
Alex Sharov
b2bf12827c
e3: cancel background build ( #6323 )
2022-12-15 17:18:00 +07:00
Alex Sharov
863e1ed07b
e3: handle "kill -9" during merge, auto-hide history .ef file if not corresponding .v file ( #6304 )
2022-12-15 13:49:06 +07:00
Alex Sharov
ce9203d80d
e3: more aggressive prune #780 ( #6299 )
2022-12-14 09:50:48 +07:00
Alex Sharov
fed1be256c
e3: auto-remove useless files ( #6298 )
2022-12-14 09:03:16 +07:00
hexoscott
c0d2523b06
reset txpool yielded flags before starting mining ( #6284 )
2022-12-12 17:27:57 +07:00
ledgerwatch
1c3c486d00
Avoid using peers returning empty responses, not sending skeleton requests ( #6281 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-12-11 23:03:10 +00:00
ledgerwatch
4ab76849d8
Use old method of peer selection for non-POS networks ( #6279 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2022-12-11 15:14:49 +00:00
Alex Sharp
d8ae12b6fd
Revert "Add passive peer parameter"
...
This reverts commit 786179646b
2022-12-11 12:33:08 +00:00
Alex Sharp
786179646b
Add passive peer parameter
2022-12-11 12:32:47 +00:00
ledgerwatch
b5a7faa8db
[e3] Incremental reconstitution ( #6270 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-12-10 09:34:17 +00:00
Alex Sharov
b4fd07b671
e3: earlier flush ( #6227 )
2022-12-10 15:53:58 +07:00
hexoscott
47a6f86f76
use a shared simulated tx when mining ( #6253 )
...
This ensures that the filter bad transactions can use the same context
each time, so increases an account nonce in the first batch of
transactions is committed to the simulation just in case the same
account appears in the next batch of transactions.
Also makes use of the new txpool candidate functionality to ensure we're
getting fresh transactions each time.
2022-12-09 21:16:10 +07:00
Giulio rebuffo
0da12e4c94
Verification by root and not by slot ( #6243 )
2022-12-07 21:26:45 +01:00
Alex Sharov
554a21cf79
mdbx: runtime options are changeable in Ascedee mode ( #6232 )
2022-12-07 17:10:36 +07:00
Alex Sharov
43934c6f4a
mdbx: expose dirtySpace option ( #6231 )
2022-12-07 16:39:13 +07:00
Alex Sharov
79f259d902
mdbx bindings: remove txn.RawRead field #769 ( #6225 )
2022-12-07 13:08:48 +07:00
Alex Sharov
724e93a239
e3: no wal support ( #6224 )
2022-12-07 12:15:57 +07:00
Alex Sharov
002140daae
mdbx: add BeginRwAsync method ( #6221 )
2022-12-07 11:19:05 +07:00
alex.sharov
7788802e96
save
2022-12-07 10:32:06 +07:00
Giulio rebuffo
6e76643c09
Added Handshake protocol to Erigon-CL Lightclient and Fullclient ( #6206 )
2022-12-05 01:25:12 +01:00
Alex Sharov
e3085f9290
e3: experiment with btree "path hint" ( #6158 )
2022-12-04 18:15:28 +07:00
Alex Sharov
f9c8d556a5
log experiment enabling ( #6186 )
2022-12-03 12:56:44 +07:00
Alex Sharov
9b65c533c9
e3: optimize incremental hashstate ( #6179 )
2022-12-03 12:23:01 +07:00
hexoscott
09a01bc6a0
txpool to pull blocks of transactions until no gas remains for the block ( #6160 )
...
Moving the txpool transaction pull into the execution phase and looping
until the gas is used up or the txpool runs dry.
Removed the concept of local vs remote transactions as comments/code
showed this split was no longer in use.
Created a `PreparedTxs` collection to satisfy the use case in the
integration tool when mining is active.
Untested locally as I have no way of mining/validating currently.
Co-authored-by: Alex Sharov <AskAlexSharov@gmail.com>
2022-12-03 12:20:47 +07:00
alex.sharov
bae905b573
save
2022-12-02 18:41:36 +07:00
Andrew Ashikhmin
d82c778ab3
Withdrawals part 1 ( #6009 )
...
This PR partially implements
[EIP-4895](https://eips.ethereum.org/EIPS/eip-4895 ): Beacon chain push
withdrawals as operations. The new Engine API methods
(https://github.com/ethereum/execution-apis/pull/195 ) are implemented.
_Body downloader and saving withdrawals into DB are not implemented
yet!_
2022-12-01 09:15:01 +01:00
