Commit Graph

269 Commits

Author SHA1 Message Date
Alex Sharov
f110e80dab
go 1.19 atomics (#951) 2023-03-23 05:11:20 +00:00
Alex Sharov
0915811f47
e3: domain range api simplify (#949) 2023-03-22 07:35:58 +00:00
Alex Sharov
24a5f38a85
e3: unionKV limit (#948) 2023-03-22 06:58:07 +00:00
Alex Sharov
c2b85725c8
e3: union limit (#947) 2023-03-22 06:38:02 +00:00
Alex Sharov
39f1d090c6
e3: remove settings table (#946) 2023-03-22 05:21:11 +00:00
Alex Sharov
e143f7756f
e3: history no auto-increment (#935) 2023-03-15 06:47:48 +00:00
Jason Yellick
820840bbbb
Fix broken doc link (#934)
The [KV
Readme.md](https://github.com/ledgerwatch/erigon-lib/tree/main/kv#ethdbabstractkv-design)
currently references `dupsort.md` which is in the original Erigon repo,
so the link is broken. This simply fixes the reference to point back to
the main repo.

Co-authored-by: Jason Yellick <jason@enya.ai>
2023-03-14 15:43:07 +07:00
Alex Sharov
b968398cbd
e3: split "changed keys" iterator to simplify (#933) 2023-03-13 08:06:37 +00:00
alex.sharov
c3c270fdf5 rawdb: txnums.Last 2023-03-10 15:14:03 +07:00
alex.sharov
25d913c676 better iter dup 2023-03-09 09:57:16 +07:00
Alex Sharov
05d0018864
e3: use iterators composition in invIndex.Range( (#926) 2023-03-09 02:26:29 +00:00
Alex Sharov
fd8122be5b
mdbx: RangeDupSort iterator (#925) 2023-03-08 10:16:04 +00:00
Alex Sharov
44f8a908db
etl: distinct empty values from nil (#919)
Reverts ledgerwatch/erigon-lib#918
2023-03-07 04:19:08 +00:00
Alex Sharov
f0a051c44c
Revert "etl: distinct empty values from nil" (#918)
Reverts ledgerwatch/erigon-lib#902
2023-03-07 03:22:20 +00:00
Alex Sharov
f4a02864a9
etl: distinct empty values from nil (#902) 2023-03-07 02:30:45 +00:00
Giulio rebuffo
a790ec764a
added finalized roots table (#915) 2023-03-05 18:28:54 +00:00
Alex Sharov
70f4a28e0e
e3: optimize iterators, step1 (#903) 2023-02-24 03:31:10 +00:00
ledgerwatch
fe85438cb4
kv/mdbx: Ability to list tables from read-only tx, and enumerate DBs open in a process (#897)
This is for the diagnostics project

---------

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-02-22 08:30:20 +00:00
Alex Sharov
cb8d3ec530
EliasFano: Search to touch only UpperBits array (#895) 2023-02-20 06:42:35 +00:00
Alex Sharov
565acd3624
e3: read files list from db (#885) 2023-02-13 05:16:58 +00:00
Maxim Andreev
ddf6c3bcf3
kv_mdbx: fix typo db.evn -> db.env (#887) 2023-02-12 18:20:50 +07:00
ledgerwatch
aa2b561741
Disallow memory db creation with empty tmpDir (#886)
It silently fills up `/tmp` directory with directories that never get
cleaned up and eventually cause trouble

---------

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-02-11 20:08:54 +00:00
Alex Sharov
db0e7ed112
e3: return list of e3 files by grpc (#884) 2023-02-10 14:16:39 +07:00
Alex Sharov
3e933bc456
Downloader: "incomplete" markers are more important than "complete", so commit them with fsync (#883)
On power-off recent "no-sync" txs may be lost. It will cause 2. cases:
- Good piece on disk and recent "complete" db marker lost. Self-Heal by
re-download.
- Bad piece on dis and recent "incomplete" db marker lost. No Self-Heal.
So, can't afford loosing recent "incomplete" markers.
2023-02-10 13:20:13 +07:00
Alex Sharov
6254a32e4b
e3: MakeContext must not see garbage files (deleted, overlapped, etc...). make it cheaper. (#880) 2023-02-08 12:50:44 +07:00
Alex Sharov
4344efa765
e3: more mergeFiles tests, refcnt for LocalityIndex (#878) 2023-02-03 19:14:34 +07:00
Alex Sharov
ffc4dc71d6
E3 small rename3 (#868) 2023-01-29 11:32:26 +07:00
Alex Sharov
bc136bd0f5
e3: eth_getModifiedAccountsByNumber (#865) 2023-01-29 10:10:28 +07:00
nanevardanyan
a1ac65bc07
kv: added transactionsV3 to the accessors config (#864) 2023-01-29 10:00:42 +07:00
Alex Sharov
206fbadf9c
iter: filter tests (#862) 2023-01-28 12:03:20 +07:00
Alex Sharov
775989d068
move math big constants to erigon-lib (#858) 2023-01-27 11:39:38 +07:00
Alex Sharov
4577ab4559
e3: trace_filter on iter (#855) 2023-01-26 17:24:26 +07:00
Alex Sharov
8861f19b11
e3: ots_getContractCreator (#854) 2023-01-26 16:34:57 +07:00
Alex Sharov
f62649c307
e3: getLogs on iterators (#851) 2023-01-25 16:29:23 +07:00
Alex Sharov
ad361943e6
e3: getLogs on iterators (#849) 2023-01-24 16:20:14 +07:00
Alex Sharov
559e60f1a3
e3: simplify history reader (#846) 2023-01-22 16:42:13 +07:00
Alex Sharov
ed2c64f5fb
e3: rename "stream" to "iter" (#844) 2023-01-21 11:11:30 +07:00
ledgerwatch
ac237028d0
Rollback MDBX upgrade (#842)
There is some circumstantial evidence that there are some regressions in
this version of MDBX, I would like to rollback to either remove these
regressions or at least eliminate one of the possible causes

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-01-20 20:11:58 +00:00
Alex Sharov
a705195fa0
e3: reverse/limited iterators, stream tooling (#840) 2023-01-20 18:08:22 +07:00
nanevardanyan
347633a8fb
kv: created EthTxV2 table with key that also contains block hash (#838)
Co-authored-by: Alex Sharov <AskAlexSharov@gmail.com>
2023-01-20 16:14:43 +07:00
ledgerwatch
ab20c39019
Fix eth_getLogs (#839)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-01-18 23:20:12 +00:00
alex.sharov
1fb7e7ae77 simplify cursor2stream 2023-01-17 14:42:47 +07:00
alex.sharov
bfca37c869 simplify cursor2stream 2023-01-17 14:40:41 +07:00
alex.sharov
f09fa4a732 simplify cursor2stream 2023-01-17 14:32:56 +07:00
Alex Sharov
aaafab8fc0
e3: storageRangeAt (#833) 2023-01-17 14:16:33 +07:00
hexoscott
61706714c3
bringing hash, address, and chain config into lib (#826) 2023-01-13 15:52:38 +00:00
alex.sharov
7c475cb52e save 2023-01-13 11:35:30 +07:00
Alex Sharov
120c4a20f4
e3: stream.ToBitamp() (#831) 2023-01-12 09:58:17 +07:00
Alex Sharov
16f4e2609b
e3: invalid txnum table (#828) 2023-01-12 09:31:29 +07:00
alex.sharov
63f3770aad save 2023-01-12 09:13:15 +07:00