alex.sharov
c3c270fdf5
rawdb: txnums.Last
2023-03-10 15:14:03 +07:00
alex.sharov
25d913c676
better iter dup
2023-03-09 09:57:16 +07:00
Alex Sharov
05d0018864
e3: use iterators composition in invIndex.Range( ( #926 )
2023-03-09 02:26:29 +00:00
Alex Sharov
fd8122be5b
mdbx: RangeDupSort iterator ( #925 )
2023-03-08 10:16:04 +00:00
Alex Sharov
44f8a908db
etl: distinct empty values from nil ( #919 )
...
Reverts ledgerwatch/erigon-lib#918
2023-03-07 04:19:08 +00:00
Alex Sharov
f0a051c44c
Revert "etl: distinct empty values from nil" ( #918 )
...
Reverts ledgerwatch/erigon-lib#902
2023-03-07 03:22:20 +00:00
Alex Sharov
f4a02864a9
etl: distinct empty values from nil ( #902 )
2023-03-07 02:30:45 +00:00
Giulio rebuffo
a790ec764a
added finalized roots table ( #915 )
2023-03-05 18:28:54 +00:00
Alex Sharov
70f4a28e0e
e3: optimize iterators, step1 ( #903 )
2023-02-24 03:31:10 +00:00
ledgerwatch
fe85438cb4
kv/mdbx: Ability to list tables from read-only tx, and enumerate DBs open in a process ( #897 )
...
This is for the diagnostics project
---------
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-02-22 08:30:20 +00:00
Alex Sharov
cb8d3ec530
EliasFano: Search to touch only UpperBits array ( #895 )
2023-02-20 06:42:35 +00:00
Alex Sharov
565acd3624
e3: read files list from db ( #885 )
2023-02-13 05:16:58 +00:00
Maxim Andreev
ddf6c3bcf3
kv_mdbx: fix typo db.evn -> db.env ( #887 )
2023-02-12 18:20:50 +07:00
ledgerwatch
aa2b561741
Disallow memory db creation with empty tmpDir ( #886 )
...
It silently fills up `/tmp` directory with directories that never get
cleaned up and eventually cause trouble
---------
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-02-11 20:08:54 +00:00
Alex Sharov
db0e7ed112
e3: return list of e3 files by grpc ( #884 )
2023-02-10 14:16:39 +07:00
Alex Sharov
3e933bc456
Downloader: "incomplete" markers are more important than "complete", so commit them with fsync ( #883 )
...
On power-off recent "no-sync" txs may be lost. It will cause 2. cases:
- Good piece on disk and recent "complete" db marker lost. Self-Heal by
re-download.
- Bad piece on dis and recent "incomplete" db marker lost. No Self-Heal.
So, can't afford loosing recent "incomplete" markers.
2023-02-10 13:20:13 +07:00
Alex Sharov
6254a32e4b
e3: MakeContext must not see garbage files (deleted, overlapped, etc...). make it cheaper. ( #880 )
2023-02-08 12:50:44 +07:00
Alex Sharov
4344efa765
e3: more mergeFiles tests, refcnt for LocalityIndex ( #878 )
2023-02-03 19:14:34 +07:00
Alex Sharov
ffc4dc71d6
E3 small rename3 ( #868 )
2023-01-29 11:32:26 +07:00
Alex Sharov
bc136bd0f5
e3: eth_getModifiedAccountsByNumber ( #865 )
2023-01-29 10:10:28 +07:00
nanevardanyan
a1ac65bc07
kv: added transactionsV3 to the accessors config ( #864 )
2023-01-29 10:00:42 +07:00
Alex Sharov
206fbadf9c
iter: filter tests ( #862 )
2023-01-28 12:03:20 +07:00
Alex Sharov
775989d068
move math big constants to erigon-lib ( #858 )
2023-01-27 11:39:38 +07:00
Alex Sharov
4577ab4559
e3: trace_filter on iter ( #855 )
2023-01-26 17:24:26 +07:00
Alex Sharov
8861f19b11
e3: ots_getContractCreator ( #854 )
2023-01-26 16:34:57 +07:00
Alex Sharov
f62649c307
e3: getLogs on iterators ( #851 )
2023-01-25 16:29:23 +07:00
Alex Sharov
ad361943e6
e3: getLogs on iterators ( #849 )
2023-01-24 16:20:14 +07:00
Alex Sharov
559e60f1a3
e3: simplify history reader ( #846 )
2023-01-22 16:42:13 +07:00
Alex Sharov
ed2c64f5fb
e3: rename "stream" to "iter" ( #844 )
2023-01-21 11:11:30 +07:00
ledgerwatch
ac237028d0
Rollback MDBX upgrade ( #842 )
...
There is some circumstantial evidence that there are some regressions in
this version of MDBX, I would like to rollback to either remove these
regressions or at least eliminate one of the possible causes
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-01-20 20:11:58 +00:00
Alex Sharov
a705195fa0
e3: reverse/limited iterators, stream tooling ( #840 )
2023-01-20 18:08:22 +07:00
nanevardanyan
347633a8fb
kv: created EthTxV2 table with key that also contains block hash ( #838 )
...
Co-authored-by: Alex Sharov <AskAlexSharov@gmail.com>
2023-01-20 16:14:43 +07:00
ledgerwatch
ab20c39019
Fix eth_getLogs ( #839 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-01-18 23:20:12 +00:00
alex.sharov
1fb7e7ae77
simplify cursor2stream
2023-01-17 14:42:47 +07:00
alex.sharov
bfca37c869
simplify cursor2stream
2023-01-17 14:40:41 +07:00
alex.sharov
f09fa4a732
simplify cursor2stream
2023-01-17 14:32:56 +07:00
Alex Sharov
aaafab8fc0
e3: storageRangeAt ( #833 )
2023-01-17 14:16:33 +07:00
hexoscott
61706714c3
bringing hash, address, and chain config into lib ( #826 )
2023-01-13 15:52:38 +00:00
alex.sharov
7c475cb52e
save
2023-01-13 11:35:30 +07:00
Alex Sharov
120c4a20f4
e3: stream.ToBitamp() ( #831 )
2023-01-12 09:58:17 +07:00
Alex Sharov
16f4e2609b
e3: invalid txnum table ( #828 )
2023-01-12 09:31:29 +07:00
alex.sharov
63f3770aad
save
2023-01-12 09:13:15 +07:00
alex.sharov
a886ba0192
save
2023-01-11 09:54:16 +07:00
alex.sharov
6a8b53c105
save
2023-01-11 09:53:48 +07:00
alex.sharov
c82e38551a
save
2023-01-11 09:53:22 +07:00
alex.sharov
8f3178f2f2
Revert "mdbx: proper atomic close ( #827 )"
...
This reverts commit 493ae8b083
2023-01-10 13:20:01 +07:00
Alex Sharov
493ae8b083
mdbx: proper atomic close ( #827 )
2023-01-10 12:02:23 +07:00
Alex Sharov
d2d03d140b
mdbx: v0.12.3 ( #824 )
2023-01-10 09:15:04 +07:00
Alex Sharov
db2a25b1ae
kv_temporal: 2nd key for domain ( #825 )
2023-01-09 15:16:05 +07:00
Alex Sharov
ac40ca5269
e3: locality index ( #823 )
...
Mainnet:
```
447M accounts.0-544.l
45M accounts.0-544.li
133M code.0-544.l
14M code.0-544.li
2.0G storage.0-544.l
197M storage.0-544.li
```
Decided no to use Roaring - because it can only keep full bitmap in RAM
(no way to stream into file). But it's more compact 2Gb -> 1.4Gb. Maybe
can shard large bitmap - or do other trick (storage has 1B keys -
sharding probably is cheap). Maybe in the future.
2023-01-07 12:30:57 +07:00
