Commit Graph

188 Commits

Author SHA1 Message Date
alex.sharov
faf600b0f0 domain: to use history api 2023-03-22 11:54:26 +07:00
alex.sharov
ad12b79b50 e3: domain inline logging 2023-03-22 11:10:57 +07:00
alex.sharov
d029d2ef9e e3: test for DomainGC 2023-03-22 10:42:32 +07:00
awskii
0a4e293b4f
e4 speedup collate/prune (#944)
Continuing experiments on reducing time consumption of each aggregate
step.
2023-03-21 23:33:06 +00:00
awskii
08c5e41ea6
E4 metrics update (#939) 2023-03-16 23:59:24 +00:00
Alex Sharov
e143f7756f
e3: history no auto-increment (#935) 2023-03-15 06:47:48 +00:00
alex.sharov
59238cf44d e3: less merge logs 2023-03-15 13:34:13 +07:00
hexoscott
4493b598b9
read config yaml file to check for metrics being enabled (#909)
created to help with https://github.com/ledgerwatch/erigon/issues/6530
2023-03-14 00:07:27 +00:00
alex.sharov
ac75ffcda0 save 2023-03-13 19:07:50 +07:00
alex.sharov
f5faade958 save 2023-03-13 15:44:19 +07:00
Alex Sharov
b968398cbd
e3: split "changed keys" iterator to simplify (#933) 2023-03-13 08:06:37 +00:00
Alex Sharov
6f17999b1f
e3: simplify wal (#932) 2023-03-13 02:35:14 +00:00
awskii
9f522be0bb
E4 integrate state (#930)
minor refactoring of state/aggregator.
added simple aggregator metrics.
2023-03-10 19:20:47 +00:00
alex.sharov
c48bbde775 save 2023-03-09 14:56:13 +07:00
alex.sharov
3f4fdb9e20 remove NextBatch method 2023-03-09 09:37:55 +07:00
Alex Sharov
05d0018864
e3: use iterators composition in invIndex.Range( (#926) 2023-03-09 02:26:29 +00:00
alex.sharov
51698bfc97 more history tests 2023-03-08 10:18:58 +07:00
alex.sharov
565ab562a4 more history tests 2023-03-08 10:09:43 +07:00
Alex Sharov
44f8a908db
etl: distinct empty values from nil (#919)
Reverts ledgerwatch/erigon-lib#918
2023-03-07 04:19:08 +00:00
Alex Sharov
f0a051c44c
Revert "etl: distinct empty values from nil" (#918)
Reverts ledgerwatch/erigon-lib#902
2023-03-07 03:22:20 +00:00
Alex Sharov
f4a02864a9
etl: distinct empty values from nil (#902) 2023-03-07 02:30:45 +00:00
awskii
f645d8daf8
moved state tests to benchmarks/fuzz, speedup test run (#917) 2023-03-06 18:40:04 +00:00
awskii
32eddc9df4
E4 btree index (#914)
recreated branch from https://github.com/ledgerwatch/erigon-lib/pull/891
without fixups for windows tests
2023-03-03 18:32:03 +00:00
Alex Sharov
5edc0612ce
e3: close files (#912) 2023-03-02 05:05:34 +00:00
Alex Sharov
18a0f2bafa
e3: less locks (#911) 2023-03-01 07:59:54 +00:00
Alex Sharov
4d6d154bec
e3: less wal locks (#908) 2023-02-27 07:02:55 +00:00
Alex Sharov
d548f225b9
e3: index readers pool (#906) 2023-02-26 02:04:19 +00:00
Alex Sharov
c68d3c4ff8
eliasfano iterator.Seek() (#904) 2023-02-24 05:59:36 +00:00
Alex Sharov
70f4a28e0e
e3: optimize iterators, step1 (#903) 2023-02-24 03:31:10 +00:00
alex.sharov
d14c31f185 Revert "save"
This reverts commit 5679d509d2.
2023-02-21 09:11:12 +07:00
alex.sharov
5679d509d2 save 2023-02-21 09:07:42 +07:00
Alex Sharov
565acd3624
e3: read files list from db (#885) 2023-02-13 05:16:58 +00:00
Alex Sharov
e647e5fe3b
e3: reduce buildIndex ctx scope (#889) 2023-02-12 09:24:16 +00:00
Alex Sharov
e57fe47ffb
e3: temporary remove semaphore (#888) 2023-02-12 16:06:24 +07:00
Alex Sharov
3e933bc456
Downloader: "incomplete" markers are more important than "complete", so commit them with fsync (#883)
On power-off recent "no-sync" txs may be lost. It will cause 2. cases:
- Good piece on disk and recent "complete" db marker lost. Self-Heal by
re-download.
- Bad piece on dis and recent "incomplete" db marker lost. No Self-Heal.
So, can't afford loosing recent "incomplete" markers.
2023-02-10 13:20:13 +07:00
Alex Sharov
ef4e4e5402
less logs about compression (#882) 2023-02-09 12:28:07 +07:00
Alex Sharov
1b22208462
e3: Thread safe reopen folder (#881) 2023-02-09 12:11:36 +07:00
Alex Sharov
6254a32e4b
e3: MakeContext must not see garbage files (deleted, overlapped, etc...). make it cheaper. (#880) 2023-02-08 12:50:44 +07:00
Alex Sharov
9d7928f2d3
e3: to fix test (#879) 2023-02-06 09:54:30 +07:00
Alex Sharov
4344efa765
e3: more mergeFiles tests, refcnt for LocalityIndex (#878) 2023-02-03 19:14:34 +07:00
Alex Sharov
c6d823dae0
e3: last reader to close/remove merged files (marked as canDelete) inside tx.Rollback() (#869) 2023-02-01 15:44:11 +07:00
Alex Sharov
6f6764ee01
e3: indices wal - to reuse etl collector (#875) 2023-02-01 10:02:26 +07:00
Alex Sharov
ffc4dc71d6
E3 small rename3 (#868) 2023-01-29 11:32:26 +07:00
Alex Sharov
3e82f0fc87
e3: small rename (#867) 2023-01-29 10:56:01 +07:00
Alex Sharov
96db46b3ed
e3: small rename (#866) 2023-01-29 10:47:04 +07:00
Alex Sharov
bc136bd0f5
e3: eth_getModifiedAccountsByNumber (#865) 2023-01-29 10:10:28 +07:00
Alex Sharov
206fbadf9c
iter: filter tests (#862) 2023-01-28 12:03:20 +07:00
Alex Sharov
040fefda7b
e3: ots underflow fixes (#860) 2023-01-27 14:40:29 +07:00
Alex Sharov
3f234f90d0
e3: ots some underflow fixes (#859) 2023-01-27 14:16:08 +07:00
Alex Sharov
775989d068
move math big constants to erigon-lib (#858) 2023-01-27 11:39:38 +07:00