Commit Graph

196 Commits

Author SHA1 Message Date
alex.sharov
d7b01ea68f save 2023-03-23 12:19:17 +07:00
Alex Sharov
f110e80dab
go 1.19 atomics (#951) 2023-03-23 05:11:20 +00:00
alex.sharov
2d37194405 fix test 2023-03-23 10:18:00 +07:00
Alex Sharov
24a5f38a85
e3: unionKV limit (#948) 2023-03-22 06:58:07 +00:00
Alex Sharov
c2b85725c8
e3: union limit (#947) 2023-03-22 06:38:02 +00:00
alex.sharov
3c33211cda clean 2023-03-22 12:38:08 +07:00
Alex Sharov
39f1d090c6
e3: remove settings table (#946) 2023-03-22 05:21:11 +00:00
alex.sharov
dc74cf0404 less logs 2023-03-22 12:00:25 +07:00
alex.sharov
faf600b0f0 domain: to use history api 2023-03-22 11:54:26 +07:00
alex.sharov
ad12b79b50 e3: domain inline logging 2023-03-22 11:10:57 +07:00
alex.sharov
d029d2ef9e e3: test for DomainGC 2023-03-22 10:42:32 +07:00
awskii
0a4e293b4f
e4 speedup collate/prune (#944)
Continuing experiments on reducing time consumption of each aggregate
step.
2023-03-21 23:33:06 +00:00
awskii
08c5e41ea6
E4 metrics update (#939) 2023-03-16 23:59:24 +00:00
Alex Sharov
e143f7756f
e3: history no auto-increment (#935) 2023-03-15 06:47:48 +00:00
alex.sharov
59238cf44d e3: less merge logs 2023-03-15 13:34:13 +07:00
hexoscott
4493b598b9
read config yaml file to check for metrics being enabled (#909)
created to help with https://github.com/ledgerwatch/erigon/issues/6530
2023-03-14 00:07:27 +00:00
alex.sharov
ac75ffcda0 save 2023-03-13 19:07:50 +07:00
alex.sharov
f5faade958 save 2023-03-13 15:44:19 +07:00
Alex Sharov
b968398cbd
e3: split "changed keys" iterator to simplify (#933) 2023-03-13 08:06:37 +00:00
Alex Sharov
6f17999b1f
e3: simplify wal (#932) 2023-03-13 02:35:14 +00:00
awskii
9f522be0bb
E4 integrate state (#930)
minor refactoring of state/aggregator.
added simple aggregator metrics.
2023-03-10 19:20:47 +00:00
alex.sharov
c48bbde775 save 2023-03-09 14:56:13 +07:00
alex.sharov
3f4fdb9e20 remove NextBatch method 2023-03-09 09:37:55 +07:00
Alex Sharov
05d0018864
e3: use iterators composition in invIndex.Range( (#926) 2023-03-09 02:26:29 +00:00
alex.sharov
51698bfc97 more history tests 2023-03-08 10:18:58 +07:00
alex.sharov
565ab562a4 more history tests 2023-03-08 10:09:43 +07:00
Alex Sharov
44f8a908db
etl: distinct empty values from nil (#919)
Reverts ledgerwatch/erigon-lib#918
2023-03-07 04:19:08 +00:00
Alex Sharov
f0a051c44c
Revert "etl: distinct empty values from nil" (#918)
Reverts ledgerwatch/erigon-lib#902
2023-03-07 03:22:20 +00:00
Alex Sharov
f4a02864a9
etl: distinct empty values from nil (#902) 2023-03-07 02:30:45 +00:00
awskii
f645d8daf8
moved state tests to benchmarks/fuzz, speedup test run (#917) 2023-03-06 18:40:04 +00:00
awskii
32eddc9df4
E4 btree index (#914)
recreated branch from https://github.com/ledgerwatch/erigon-lib/pull/891
without fixups for windows tests
2023-03-03 18:32:03 +00:00
Alex Sharov
5edc0612ce
e3: close files (#912) 2023-03-02 05:05:34 +00:00
Alex Sharov
18a0f2bafa
e3: less locks (#911) 2023-03-01 07:59:54 +00:00
Alex Sharov
4d6d154bec
e3: less wal locks (#908) 2023-02-27 07:02:55 +00:00
Alex Sharov
d548f225b9
e3: index readers pool (#906) 2023-02-26 02:04:19 +00:00
Alex Sharov
c68d3c4ff8
eliasfano iterator.Seek() (#904) 2023-02-24 05:59:36 +00:00
Alex Sharov
70f4a28e0e
e3: optimize iterators, step1 (#903) 2023-02-24 03:31:10 +00:00
alex.sharov
d14c31f185 Revert "save"
This reverts commit 5679d509d2.
2023-02-21 09:11:12 +07:00
alex.sharov
5679d509d2 save 2023-02-21 09:07:42 +07:00
Alex Sharov
565acd3624
e3: read files list from db (#885) 2023-02-13 05:16:58 +00:00
Alex Sharov
e647e5fe3b
e3: reduce buildIndex ctx scope (#889) 2023-02-12 09:24:16 +00:00
Alex Sharov
e57fe47ffb
e3: temporary remove semaphore (#888) 2023-02-12 16:06:24 +07:00
Alex Sharov
3e933bc456
Downloader: "incomplete" markers are more important than "complete", so commit them with fsync (#883)
On power-off recent "no-sync" txs may be lost. It will cause 2. cases:
- Good piece on disk and recent "complete" db marker lost. Self-Heal by
re-download.
- Bad piece on dis and recent "incomplete" db marker lost. No Self-Heal.
So, can't afford loosing recent "incomplete" markers.
2023-02-10 13:20:13 +07:00
Alex Sharov
ef4e4e5402
less logs about compression (#882) 2023-02-09 12:28:07 +07:00
Alex Sharov
1b22208462
e3: Thread safe reopen folder (#881) 2023-02-09 12:11:36 +07:00
Alex Sharov
6254a32e4b
e3: MakeContext must not see garbage files (deleted, overlapped, etc...). make it cheaper. (#880) 2023-02-08 12:50:44 +07:00
Alex Sharov
9d7928f2d3
e3: to fix test (#879) 2023-02-06 09:54:30 +07:00
Alex Sharov
4344efa765
e3: more mergeFiles tests, refcnt for LocalityIndex (#878) 2023-02-03 19:14:34 +07:00
Alex Sharov
c6d823dae0
e3: last reader to close/remove merged files (marked as canDelete) inside tx.Rollback() (#869) 2023-02-01 15:44:11 +07:00
Alex Sharov
6f6764ee01
e3: indices wal - to reuse etl collector (#875) 2023-02-01 10:02:26 +07:00