Commit Graph

213 Commits

Author SHA1 Message Date
ledgerwatch
f2d93b959b
Introduce separate logging for etl functions (#998)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-05-18 19:55:02 +00:00
Alex Sharov
0e2883bf3f
LeakDetector: use it to find which resource was created but not closed (leaked) (#990) 2023-05-08 05:22:24 +00:00
alex.sharov
9a4582989a aggV3.rotate() unlock in defer to prevent deadlock 2023-05-05 11:08:37 +07:00
Alex Sharov
6e8c55239a
e3: log slow (unclosed) contexts to detect leaks (#979) 2023-04-24 05:52:21 +00:00
Alex Sharov
b1183da945
e3: remove files when no readers (#978) 2023-04-23 04:55:13 +00:00
alex.sharov
d2c9459ef6 clean 2023-04-21 10:49:30 +07:00
Alex Sharov
9cdea8f079
e3: remove garbage files (#977) 2023-04-21 02:49:49 +00:00
Alex Sharov
ba7424f435
e3: move staticFilesInRange method to ctx (#974) 2023-04-18 06:04:44 +00:00
Alex Sharov
1e2a52df39
e3: in-general merge must not see "overlaps/deleted" files, but merge of history need access to corresponding index files (even if they marked as deleted or already merged - before kill -9) (#972) 2023-04-17 05:54:15 +00:00
Alex Sharov
1cd35c810f
e3: print background indexing logs in e2 style (summary of all files progress in 1 line) (#965) 2023-04-05 04:49:05 +00:00
Alex Sharov
9431fe1b94
e3: history iterator shortcut fix (#960) 2023-03-30 02:51:59 +00:00
Alex Sharov
a4034d5cea
enable more linters (#954) 2023-03-25 05:13:20 +00:00
alex.sharov
7da125879b better context 2023-03-24 15:50:00 +07:00
Alex Sharov
71d01a8653
e3: remove some iterator (#952) 2023-03-24 08:36:54 +00:00
alex.sharov
e2b62447c7 clean 2023-03-24 11:02:11 +07:00
alex.sharov
f2e0f1ead4 clean 2023-03-24 10:58:33 +07:00
alex.sharov
e15093d30e fix test 2023-03-23 13:26:04 +07:00
alex.sharov
d7b01ea68f save 2023-03-23 12:19:17 +07:00
Alex Sharov
f110e80dab
go 1.19 atomics (#951) 2023-03-23 05:11:20 +00:00
alex.sharov
2d37194405 fix test 2023-03-23 10:18:00 +07:00
Alex Sharov
24a5f38a85
e3: unionKV limit (#948) 2023-03-22 06:58:07 +00:00
Alex Sharov
c2b85725c8
e3: union limit (#947) 2023-03-22 06:38:02 +00:00
alex.sharov
3c33211cda clean 2023-03-22 12:38:08 +07:00
Alex Sharov
39f1d090c6
e3: remove settings table (#946) 2023-03-22 05:21:11 +00:00
alex.sharov
dc74cf0404 less logs 2023-03-22 12:00:25 +07:00
alex.sharov
faf600b0f0 domain: to use history api 2023-03-22 11:54:26 +07:00
alex.sharov
ad12b79b50 e3: domain inline logging 2023-03-22 11:10:57 +07:00
alex.sharov
d029d2ef9e e3: test for DomainGC 2023-03-22 10:42:32 +07:00
awskii
0a4e293b4f
e4 speedup collate/prune (#944)
Continuing experiments on reducing time consumption of each aggregate
step.
2023-03-21 23:33:06 +00:00
awskii
08c5e41ea6
E4 metrics update (#939) 2023-03-16 23:59:24 +00:00
Alex Sharov
e143f7756f
e3: history no auto-increment (#935) 2023-03-15 06:47:48 +00:00
alex.sharov
59238cf44d e3: less merge logs 2023-03-15 13:34:13 +07:00
hexoscott
4493b598b9
read config yaml file to check for metrics being enabled (#909)
created to help with https://github.com/ledgerwatch/erigon/issues/6530
2023-03-14 00:07:27 +00:00
alex.sharov
ac75ffcda0 save 2023-03-13 19:07:50 +07:00
alex.sharov
f5faade958 save 2023-03-13 15:44:19 +07:00
Alex Sharov
b968398cbd
e3: split "changed keys" iterator to simplify (#933) 2023-03-13 08:06:37 +00:00
Alex Sharov
6f17999b1f
e3: simplify wal (#932) 2023-03-13 02:35:14 +00:00
awskii
9f522be0bb
E4 integrate state (#930)
minor refactoring of state/aggregator.
added simple aggregator metrics.
2023-03-10 19:20:47 +00:00
alex.sharov
c48bbde775 save 2023-03-09 14:56:13 +07:00
alex.sharov
3f4fdb9e20 remove NextBatch method 2023-03-09 09:37:55 +07:00
Alex Sharov
05d0018864
e3: use iterators composition in invIndex.Range( (#926) 2023-03-09 02:26:29 +00:00
alex.sharov
51698bfc97 more history tests 2023-03-08 10:18:58 +07:00
alex.sharov
565ab562a4 more history tests 2023-03-08 10:09:43 +07:00
Alex Sharov
44f8a908db
etl: distinct empty values from nil (#919)
Reverts ledgerwatch/erigon-lib#918
2023-03-07 04:19:08 +00:00
Alex Sharov
f0a051c44c
Revert "etl: distinct empty values from nil" (#918)
Reverts ledgerwatch/erigon-lib#902
2023-03-07 03:22:20 +00:00
Alex Sharov
f4a02864a9
etl: distinct empty values from nil (#902) 2023-03-07 02:30:45 +00:00
awskii
f645d8daf8
moved state tests to benchmarks/fuzz, speedup test run (#917) 2023-03-06 18:40:04 +00:00
awskii
32eddc9df4
E4 btree index (#914)
recreated branch from https://github.com/ledgerwatch/erigon-lib/pull/891
without fixups for windows tests
2023-03-03 18:32:03 +00:00
Alex Sharov
5edc0612ce
e3: close files (#912) 2023-03-02 05:05:34 +00:00
Alex Sharov
18a0f2bafa
e3: less locks (#911) 2023-03-01 07:59:54 +00:00