Commit Graph

18 Commits

Author SHA1 Message Date
ledgerwatch
f2d93b959b
Introduce separate logging for etl functions (#998)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-05-18 19:55:02 +00:00
Alex Sharov
1cd35c810f
e3: print background indexing logs in e2 style (summary of all files progress in 1 line) (#965) 2023-04-05 04:49:05 +00:00
Alex Sharov
a4034d5cea
enable more linters (#954) 2023-03-25 05:13:20 +00:00
awskii
08c5e41ea6
E4 metrics update (#939) 2023-03-16 23:59:24 +00:00
awskii
f645d8daf8
moved state tests to benchmarks/fuzz, speedup test run (#917) 2023-03-06 18:40:04 +00:00
awskii
32eddc9df4
E4 btree index (#914)
recreated branch from https://github.com/ledgerwatch/erigon-lib/pull/891
without fixups for windows tests
2023-03-03 18:32:03 +00:00
Alex Sharov
565acd3624
e3: read files list from db (#885) 2023-02-13 05:16:58 +00:00
Alex Sharov
3e933bc456
Downloader: "incomplete" markers are more important than "complete", so commit them with fsync (#883)
On power-off recent "no-sync" txs may be lost. It will cause 2. cases:
- Good piece on disk and recent "complete" db marker lost. Self-Heal by
re-download.
- Bad piece on dis and recent "incomplete" db marker lost. No Self-Heal.
So, can't afford loosing recent "incomplete" markers.
2023-02-10 13:20:13 +07:00
Alex Sharov
1b22208462
e3: Thread safe reopen folder (#881) 2023-02-09 12:11:36 +07:00
Alex Sharov
c6d823dae0
e3: last reader to close/remove merged files (marked as canDelete) inside tx.Rollback() (#869) 2023-02-01 15:44:11 +07:00
Alex Sharov
d2603c5730
use in-mem db in tests (#800) 2022-12-23 14:34:14 +07:00
Alex Sharov
67815f5faa
e3: handle "kill -9" during merge, auto-hide history .ef file if not corresponding .v file (#781) 2022-12-15 13:49:03 +07:00
Alex Sharov
14ceff26c3
tests speedup (#751) 2022-12-01 14:45:03 +07:00
awskii
229b08146b
[WIP] E4 commitment keys replace (#684)
basic implementation of replacing account and storage keys encoded in
commitment branches
2022-11-21 07:39:30 +00:00
Alex Sharov
12f8c4be0f
e3: parallel build missed indices (#693) 2022-10-21 13:31:03 +07:00
Alex Sharov
95433c2151
e3: write history and indices to etl (#683) 2022-10-15 08:21:15 +07:00
awskii
d0efd3c1ca
E3/4 restore state and commitment fix (#670)
- Fixed commitment issues both erigon3/erigon4
- get back update-based commitments approach
- partially fixed state seeking
2022-10-11 07:24:25 +01:00
Artem Tsebrovskiy
4f5232504f
E3 agg commitment (#647)
* added commitment to aggregator

* added commitment evaluation by updates, fixed mainnet roothash mismatch

* added ability to change starting state of hph

* replayable erigon23 with commitment

* possible fix for eliasfano index read after close

* fixed db pruning and restart

* Initial fixes

* Debug

* clear downHashedLen for branch nodes

* Fix key length, cleanup

* Cleanup

* Cleanup

* picked aggregator updates

* fixed empty cell hash for ProcessUpdate evaluation

* hashBuffer moved from Cell to HexPatriciaHashed

* fixed codeHash incorrect renewal

* lint

* removed valuemergefn from history

* fixed lint

* fixed test

* rewritten fuzz test on hph

* fix for Win tests - do not remove tmp dir after test

* win

* fixup after merge

* close aggregator after test

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-09-26 15:59:24 +01:00