erigon-pulse/cmd/hack
ledgerwatch 0d34a5b9c5
[State sync experiment] Building dictionary for state file compression (#2721)
* Kasai experiments

* Use divsufsort instead of standard lib

* Refactor experiments, split dictionary building into chunks

* Fixes

* Estimate compression, sample

* More stats

* Parallelise

* Fix lint

* dictionary aggregator

* Actual replacement

* Fixes, separate dictionary processing

* Test file

* More correct dictionary, decompression

* Use dynamic programming to reduce dictionary

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-09-27 21:32:53 +01:00
..
db move kv to erigon-lib (#2467) 2021-07-29 18:53:13 +07:00
flow hide file exists err (#2218) 2021-06-22 11:09:45 +01:00
scripts Rename to Erigon (#2018) 2021-05-26 11:35:39 +01:00
tool Performance tests for ValidateHeaders on mainnet and rinkeby networks (#1489) 2021-02-11 16:36:22 +03:00
hack.go [State sync experiment] Building dictionary for state file compression (#2721) 2021-09-27 21:32:53 +01:00