Commit Graph

7 Commits

Author SHA1 Message Date
Alex Sharov
2bfb6d70bb
a bit more docs to etl #463 2022-05-24 11:37:27 +07:00
ledgerwatch
0497aa6aa2
ExtractEndKey should be exclusive bound in etl (#461)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-22 17:26:39 +01:00
Alex Sharov
a8ce14e8cc
option to disable runtime.ReadMemStats (#457)
* save

* save

* save

* save
2022-05-19 11:46:55 +07:00
ledgerwatch
c71ac02a0f
[erigon2] Optimisations in etl collector and compressor (#339)
* Optimisations in etl collector and compressor

* Not copy k and v in the collector

* Fix lint

* Optimisations

* Change Load1 back to Load

* Reduce allocations for tests

* preallocate inv

* counting hits and misses

* Try to fix

* Try to fix

* Relaxation 1

* Relaxation 2

* Add arch tables

* Fix

* Update arch tables and use them

* Not to override larger value

* Increase arch table size

* Increase arch table size

* Fixes to arch

* Print

* Off by one

* Print

* Fix

* Remove print

* Perform update of arch in the background

* Build up huffman tree

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-02-20 22:14:06 +00:00
Alex Sharov
ba51a5966a
etl.collector - move logPrefix to constructor (#128) 2021-10-25 09:12:00 +07:00
alex.sharov
379c101a50 better log 2021-10-13 09:33:52 +07:00
ledgerwatch
826f6ce377
Move ETL to erigon-lib (#65)
* Move ETL to erigon-lib

* Add coded

* Remove walk

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-09-11 16:11:41 +01:00