Alex Sharov
44f8a908db
etl: distinct empty values from nil ( #919 )
...
Reverts ledgerwatch/erigon-lib#918
2023-03-07 04:19:08 +00:00
Alex Sharov
f0a051c44c
Revert "etl: distinct empty values from nil" ( #918 )
...
Reverts ledgerwatch/erigon-lib#902
2023-03-07 03:22:20 +00:00
Alex Sharov
f4a02864a9
etl: distinct empty values from nil ( #902 )
2023-03-07 02:30:45 +00:00
Alex Sharov
6f6764ee01
e3: indices wal - to reuse etl collector ( #875 )
2023-02-01 10:02:26 +07:00
Alex Sharov
f9074c989f
e3: build files sequentially ( #723 )
2022-11-02 09:44:40 +07:00
Alex Sharov
746b31def2
agg22 madv helpers ( #668 )
2022-10-05 13:17:23 +07:00
Håvard Anda Estensen
ad2344a6cc
Replace ioutil with io and os ( #560 )
2022-08-01 11:03:48 +07:00
Alex Sharov
a8ce14e8cc
option to disable runtime.ReadMemStats ( #457 )
...
* save
* save
* save
* save
2022-05-19 11:46:55 +07:00
Alex Sharov
8c4a3df7f1
etl: collector log level ( #385 )
2022-03-21 11:22:17 +07:00
ledgerwatch
c71ac02a0f
[erigon2] Optimisations in etl collector and compressor ( #339 )
...
* Optimisations in etl collector and compressor
* Not copy k and v in the collector
* Fix lint
* Optimisations
* Change Load1 back to Load
* Reduce allocations for tests
* preallocate inv
* counting hits and misses
* Try to fix
* Try to fix
* Relaxation 1
* Relaxation 2
* Add arch tables
* Fix
* Update arch tables and use them
* Not to override larger value
* Increase arch table size
* Increase arch table size
* Fixes to arch
* Print
* Off by one
* Print
* Fix
* Remove print
* Perform update of arch in the background
* Build up huffman tree
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-02-20 22:14:06 +00:00
Alex Sharov
3c4f8a759c
recsplit: reset offset collector, etl: faster flush and load ( #310 )
2022-02-10 14:40:24 +07:00
Alex Sharov
e649f7ea91
Less alloc etl recsplit ( #307 )
...
* less allocs recsplit
* save
* save
2022-02-09 13:22:45 +07:00
Alex Sharov
8791c5eb7a
Etl less allocs ( #263 )
...
* etl less allocs
* etl less allocs
* allow configure pagesize
2022-01-22 12:21:04 +07:00
Alex Sharov
0d5d8975d9
Snapshots: create .dat in tmpdir ( #225 )
2022-01-09 14:43:55 +07:00
Alex Sharov
52ef645c0c
ETL file names revert ( #147 )
2021-11-06 17:32:37 +07:00
Alex Sharov
3c86aa6290
ETL: use logPrefix as suffix of tmp files ( #146 )
2021-11-05 17:04:17 +07:00
Alex Sharov
8163e0cd93
Pool: cache based on txID ( #75 )
2021-09-17 09:56:04 +07:00
ledgerwatch
826f6ce377
Move ETL to erigon-lib ( #65 )
...
* Move ETL to erigon-lib
* Add coded
* Remove walk
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-09-11 16:11:41 +01:00