* added commitment to aggregator
* added commitment evaluation by updates, fixed mainnet roothash mismatch
* added ability to change starting state of hph
* replayable erigon23 with commitment
* possible fix for eliasfano index read after close
* fixed db pruning and restart
* Initial fixes
* Debug
* clear downHashedLen for branch nodes
* Fix key length, cleanup
* Cleanup
* Cleanup
* picked aggregator updates
* fixed empty cell hash for ProcessUpdate evaluation
* hashBuffer moved from Cell to HexPatriciaHashed
* fixed codeHash incorrect renewal
* lint
* removed valuemergefn from history
* fixed lint
* fixed test
* rewritten fuzz test on hph
* fix for Win tests - do not remove tmp dir after test
* win
* fixup after merge
* close aggregator after test
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
* Split History from Domain
* Add History.prune
* More on history
* Fix HistoryHistory test
* Merge history files
* Scan file test for history
* Add aggregator for erigon 2.2
* Change to generics, introduce contexts
* Delete to belong to Aggregator
* Fix lint
* Fix lint
* Fix lint
* Fix lint
* Use pointers to InvertedIndex again
* Remove prints
* Close embedded InvertedIndex
* Fix closing files
* Print
* Update ci.yml
* More printing
* Fix
* Make InvertedIndex pointer inside History
* Fix
* Update ci.yml
* Remove print
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Reduce allocations in domain and aggregator
* Make keys always uncompressed, values compressed only for code
* Functions to remake index
* Fix index recreation
* Test for reindex, fix
* Use uncompress vals in history
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Elias fano search and merge
* Add first cut of search
* Iterator and test
* Changes in aggregator
* Elias fano bitmap
* Fix uncompress decompress
* Print
* Print
* No print
* Print
* Print
* Print
* Change to AppendBytes
* Print
* Fix NextUncompressed
* Remove print
* Fix history search
* Fix in history search
* More tracing
* More tracing
* Fix
* Print
* Print key
* More print
* Print
* No deletion for history records
* Remove print
* Fix
* Fix
* Fix test
* Fix lint
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Optimisations in etl collector and compressor
* Not copy k and v in the collector
* Fix lint
* Optimisations
* Change Load1 back to Load
* Reduce allocations for tests
* preallocate inv
* counting hits and misses
* Try to fix
* Try to fix
* Relaxation 1
* Relaxation 2
* Add arch tables
* Fix
* Update arch tables and use them
* Not to override larger value
* Increase arch table size
* Increase arch table size
* Fixes to arch
* Print
* Off by one
* Print
* Fix
* Remove print
* Perform update of arch in the background
* Build up huffman tree
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Another fix for history files
* Half way through
* Another fix
* Correct closing sequence
* Remove first byte insert marker
* More on think commitments
* Fixes
* Fixes
* Print
* Skip touchMap
* Merge branchData from trees and from files
* Fill branch commitment
* Fill branch commitment
* Print
* Fix?
* Merge branchData when updating in the tree
* Better panic
* Prints
* Prints
* Prints
* Create complete branch data if it did not exist before
* Cleanup printing
* Fix merge
* Fix merge use
* Fix transform
* Better startBlock panic
* Preserve touchMap
* Merge commitments during aggregation
* Merge commitments during aggregation
* Merge commitments during aggregation
* Merge commitments during aggregation
* Merge commitments
* Merge commitments
* Merge commitments
* Merge commitments
* Merge commitments
* Merge commitments
* Merge commitments
* Include fieldbits during transform
* Fix history reads
* Print
* Print
* Prints
* Prints
* Prints
* Prints
* Prints
* Prints
* Prints
* Prints
* Prints
* Prints
* Prints
* Print largestMerge, lock files in branchFn
* Add storage lock
* Prints
* prefixLen fix
* prefixLen fix
* Fixes
* Remove print
* Remove print
* Set changesets and commitments flags upfront
* Logging instead of printing
* Fix history merge, recsplit panic
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
* corretly shutdown history goroutine
* Different final merge for history files
* Skip value
* Bitmap production bug
* Bitmap production bug
* Bitmap production bug
* Bitmap production bug
* Bitmap production bug
* Bitmap production bug
* Bitmap production bug
* Bitmap production bug
* Handle collision
* Handle collision
* Debug
* Debug
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
* State aggregator
* Compile fix
* More
* Add
* More
* More on aggregator
* Writes (still incorrect)
* Move table names
* More
* Start of aggregation
* Change files instead of db
* More on change files
* More
* More
* Dealing with state and change files
* More
* More
* More boilerplate
* More
* More
* Iteration over storage
* More boilerplate
* More fixes
* Insert flag
* More
* Unit test
* Add more to the test
* Expand the test a bit
* More testing
* Keep fixing the test
* More fixes to the test
* Clean up DB tables upon aggregation
* More fixes
* Remove update/insert indicator from returned values
* Add assertions
* close files before deleting
* close files before deleting
* close files before deleting
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
