* Elias fano search and merge
* Add first cut of search
* Iterator and test
* Changes in aggregator
* Elias fano bitmap
* Fix uncompress decompress
* Print
* Print
* No print
* Print
* Print
* Print
* Change to AppendBytes
* Print
* Fix NextUncompressed
* Remove print
* Fix history search
* Fix in history search
* More tracing
* More tracing
* Fix
* Print
* Print key
* More print
* Print
* No deletion for history records
* Remove print
* Fix
* Fix
* Fix test
* Fix lint
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Optimisations in etl collector and compressor
* Not copy k and v in the collector
* Fix lint
* Optimisations
* Change Load1 back to Load
* Reduce allocations for tests
* preallocate inv
* counting hits and misses
* Try to fix
* Try to fix
* Relaxation 1
* Relaxation 2
* Add arch tables
* Fix
* Update arch tables and use them
* Not to override larger value
* Increase arch table size
* Increase arch table size
* Fixes to arch
* Print
* Off by one
* Print
* Fix
* Remove print
* Perform update of arch in the background
* Build up huffman tree
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Another fix for history files
* Half way through
* Another fix
* Correct closing sequence
* Remove first byte insert marker
* More on think commitments
* Fixes
* Fixes
* Print
* Skip touchMap
* Merge branchData from trees and from files
* Fill branch commitment
* Fill branch commitment
* Print
* Fix?
* Merge branchData when updating in the tree
* Better panic
* Prints
* Prints
* Prints
* Create complete branch data if it did not exist before
* Cleanup printing
* Fix merge
* Fix merge use
* Fix transform
* Better startBlock panic
* Preserve touchMap
* Merge commitments during aggregation
* Merge commitments during aggregation
* Merge commitments during aggregation
* Merge commitments during aggregation
* Merge commitments
* Merge commitments
* Merge commitments
* Merge commitments
* Merge commitments
* Merge commitments
* Merge commitments
* Include fieldbits during transform
* Fix history reads
* Print
* Print
* Prints
* Prints
* Prints
* Prints
* Prints
* Prints
* Prints
* Prints
* Prints
* Prints
* Prints
* Print largestMerge, lock files in branchFn
* Add storage lock
* Prints
* prefixLen fix
* prefixLen fix
* Fixes
* Remove print
* Remove print
* Set changesets and commitments flags upfront
* Logging instead of printing
* Fix history merge, recsplit panic
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
* corretly shutdown history goroutine
* Different final merge for history files
* Skip value
* Bitmap production bug
* Bitmap production bug
* Bitmap production bug
* Bitmap production bug
* Bitmap production bug
* Bitmap production bug
* Bitmap production bug
* Bitmap production bug
* Handle collision
* Handle collision
* Debug
* Debug
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
* State aggregator
* Compile fix
* More
* Add
* More
* More on aggregator
* Writes (still incorrect)
* Move table names
* More
* Start of aggregation
* Change files instead of db
* More on change files
* More
* More
* Dealing with state and change files
* More
* More
* More boilerplate
* More
* More
* Iteration over storage
* More boilerplate
* More fixes
* Insert flag
* More
* Unit test
* Add more to the test
* Expand the test a bit
* More testing
* Keep fixing the test
* More fixes to the test
* Clean up DB tables upon aggregation
* More fixes
* Remove update/insert indicator from returned values
* Add assertions
* close files before deleting
* close files before deleting
* close files before deleting
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
* Fixes for compress, and first test
* Add decompressor and memory mapping
* Add decompressor and memory mapping
* Fix for windows
* Fix lint
* Fix compile for windows
* More on decompressor
* Fix lint
* Decompress
* Fix lint
* Use decompressor in tests, fixes
* Introduce Index for RecSplit
* Fix compilation on Windows
* close index file on failure
* Fixes to the tests
* Add single Elias Fano, fix recsplit fuzz test
* Fix elias fano
* Add two layer index
* Add two level index to the tests
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
* not allocate count
* Print timings
* More time measurement
* See time with fanout=2
* Less branching?
* Revert
* Split functions for fingeprint and bucket separation
* Save indices
* Fix limits
* Use original split formula
* Revert
* uint16
* Correctly measure 2
* Less branching again?
* No time measurements
* Cleanup
* Fix lint
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Recsplit encoding
* Added Golomb-Rice encoding
* More on encoding
* More
* Fix compile errors
* Fix fuzz test, add corpus
* Integrated Elias-Fano
* Fix lint
* Add select64
* More
* Add fuzz test for elias fano
* Debugging elias fano
* Fuzz test for elias fano
* More elias fano debugging
* Fix elias fano
* More fixes
* Fix to golombRiceLength
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
