8 Commits

Author	SHA1	Message	Date
ledgerwatch	df49481ddc	[erigon 2.2] Make keys always uncompressed, values compressed only for code (#492) ... * Reduce allocations in domain and aggregator * Make keys always uncompressed, values compressed only for code * Functions to remake index * Fix index recreation * Test for reindex, fix * Use uncompress vals in history Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>	2022-06-17 12:39:49 +01:00
Alex Sharov	6f85066c7e	path -> filepath (path package is for urls) (#321)	2022-02-12 20:11:30 +07:00
primal_concrete_sledge	d8a33270e8	issue/issue-249-add_index_reader (#273) ... * issue/issue-249-add_index_reader * Add licence	2022-01-24 20:39:04 +00:00
Alex Sharov	8213f020f0	recsplit add MustOpen method (#138)	2021-10-31 09:38:10 +07:00
ledgerwatch	967937151d	Fixes for compress, decompressor, and tests (#110) ... * Fixes for compress, and first test * Add decompressor and memory mapping * Add decompressor and memory mapping * Fix for windows * Fix lint * Fix compile for windows * More on decompressor * Fix lint * Decompress * Fix lint * Use decompressor in tests, fixes * Introduce Index for RecSplit * Fix compilation on Windows * close index file on failure * Fixes to the tests * Add single Elias Fano, fix recsplit fuzz test * Fix elias fano * Add two layer index * Add two level index to the tests Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local> Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>	2021-10-16 10:43:41 +01:00
ledgerwatch	f2549ad6ec	Integration of recsplit (#79) ... * Integration of recsplit * Add tables * Print bucket by bucket * Not to print all keys * Print correct bitSize * switch to []byte * Optimisation * Fix * Fix lint * Performance improvements * Print bucket info * Add tracing * Fixed split Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local> Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>	2021-09-20 12:14:49 +01:00
ledgerwatch	312d43aa88	Recsplit encoding (#69) ... * Recsplit encoding * Added Golomb-Rice encoding * More on encoding * More * Fix compile errors * Fix fuzz test, add corpus * Integrated Elias-Fano * Fix lint * Add select64 * More * Add fuzz test for elias fano * Debugging elias fano * Fuzz test for elias fano * More elias fano debugging * Fix elias fano * More fixes * Fix to golombRiceLength Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local> Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>	2021-09-18 22:59:27 +01:00
ledgerwatch	6dce34ac32	Initial recsplit (#67) ... * Initial recsplit * Move licence * Fix bucket count and key count * Check for duplicate kwys * More recsplit implementation * Skeleton of recsplit, fuzz test * Fix lint Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local> Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>	2021-09-13 18:31:09 +01:00