15 Commits

Author	SHA1	Message	Date
Alex Sharov	0feb7fd591	Decompressor.WithReadAhead (#290)	2022-02-01 11:19:11 +07:00
ledgerwatch	4e8840256e	[erigon2] Use shorter references instead of full plain keys in the commitment files (#289) ... * Rearrange aggregations * More rearranging before introducing 3 threads * Background aggregation| * Concurrency fixes * Remove files under lock * Better logging * Remove files without lock * Fix lint * Fix locking * Try * Fix background Merge * Log merging * Log merging * Less logging * Millisecond * Add Stats function * Log merge only after 1m * Wrong counting * plain key extract and replace functions * Insert valTransform function * Not parse first byte * Not parse first byte * Fix lint * Switch to thin state references * Fix lint * Fix lint * Debug print| * Fix decoding * Turn off valTransform * Not to reuse transformer * Print * Print * Print * Derive hashed keys later * Fix * Fix log * Fix * Debug * Another fix * Fix * Fix * Print * Print * Data race Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local> Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>	2022-01-31 22:32:00 +00:00
ledgerwatch	586ab3e6b3	Separate state btree files (#287) ... * Separate state file btrees, fix Match in the decompressor * fix match * Fix to match * Switch back from Match * Try to use match, close indices * Fixing Match * Use Skip Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>	2022-01-29 11:12:38 +00:00
primal_concrete_sledge	e69a5da702	Issue 248 refinements for decompressor api (#271) ... * issue/ISSUE-248-refinements_for_decompressor_api * Fix match tedst expectations * Remove unneeded comment	2022-01-24 09:18:08 +00:00
Alex Sharov	51220cfe43	ParallelCompressor class, DecompressedFile class (#234) ... * save * save * save * remove major jump check * remove major jump check * log * log * save * format docs * format docs * issue-260 * issue-260 * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save	2022-01-17 08:50:42 +00:00
Alex Sharov	f92c12855d	Decompressor: fast .Count method(#226)	2022-01-09 17:32:56 +07:00
Alex Sharov	2fe3f06702	Decompressor internal file path getter (#220)	2021-12-31 18:42:43 +07:00
Alex Sharov	583c3f9b5b	count in .seg (#212)	2021-12-21 10:45:20 +07:00
Alex Sharov	bb1d712834	Hack: dump bodies and headers (#177) ... * save * save * save * save	2021-11-19 22:00:55 +07:00
Alex Sharov	5b7f67deae	Snapshot naming (#163) ... * save * save * save * save * save * save	2021-11-15 14:19:56 +00:00
Alex Sharov	3a17502353	Compress: fix compress bytes share (#154) ... * fix compress bytes share * fix compress bytes share	2021-11-10 19:50:36 +07:00
Alex Sharov	d79f87a0e9	Recsplit: single offset bucket (#152)	2021-11-08 14:27:21 +07:00
alex.sharov	377bc94675	save	2021-11-08 07:59:18 +07:00
Alex Sharov	be8c96bbef	Use bufio limit in compressor (#151)	2021-11-07 14:32:01 +07:00
ledgerwatch	967937151d	Fixes for compress, decompressor, and tests (#110) ... * Fixes for compress, and first test * Add decompressor and memory mapping * Add decompressor and memory mapping * Fix for windows * Fix lint * Fix compile for windows * More on decompressor * Fix lint * Decompress * Fix lint * Use decompressor in tests, fixes * Introduce Index for RecSplit * Fix compilation on Windows * close index file on failure * Fixes to the tests * Add single Elias Fano, fix recsplit fuzz test * Fix elias fano * Add two layer index * Add two level index to the tests Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local> Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>	2021-10-16 10:43:41 +01:00