17 Commits

Author	SHA1	Message	Date
Alex Sharov	e304418d5a	MatchPrefix: working version (#456)	2022-05-18 14:36:01 +07:00
Alex Sharov	b4776607dc	MatchPrefix: don't compare if prefix longer than word (#455) ... * save * save * save * save * save * fd	2022-05-18 10:29:19 +07:00
Alex Sharov	a86660187d	Test: support of nil value for prefixMatch (#450) ... * save * save * save * save	2022-05-16 20:59:29 +01:00
ledgerwatch	f18e05186d	Compact huffman representation in files (#414) ... * More compact huffman represenation * Intermediate * Intermediate * fix * Fix lint * Fix lint * Fix lint * Change min file size Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local> Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>	2022-04-13 12:55:15 +01:00
Alex Sharov	75b64f01a3	compressor: log lvl #408	2022-04-01 10:44:25 +07:00
Alex Sharov	83951a1d62	Enable more linters (#381)	2022-03-19 11:38:37 +07:00
ledgerwatch	f93ea948d0	[erigon2] Optimise Huffman decoder (#374) ... * Update * Intermediate * Huffman decoding * Fix lint Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local> Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>	2022-03-18 09:10:18 +00:00
Alex Sharov	6512e3c941	add emptyWordsCount field to .seg file header (breaking .seg format) (#355) ... * up torrent * save * save * save * save * save * save * save	2022-03-10 07:48:37 +00:00
ledgerwatch	75b52ac25e	[compress] Allow uncompressed words (#350) ... * Intermediate work * Allow uncompressed words * Fix * Fix tests * Add NextUncompressed, remove g.word buffer * Code simplifications, no goroutines when workers == 1 * Fix lint| * Add test for MatchPrefix * Work on patricia * Beginning of new matcher * Fuzz test for new longest match * No skip * Fixes * Fixes * More tracing * Fixes * Fixes * Change back to old FindLongestMatches * Switch to old match finder * Print mismatches * Fix * After fix * After fix * After fix * Print pointers * Fixes and tests * Print * Print * Print * More tests * Intermediate * Fix * Fix * Prints * Fix * Fix * Initialise matchStack * Compute only once * Compute only once * Switch back * Switch to old Find * Introduce sais * Switch patricia to sais * Use sais in compressor * Use sais in compressor * Remove unused code Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local> Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>	2022-03-09 17:25:22 +00:00
Alex Sharov	6f85066c7e	path -> filepath (path package is for urls) (#321)	2022-02-12 20:11:30 +07:00
Alex Sharov	dfdf7c8a66	[wip] parallel compress: less read of dat file (#284) ... * save * save * save	2022-01-27 17:13:26 +07:00
primal_concrete_sledge	e69a5da702	Issue 248 refinements for decompressor api (#271) ... * issue/ISSUE-248-refinements_for_decompressor_api * Fix match tedst expectations * Remove unneeded comment	2022-01-24 09:18:08 +00:00
Alex Sharov	0f80e9941f	Switch to parallel compressor (#244)	2022-01-18 12:55:20 +07:00
alex.sharov	4398d3f8da	save	2021-11-08 10:35:30 +07:00
alex.sharov	377bc94675	save	2021-11-08 07:59:18 +07:00
Alex Sharov	ba51a5966a	etl.collector - move logPrefix to constructor (#128)	2021-10-25 09:12:00 +07:00
ledgerwatch	967937151d	Fixes for compress, decompressor, and tests (#110) ... * Fixes for compress, and first test * Add decompressor and memory mapping * Add decompressor and memory mapping * Fix for windows * Fix lint * Fix compile for windows * More on decompressor * Fix lint * Decompress * Fix lint * Use decompressor in tests, fixes * Introduce Index for RecSplit * Fix compilation on Windows * close index file on failure * Fixes to the tests * Add single Elias Fano, fix recsplit fuzz test * Fix elias fano * Add two layer index * Add two level index to the tests Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local> Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>	2021-10-16 10:43:41 +01:00