14 Commits

Author	SHA1	Message	Date
Alex Sharov	689fc4effd	e3: background merge (#718)	2022-11-01 09:55:34 +07:00
Alex Sharov	24d530e307	e3: parallel exec, rotate and partial-flush of indices wal - while main thread is idle (#708)	2022-10-28 21:10:46 +07:00
Alex Sharov	725cd95865	E3: parallel exec, apply on roTx (#707)	2022-10-27 16:47:04 +07:00
Alex Sharov	12f8c4be0f	e3: parallel build missed indices (#693)	2022-10-21 13:31:03 +07:00
Alex Sharov	95433c2151	e3: write history and indices to etl (#683)	2022-10-15 08:21:15 +07:00
Alex Sharov	0eab2a3dd1	e3: prevent files ranges overlap (kill -9 during merge handle) (#674)	2022-10-12 10:18:51 +07:00
Alex Sharov	a63b054c1c	e3: prune limited amount before commit (#675)	2022-10-11 11:25:08 +07:00
Andrew Ashikhmin	23c7f503e0	WithTablessCfg -> WithTableCfg (#601)	2022-08-24 11:02:47 +02:00
Alex Sharov	eab2010195	InvertedIndex don't loose last key (#597) ... * save * save	2022-08-22 15:45:59 +07:00
ledgerwatch	e160c1ad9c	Optimise state erigon2.2 reconstitution (#570) ... * Start iterator1 * No parallel buildFiles and mergeFiles * Optimise GetNoState * Fixes * Fix 2 * Another fix * Fix * More changes iter * Provide keys in ScanIterator * Tables for bitmaps * Add X tables * Change signature of GeNoState * More on changes iterator * Test for changed keys iterator * ReconDb tables * Changed key iterator * Fix lint * Fix lint * uncovert Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local> Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local> Co-authored-by: Alex Sharp <alexsharp@alexs-mbp.lan>	2022-08-14 14:56:47 +01:00
ledgerwatch	fadc9b21d1	[erigon2.2] Split 2.2 and 2.3 prototype (#548) ... * Introduce access functions to history * Add missing functions * Add missing functions * Add missing functions * Changeover in the aggregator * Intermediate * Fix domain tests * Fix lint * Fix lint * Fix lint * Close files Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>	2022-07-28 08:47:13 +01:00
ledgerwatch	596d10ea2e	Split aggregator to 2.2 and 2.3 versions (#539) ... * Split History from Domain * Add History.prune * More on history * Fix HistoryHistory test * Merge history files * Scan file test for history * Add aggregator for erigon 2.2 * Change to generics, introduce contexts * Delete to belong to Aggregator * Fix lint * Fix lint * Fix lint * Fix lint * Use pointers to InvertedIndex again * Remove prints * Close embedded InvertedIndex * Fix closing files * Print * Update ci.yml * More printing * Fix * Make InvertedIndex pointer inside History * Fix * Update ci.yml * Remove print Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local> Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>	2022-07-23 09:06:52 +01:00
ledgerwatch	157b4299e4	[erigon2] Continuation on domains and inverted indices, putting things together (#476) ... * Add scan files tests, create new aggregator type * Fix lint * windows test fix * Add delelte test * AggCollation * More functions to Aggregator * More aggregator functions * Update * More functions * More functions Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local> Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>	2022-06-02 21:40:58 +01:00
ledgerwatch	c5a10975ab	[erigon2] Introduce inverted index type (#473) ... * [erigon2] Introduce inverted index type * More inverted index code * More tests for inverted index * Think about public and non-public APIs * Minimise DB access when accessing history * Work on iterator * Implementation of inverted iterator * Test for inverted index * Assert end of iterators * Merge of inverted index files and test * Fix lint Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local> Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>	2022-05-31 18:42:04 +01:00