Alex Sharov
f05cd214bd
aggregator22: read dir without idx ( #638 )
2022-09-18 17:38:43 +07:00
ledgerwatch
10a15edebc
[erigon22] not to overwrite files after state reconstitution ( #642 )
...
* Print
* Skip finishTx
* Correct skip
* Fix
* Fix
* Remove print
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-09-16 08:34:11 +01:00
Alex Sharov
aad257bc0c
erigon22: skip tmp files by regexp ( #637 )
2022-09-13 16:01:41 +07:00
Alex Sharov
4858acfb2e
fix lint ( #632 )
2022-09-09 21:07:39 +07:00
Alex Sharov
4fea8e9ba2
erigon22: history iterator v3 #630
2022-09-08 14:01:32 +07:00
Alex Sharov
6db97dbe2d
enable some test ( #629 )
2022-09-08 11:19:32 +07:00
Alex Sharov
e6276aeea8
erigon22: history iterator v2 ( #628 )
2022-09-08 11:09:54 +07:00
Alex Sharov
c22f737b87
Erigon22: use history iterator #627
2022-09-07 15:57:28 +07:00
Alex Sharov
f8060aa75d
erigon22: HistoryIterator1 v1 ( #626 )
2022-09-07 14:40:39 +07:00
Alex Sharov
841fe604f9
erigon22: fix infinity loop #624
2022-09-06 13:56:07 +07:00
Alex Sharov
775ace2e37
erigon22: historyReader22 and more tests #623
2022-09-06 13:54:58 +07:00
Alex Sharov
e40691a4ad
history22: small renames #608
2022-08-29 11:07:10 +07:00
Alex Sharov
588519a33b
erigon22: recent history read ( #605 )
2022-08-28 11:25:53 +07:00
Alex Sharov
cfd14d0297
erigon22: step toward /tests
2022-08-25 15:31:59 +07:00
Andrew Ashikhmin
23c7f503e0
WithTablessCfg -> WithTableCfg ( #601 )
2022-08-24 11:02:47 +02:00
Alex Sharov
c7cf5b6530
clean ( #599 )
2022-08-22 15:56:18 +07:00
Alex Sharov
eab2010195
InvertedIndex don't loose last key ( #597 )
...
* save
* save
2022-08-22 15:45:59 +07:00
alex.sharov
36778a2db3
save
2022-08-22 10:33:14 +07:00
alex.sharov
abcfb230fc
save
2022-08-19 11:23:56 +07:00
Alex Sharov
d93972c581
domain: docs of tables format ( #595 )
2022-08-18 15:02:24 +07:00
Alex Sharov
0b4dcfb43d
erigon22: unwind code ( #591 )
...
* save
* save
2022-08-17 16:37:42 +07:00
Alex Sharov
59dfcc471c
erigon22: prune - check key existance ( #588 )
2022-08-15 14:33:32 +07:00
Alex Sharov
4945162dd7
erigon22: unwind code #587
2022-08-15 10:27:08 +07:00
ledgerwatch
e160c1ad9c
Optimise state erigon2.2 reconstitution ( #570 )
...
* Start iterator1
* No parallel buildFiles and mergeFiles
* Optimise GetNoState
* Fixes
* Fix 2
* Another fix
* Fix
* More changes iter
* Provide keys in ScanIterator
* Tables for bitmaps
* Add X tables
* Change signature of GeNoState
* More on changes iterator
* Test for changed keys iterator
* ReconDb tables
* Changed key iterator
* Fix lint
* Fix lint
* uncovert
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alex Sharp <alexsharp@alexs-mbp.lan>
2022-08-14 14:56:47 +01:00
Alex Sharov
404276494a
state22.Unwind() ( #586 )
2022-08-14 17:53:53 +07:00
Alex Sharov
0b68b61b52
fix for loop
2022-08-14 10:21:38 +07:00
Alex Sharov
27ce06026f
Aggregator22.Unwind() ( #584 )
2022-08-13 18:51:23 +07:00
Alex Sharov
95e94b2eb5
erigon22: optimize index.add ( #571 )
...
* save
* save
2022-08-09 10:28:29 +07:00
Alex Sharov
2be46669d5
Progress type ( #568 )
2022-08-04 12:31:17 +07:00
ledgerwatch
fadc9b21d1
[erigon2.2] Split 2.2 and 2.3 prototype ( #548 )
...
* Introduce access functions to history
* Add missing functions
* Add missing functions
* Add missing functions
* Changeover in the aggregator
* Intermediate
* Fix domain tests
* Fix lint
* Fix lint
* Fix lint
* Close files
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-07-28 08:47:13 +01:00
Alex Sharov
f9164fdc82
Log readable ( #556 )
...
* save
* save
* save
2022-07-27 12:09:07 +07:00
Alex Sharov
471d790348
kv.Del() remove second parameter ( #554 )
...
* save
* save
* save
* save
* save
* save
* save
* save
2022-07-26 12:47:08 +07:00
ledgerwatch
596d10ea2e
Split aggregator to 2.2 and 2.3 versions ( #539 )
...
* Split History from Domain
* Add History.prune
* More on history
* Fix HistoryHistory test
* Merge history files
* Scan file test for history
* Add aggregator for erigon 2.2
* Change to generics, introduce contexts
* Delete to belong to Aggregator
* Fix lint
* Fix lint
* Fix lint
* Fix lint
* Use pointers to InvertedIndex again
* Remove prints
* Close embedded InvertedIndex
* Fix closing files
* Print
* Update ci.yml
* More printing
* Fix
* Make InvertedIndex pointer inside History
* Fix
* Update ci.yml
* Remove print
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-07-23 09:06:52 +01:00
Alex Sharov
ebea2863c1
domain: files generic btree
2022-07-18 16:05:04 +07:00
ledgerwatch
9e7f22667e
[erigon2.2] FinishTx to aggregate with delay (to avoid MDBX panic) ( #513 )
...
* Add temporary table for Plain state reconstitution
* Add 2 more temp tables
* FinishTx with delay
* Fix search in history
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-07-06 06:42:40 +01:00
ledgerwatch
707a89842d
Add function to get history without state ( #501 )
...
* Add function to get history without state
* Add recon functions
* Expose endMinimax
* Recon prints
* Add NoState access methods
* MaxTxNum functions
* MaxTxNum functions
* MaxTxNum functions
* MaxTxNum functions
* History iterator
* Iterator
* history iterators to aggregator
* Print
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Print
* Print
* Print
* Fix
* Fix
* Fix
* Fix
* Fix
* Print
* Print
* Print
* Print
* Print
* Add stats
* Remove time measurement
* Contexts for thread safety
* Partial iterators
* Fix
* Fix
* Not use SkipUncompressed
* Print
* Print
* Pass empty vals
* Parallel bitmap collection
* Print
* ReconTx iterator
* ReconTx iterator
* ReconTx iterator
* ReconTx iterator
* Print
* Print
* Remove print
* Print
* Print
* Print
* Print
* Print
* Print
* Dedicated getter for Iterate
* For for storage 0
* Remove print
* do not perform unnecessary changes
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-07-02 19:38:34 +01:00
ledgerwatch
46bebb3317
[erigon2.2] Add ReadIndices aggregator to collect data ( #500 )
...
* [erigon2.2] Add ReadIndices aggregator to collect data
* Try
* Fix for history access
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-06-20 08:39:29 +01:00
ledgerwatch
234be664fc
Optimise history access for multiple files ( #498 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-06-18 22:54:36 +01:00
ledgerwatch
945b0e9e0f
Fix merge of code files ( #495 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-06-17 19:24:56 +01:00
ledgerwatch
df49481ddc
[erigon 2.2] Make keys always uncompressed, values compressed only for code ( #492 )
...
* Reduce allocations in domain and aggregator
* Make keys always uncompressed, values compressed only for code
* Functions to remake index
* Fix index recreation
* Test for reindex, fix
* Use uncompress vals in history
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-06-17 12:39:49 +01:00
ledgerwatch
bbf96d0580
Close compressor ( #491 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-06-14 22:38:18 +01:00
ledgerwatch
e2c6ef0058
[erigon2.2] Fixes for inverted indices and domains for the prototype ( #489 )
...
* Better control of compress/uncompressed
* Add new function
* more careful pruning
* Printf
* Printf
* Fix DupSort
* Remove copying in prune
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-06-13 19:32:13 +01:00
ledgerwatch
6cad65e62b
[erigon2.2] Parallel build files and merge, change file names ( #487 )
...
* Parallel build files and merge, change file names
* Update ci.yml
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-06-12 10:14:18 +01:00
ledgerwatch
45d4c21490
Expose inverted index ranges in aggregator ( #486 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-06-11 12:09:24 +01:00
ledgerwatch
7ce8bd589f
[erigon 2.2] Add functions for traces and event logs ( #485 )
...
* Add functions for traces and event logs
* Add functions for traces and event logs
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-06-10 06:51:00 +01:00
ledgerwatch
74ea75f9b8
[erigon2.2] Merge fixes, add historical access ( #482 )
...
* Merge fixes, add historical access
* Change API from AfterTxNum to BeforeTxNum
* Change API functions
* Change API functions
* Print
* Fix for non-existent items
* Remove prints
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-06-09 14:48:16 +01:00
ledgerwatch
a77e6425eb
Fixes for the Erigon 2 upgrade 2 prototype ( #479 )
...
* Print
* Remove print
* Remove print
* Fix one panic
* Fix duplicate collation
* Print
* Fix print
* fix maxSpan
* Reduce maxSpan
* Remove duplicate join
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-06-05 22:32:34 +01:00
ledgerwatch
f16b285631
Adjustments for erigon 2 upgrade prototype ( #477 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-06-05 16:34:38 +01:00
ledgerwatch
157b4299e4
[erigon2] Continuation on domains and inverted indices, putting things together ( #476 )
...
* Add scan files tests, create new aggregator type
* Fix lint
* windows test fix
* Add delelte test
* AggCollation
* More functions to Aggregator
* More aggregator functions
* Update
* More functions
* More functions
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-06-02 21:40:58 +01:00
ledgerwatch
c5a10975ab
[erigon2] Introduce inverted index type ( #473 )
...
* [erigon2] Introduce inverted index type
* More inverted index code
* More tests for inverted index
* Think about public and non-public APIs
* Minimise DB access when accessing history
* Work on iterator
* Implementation of inverted iterator
* Test for inverted index
* Assert end of iterators
* Merge of inverted index files and test
* Fix lint
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-05-31 18:42:04 +01:00
