ledgerwatch
|
e5692d1726
|
Various fixes to staged sync and experiments (#608)
* First commit
* Fix the one-off error
* Fix formatting
* Ability to execute stage5 separately
* Clean up intermediate hashes and stage5 progress
* Fix linter
* Print original keys when extracting
* channel
* More logging
* More logging
* Remove excess logging
* fix stage2
* Revert
* Fix stage2
* Add provider exhausted
* Sort sortable buffer
* Fix test
* Another cleanup
* Remove exhaust log
|
2020-06-03 13:03:40 +01:00 |
|
Igor Mandrigin
|
c16d3da1b4
|
etl: startkey for Load + OnLoadCommit callback (#601)
|
2020-06-01 17:14:40 +03:00 |
|
ledgerwatch
|
7ab10c85af
|
Separate Collector pattern out of ETL, hash collector for rebuilding Intermediate Hashes (#597)
* Introduce hashCollector
* Add HashCollector to SubTrieLoader
* Fix linter
* Reset hashed state
* Not to regenerate the hashed state
* Not to delete state
* Fix linter
* Print expected hash in the beginning
* Simplify
* Remove initialTrie
* Use etl to buffer intermediate hashes
* Copy values, not insert empty key
* Compress instead of decompress
* Enhance file buffer logging, fix linter
* Fix compile errors
* Fix log
* Fix logging
* Exclude zero key again
* Add rewind
* Restrict timestamps
* Fix
* Fix formatting
* Incorporate separation
* Extract identityLoadFunction
* Fix formatting
|
2020-05-31 13:23:34 +01:00 |
|
Igor Mandrigin
|
786561e65e
|
don't write files if all data fits into one buffer. (#594)
|
2020-05-31 08:32:33 +01:00 |
|
b00ris
|
266f9a5208
|
Plain state index (#595)
* plain state indexes
* generalize index generation&tests
* add plain state tests
* fix regenerate index
* сoncurrent changeset chunks processing
* remove concurrency
* fix lint
* remove comments
* add test to truncate
* fix conflicts
* fmt
* remove shadowing
|
2020-05-31 07:57:47 +01:00 |
|
Evgeny Danilenko
|
32ec443572
|
Restore graceful shutdown (#591)
* initial
* gracefull shutdown for staged
* more wg fixes
* fmt
* linters
* remove generalization
* linters
* linters
* fix
* fix
* fmt
* quit into etl
* after CR
* after CR
|
2020-05-30 16:44:54 +03:00 |
|
Igor Mandrigin
|
ebe7aec14e
|
Generalize "insert into DB though sorted files" pattern. (#592)
|
2020-05-30 10:00:35 +03:00 |
|