13 Commits

Author	SHA1	Message	Date
Alex Sharov	c3e1cfdac8	Pruning for: exec, log_index, tx_lookup, history stages (#2399) ... * Pruning for: exec, log_index, tx_lookup, history stages * Pruning for: exec, log_index, tx_lookup, history stages * Pruning for: exec, log_index, tx_lookup, history stages * Pruning for: exec, log_index, tx_lookup, history stages * add tvm flag * save * db migration for storage mode add flag --prune= remove flag --storage-mode= add flag --experiments=tevm,... rename integration set_storage_mode to set_prune * fix * forward move of stages must skip everything before PruneTo * keep in db progress of prune method * keep in db progress of prune method * simplify logs * simplify logs * simplify logs * fix test * simplify logs * simplify logs * simplify logs * simplify logs * remove callTraceSet as dupsort use etl transform for txlookup prune remove some logs * cleanup tests a bit * print_stages and eth_sync to show prune progress * fix print_stages * add readme about --prune.to flag * more docs * add --prune.history.older and other flags support * fix migration on empty db * better toString * better toString	2021-07-20 21:03:19 +01:00
Alex Sharov	a78cb54132	step towards kv interface (#2311)	2021-07-07 23:15:49 +07:00
Alex Sharov	bc271f92ce	To break dependency to db implementation - move all db classes to "ethdb/kv" and leave in "ethdb" only interfaces (#2195)	2021-06-19 15:21:53 +07:00
Alex Sharov	0be3044b7e	rename (#1978) ... * rename * rename "make grpc" * rename "abi bindings templates" * rename "abi bindings templates"	2021-05-20 19:25:53 +01:00
Alex Sharov	c7eedf0091	Add kv to stage settings (because it doesn't change in runtime, tx will be passed as Stage func argument) (#1872) ... * add kv to config * move forward tx use * move forward tx use * gc stat * gc stat * changeset writer - move to tx * clean * clean * clean * clean * clean	2021-05-04 13:36:03 +01:00
Alex Sharov	3af0b9b591	add hashstate, trie, history, logIndex stages (#1799) ... * add hashstate and trie stages * add history stages * add history stages * add history stages * add logindex stage * add logindex stage * add other stages	2021-04-25 09:29:39 +01:00
Alex Sharov	fbfc43da7e	etl to use rwtx (#1660)	2021-04-02 18:22:25 +07:00
b00ris	c03da8fb8e	Split header prefix bucket to headers, td and canonical (#1556) ... * split headers prefix * migration * fix downloader bug * test for migration * fix lint * uncomment t.Prallel * fix postprocessing test	2021-03-19 12:54:47 +00:00
Artem Vorotnikov	8c0ecaeea9	Remove StageData (#1419)	2020-12-21 11:01:37 +00:00
ledgerwatch	88acfc55ca	Vary batch size for execution stage (#1274) ... * Vary batch size for execution stage * Fix in logging * Improve log of timings * Log improvements * Log improvements * Fix tests * More log improvments, fix tests * Fix tests * Better logging for Bodies and Interhash * Fix tests * Minor fixes * Fix test	2020-10-21 18:01:40 +01:00
ledgerwatch	ed866e6934	non-concurrent ETL, debug_traceTransaction in rcpdaemon (#692) ... * Fixing history index * Remove chunk generation, fix formatting * Fix compile error, clean up hack.go * Fix output tests * Fix index generator test * Fixed checkChangeSets * Fix linter	2020-06-28 07:10:27 +01:00
Alex Sharov	57777e7c60	Prepare codebase for future default DB change (#670) ... * Add kv.tx.bucket.Clear() and db.ClearBuckets() methods * Add kv.tx.bucket.Clear() and db.ClearBuckets() methods * choose db based on file suffix * implement db.id method * implement db.id method * use ethdb.NewDatabase method * use ethb.MustOpen method * cleanup * support TEST_DB env flag * create db path automatically needed * bolt - don't change prefix on happy path	2020-06-16 14:36:16 +01:00
b00ris	b4ba764fb1	[WIP] TxLookup stage (#646) ... * save state * txlookup full results * save state * save state * remove experiments * some fix&lint * add end key to txLookup and index generation * change log message * change log * fix lint * lint * fix test	2020-06-10 23:07:14 +03:00