10 Commits

Author	SHA1	Message	Date
b00ris	4ebade3583	Add sync by bittorrent snapshots (#1160) ... * save state * torrent experiments * torrent experiment passed * fixes after merge * snapshot headers processing passed * save state * save state * download headers works after snapshot processing * save state * save state * save state * save state * add lazy load tx to snapshots, increase number of trackers * save state * speedup getting info * change logging * move to turbo package * save state * save state * save state * cleanup * save state * add test test * save state * lmdb debugging * fix readonly mode * save state * fix build * sync works * save state * save state * save state * allow cmd stages stageSenders use snapshots * debugging failed hashing * remove experimental tests * remove torrent experimental tests * fix lint * extract snapshot wrapper * metainfo checker * add remote seeder * add logs * update gomod * remove useless code * fix lint&remove useless code * extract verify snapshot to separated command * skip debug test * fix test * change type of seedSnapshot flag * add eth logger to torrent lib * skip debug test * add Close method * review fixes * fix lint Co-authored-by: alex.sharov <AskAlexSharov@gmail.com> Co-authored-by: Alexey Akhunov <akhounov@gmail.com>	2020-10-06 20:24:48 +01:00
Alex Sharov	d9d9e14f45	change bucket type to string (#894)	2020-08-11 06:55:32 +07:00
Igor Mandrigin	3aedcbcd7d	Use datadir for temp files when generating indexes	2020-08-02 12:32:41 +02:00
b00ris	eca0f233ec	[WIP] WalkAsOf (#724) ... * save state * walkAsOf by cs test passed * cs search for plain state * save state * fix accounts tests * refactor walkAsOf account tests * fix storage test * refactor walkAsOf storage tests * fix lint * fix test * save state * save state * add test with fixed bits * fmt * add stages check * fix lint * fix lint * remove obsoleted methods	2020-07-09 07:13:45 +01:00
ledgerwatch	ed866e6934	non-concurrent ETL, debug_traceTransaction in rcpdaemon (#692) ... * Fixing history index * Remove chunk generation, fix formatting * Fix compile error, clean up hack.go * Fix output tests * Fix index generator test * Fixed checkChangeSets * Fix linter	2020-06-28 07:10:27 +01:00
Alex Sharov	57777e7c60	Prepare codebase for future default DB change (#670) ... * Add kv.tx.bucket.Clear() and db.ClearBuckets() methods * Add kv.tx.bucket.Clear() and db.ClearBuckets() methods * choose db based on file suffix * implement db.id method * implement db.id method * use ethdb.NewDatabase method * use ethb.MustOpen method * cleanup * support TEST_DB env flag * create db path automatically needed * bolt - don't change prefix on happy path	2020-06-16 14:36:16 +01:00
b00ris	b4ba764fb1	[WIP] TxLookup stage (#646) ... * save state * txlookup full results * save state * save state * remove experiments * some fix&lint * add end key to txLookup and index generation * change log message * change log * fix lint * lint * fix test	2020-06-10 23:07:14 +03:00
b00ris	266f9a5208	Plain state index (#595) ... * plain state indexes * generalize index generation&tests * add plain state tests * fix regenerate index * сoncurrent changeset chunks processing * remove concurrency * fix lint * remove comments * add test to truncate * fix conflicts * fmt * remove shadowing	2020-05-31 07:57:47 +01:00
Igor Mandrigin	ebe7aec14e	Generalize "insert into DB though sorted files" pattern. (#592)	2020-05-30 10:00:35 +03:00
ledgerwatch	f06db2f37b	Stages 6 and 7 for generating history indices (#569) ... * save state * add current index feature * fix test * remove logs * Only execute 1000 blocks * Reset history index * Correct action * Increase batch size * Increase chunk size, print memory stats * Fix linter * Remove unused from * Split into 2 staged * Use storage history gen * remove log * Not to run tx_cacher in staged mode * Not to recover during stage 2 * Not to recover during stage 2 * Remove counter Co-authored-by: b00ris <b00ris@mail.ru>	2020-05-23 10:19:56 +01:00