12 Commits

Author	SHA1	Message	Date
Alex Sharov	35872a4708	[merge after release] remove etl onLoadCommit hook, because etl doesn't manage transactions anymore (it's low-level code) (#1692)	2021-04-08 18:03:33 +07:00
Alex Sharov	fbfc43da7e	etl to use rwtx (#1660)	2021-04-02 18:22:25 +07:00
Alex Sharov	b3f1915d09	ChangeSets dupsort (#1342) ... * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * change_set_dup * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * working version * aa * aa * aa * aa * aa * aa * aa * aa * aa * aa * aa * aa * aa * aa * aa * squash * squash * fix * fix * fix * fix * fix * fix * fix * fix * fix * fix * fix * history_early_stop * history_early_stop * vmConfig with ReadOnly false * auto_increment * auto_increment * rebase master Co-authored-by: Alexey Akhunov <akhounov@gmail.com>	2020-11-16 12:08:28 +00:00
Alex Sharov	7ae38f5fe3	check canonical receipt (#1310)	2020-10-28 10:24:17 +07:00
Alex Sharov	531d36efcb	mdbx support (#1235)	2020-10-28 10:18:10 +07:00
Alex Sharov	331dcd45eb	Store receipts separately - one record per tx (#1271) ... * squash * add --database flag to integration * clean * split to 2 buckets * split to 2 buckets * split to 2 buckets * split to 2 buckets * split to 2 buckets * save progress * save progress * improve test * improve test * save progress * change app logic * change app logic * return err from rawdb package * don't clean automatically * don't clean automatically * clean * clean * clean * don't rely on `make clean` * improve cbor code * clean * clean * clean * fix tests * rebase master * stop on error: headers stage * make TxDb walk and multiwalk safe * Fix panics Co-authored-by: Alexey Akhunov <akhounov@gmail.com>	2020-10-25 08:38:55 +00:00
Alex Sharov	76f1b05cb2	Move tmpdir definition to app-start, move migrations folder inside tmpdir (#1282) ... * extract tmpdir to app-level-code * extract tmpdir to app-level-code * save progresss	2020-10-23 12:18:45 +01:00
ledgerwatch	88acfc55ca	Vary batch size for execution stage (#1274) ... * Vary batch size for execution stage * Fix in logging * Improve log of timings * Log improvements * Log improvements * Fix tests * More log improvments, fix tests * Fix tests * Better logging for Bodies and Interhash * Fix tests * Minor fixes * Fix test	2020-10-21 18:01:40 +01:00
Alex Sharov	44bbe97a1f	Migration idempotency: handle corner-cases of CriticalCollector (#1257) ... * save progress of db migration * save progress of db migration * delete * delete * delete * delete * delete * print full key if it has 8 leading zeroes * print full key if it has 8 leading zeroes * print full key if it has 8 leading zeroes	2020-10-19 20:20:18 +01:00
Alex Sharov	d7bcb29802	do commit by don't save partial progress (#1256)	2020-10-19 07:43:30 +01:00
ledgerwatch	d2e5cc5cb5	Better migration - receipts_cbor_encode not to increase size of the database (#1250) ... * Add print_migration command to integration * Not run migrations for print commands * Reverse migration * Fix lint * Add datadir to run_migrations * Add lmdb.mapSize to integration * Make lmdb.mapSize effective * Fix * receipt sizes * fix print * Switch to another version of lmdb * Collector from existing files * Not load * Commit after clearing * Add methods for clear/drop buckets by multiple transactions * Fix to lmdb * Not remove temp files * Not load * Re-enable loading * Prints * Try to fix refill * Migration in 3 steps * tidy mod * Fix lint * Fix tests * Migrations for CBOR receipts in 3 txs * Fix lint Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>	2020-10-17 14:00:12 +01:00
Alex Sharov	809d79b15f	Switch to cbor (#1172) ... * switch receipts to cbor * switch receipts to cbor * rpcdaemon to cache chainconfig * rpcdaemon to cache chainconfig * rpcdaemon to cache chainconfig * rpcdaemon to cache chainconfig	2020-10-02 13:51:20 +01:00