20 Commits

Author	SHA1	Message	Date
Alex Sharov	6bd44eb26c	move kv to erigon-lib (#2467)	2021-07-29 18:53:13 +07:00
Alex Sharov	5069558752	Apache licensed logger (#2460)	2021-07-29 17:23:23 +07:00
Alex Sharov	21cb7befa4	finish remove bucket suffix (#2458)	2021-07-28 10:43:51 +07:00
Alex Sharov	838e5f9ef2	Move bucket constants into kv package, move kv interface to kv package (#2455)	2021-07-28 09:47:38 +07:00
b00ris	57473175ff	Body snapshot (#2100) ... * fix test * get rid of ObjectDatabase * sn_builder_prototype2 * save state * save state * integration step1 * fix lint * fix * fix test * integrate migrator.finish * fix lint * fix build * fix typo * save state * body snapshot test * unique tx * body snapshot generation using walk * move methods out of test * block data verification added * fix lint * test with remove works correctly * fix lint * remove experiment test * fix test * add comment * add second layer of remove test * rename test * fix typos * fix lint * revert testdata * body snapshot migration save state * fix body snapshot migration * fix after merge * remove debug test * debug windows build * fix build * fix * fix lint * debug * fix * fix windows build * simplify snapshot management&&get rid of lazy tx * fix lint * fix windows path * debug * debug * debug * debug * remove geometry experiments * skip windows tests * clean * fix * fix ;int	2021-07-06 23:33:26 +01:00
Alex Sharov	bc271f92ce	To break dependency to db implementation - move all db classes to "ethdb/kv" and leave in "ethdb" only interfaces (#2195)	2021-06-19 15:21:53 +07:00
Alex Sharov	925d17a238	remove lmdb from hack, integration, state packages. remove lmdb dbtools (#2146)	2021-06-11 20:31:37 +07:00
Alex Sharov	0be3044b7e	rename (#1978) ... * rename * rename "make grpc" * rename "abi bindings templates" * rename "abi bindings templates"	2021-05-20 19:25:53 +01:00
Alex Sharov	ef77eb3053	tx.RwCursor() to return err (first step of removing lazy cursors) (#1656)	2021-04-02 13:36:49 +07:00
b00ris	c03da8fb8e	Split header prefix bucket to headers, td and canonical (#1556) ... * split headers prefix * migration * fix downloader bug * test for migration * fix lint * uncomment t.Prallel * fix postprocessing test	2021-03-19 12:54:47 +00:00
ledgerwatch	b743b88218	Revert "Extract validating interface (#1120)" (#1543) ... * Revert "Extract validating interface (#1120)" This reverts commit e4e36c152e. * Fix go mod tidy * Fix lint * Fix lint * fix lint * Test fix * Fix test Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>	2021-03-05 20:34:23 +00:00
Evgeny Danilenko	e4e36c152e	Extract validating interface (#1120) ... * interface * generalize interface * linters * fix deadlock * fix linters * close goroutine * fix * debug * id+ttl * refactor downloader tests * tests * lru * handle genesis, extract fake consensuses * fix fake consensus * test uncles, verify * after a new master * fmt * fix close * debug * debug * fix chain length * remove test field * use single account * fix data race on closing channel * remove postponed blocks queue * miner test * VerifyHeaderRequests * fmt * fmt * fix data race * handle validating errors * simplify matchParents * remove copy-paste * move sort to constructor * clean up * debug for 10 parents * debug * debug * batch responses * batch requests * works for many ancestors * remove debug * always Close an engine * linters * ancestors deduplication * fix test * reduce interface * api * clique * green clique sync * stable * perpermance per second * full sync * linters * gitignore * deps * fix panic after master merge * init consensus * clique tests * fix tests * fix tests * clean up * reuse snap * store vefified snapshots * optimize snapshots * safe close * cleanup loop * after downloader * downloader and consensus tests * update tests * hack.go * clique flags * fix cliuqe config * review * gitignore * remove additional bucket * blk/sec instead of blk/microsecond * rename * deps * optimize * debug * test * tests without extracted validation process * same base performance as on master * benchmark * simplify ethash verification * ethash * ethash * linters * ethash * master stats * cleanup * gomod * linters * tests * better locks * Fix * Remove logging for verifyHeaders * Verification speed in the logs * Fix compile error Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>	2021-02-25 19:40:45 +00:00
Alex Sharov	e6f1e43e6f	lmdb: move fsync inside commit (#1433)	2021-01-04 08:17:18 +00:00
b00ris	8db5790838	State snapshot sync (#1417) ... * move experiments to new branch&reorganise kv_snapshot * walk&modify tests * added delete from snapshot tests * fmt * state snapshot debug * snapshot validation passed. copy state snapshot * debug * snapshot cursor.Prev test * Prev works correct. Added Current check * add err check * added walk forward and backward test * before refactoring * refactoring * execution with snapshot debug * fix * remove useless test * before dupcursor implimentation * tests with prev and delete works * execution based on state snapshot passed * remove useless tests * blocks to 1140000 passed * clean verifier * cleanup state generation * clean verify && seeder * remove debug code * tests passed * fix lint * save state * test passed * fix lint * add state hash * fix lint	2021-01-02 19:28:37 +00:00
Alex Sharov	4565bd43c1	Mdbx v0.9.2 (#1373) ... * up devel * up devel * up devel * up devel * up devel * up devel * up devel * up devel * squash * squash * squash * squash * squash * squash * squash * squash * squash * squash * squash * squash * squash * switch to master * mdbx 0.9.2 * mdbx 0.9.2 * %<<$!%%%%%%<o'{}k.### * %<<$!%%%%%%<o'{}k.### * merge * merge * merge * merge * ad * ad * ad * ad	2020-11-28 14:26:28 +00:00
ledgerwatch	cd706d5081	Download/seed block bodies and block headers via BitTorrent (#1218) ... * save state * torrent experiments * torrent experiment passed * fixes after merge * snapshot headers processing passed * save state * save state * download headers works after snapshot processing * save state * save state * save state * save state * add lazy load tx to snapshots, increase number of trackers * save state * speedup getting info * change logging * move to turbo package * save state * save state * save state * cleanup * save state * add test test * save state * lmdb debugging * fix readonly mode * save state * fix build * sync works * save state * save state * save state * allow cmd stages stageSenders use snapshots * debugging failed hashing * remove experimental tests * remove torrent experimental tests * fix lint * extract snapshot wrapper * metainfo checker * add remote seeder * add logs * update gomod * remove useless code * fix lint&remove useless code * extract verify snapshot to separated command * skip debug test * fix test * change type of seedSnapshot flag * add eth logger to torrent lib * skip debug test * add Close method * review fixes * fix lint * tidy mods * Fix compile * Fix lint * Fix rpcdaemon running in the docker Co-authored-by: b00ris <b00ris@mail.ru> Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>	2020-10-13 13:56:16 +01:00
ledgerwatch	1af6cbe37b	Revert "Download/seed headers and block bodies via BitTorrent (#1195)" (#1202) ... This reverts commit 94360212cb.	2020-10-07 21:49:44 +01:00
ledgerwatch	94360212cb	Download/seed headers and block bodies via BitTorrent (#1195) ... * save state * torrent experiments * torrent experiment passed * fixes after merge * snapshot headers processing passed * save state * save state * download headers works after snapshot processing * save state * save state * save state * save state * add lazy load tx to snapshots, increase number of trackers * save state * speedup getting info * change logging * move to turbo package * save state * save state * save state * cleanup * save state * add test test * save state * lmdb debugging * fix readonly mode * save state * fix build * sync works * save state * save state * save state * allow cmd stages stageSenders use snapshots * debugging failed hashing * remove experimental tests * remove torrent experimental tests * fix lint * extract snapshot wrapper * metainfo checker * add remote seeder * add logs * update gomod * remove useless code * fix lint&remove useless code * extract verify snapshot to separated command * skip debug test * fix test * change type of seedSnapshot flag * add eth logger to torrent lib * skip debug test * add Close method * review fixes * fix lint Co-authored-by: b00ris <b00ris@mail.ru> Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>	2020-10-07 13:15:49 +01:00
ledgerwatch	bdb0155856	Revert "Add sync by bittorrent snapshots (#1160)" (#1194) ... This reverts commit 4ebade3583.	2020-10-06 22:31:57 +01:00
b00ris	4ebade3583	Add sync by bittorrent snapshots (#1160) ... * save state * torrent experiments * torrent experiment passed * fixes after merge * snapshot headers processing passed * save state * save state * download headers works after snapshot processing * save state * save state * save state * save state * add lazy load tx to snapshots, increase number of trackers * save state * speedup getting info * change logging * move to turbo package * save state * save state * save state * cleanup * save state * add test test * save state * lmdb debugging * fix readonly mode * save state * fix build * sync works * save state * save state * save state * allow cmd stages stageSenders use snapshots * debugging failed hashing * remove experimental tests * remove torrent experimental tests * fix lint * extract snapshot wrapper * metainfo checker * add remote seeder * add logs * update gomod * remove useless code * fix lint&remove useless code * extract verify snapshot to separated command * skip debug test * fix test * change type of seedSnapshot flag * add eth logger to torrent lib * skip debug test * add Close method * review fixes * fix lint Co-authored-by: alex.sharov <AskAlexSharov@gmail.com> Co-authored-by: Alexey Akhunov <akhounov@gmail.com>	2020-10-06 20:24:48 +01:00