38 Commits

Author	SHA1	Message	Date
Alex Sharov	cd8b10f57e	snapshot merger: smaller interface (#4786) ... * save * save * save	2022-07-22 16:54:05 +07:00
Alex Sharov	5805d963ea	erigon-snapshot: convert from git sumbodule to golang package (#4760)	2022-07-20 09:34:12 +07:00
Enrique Jose Avila Asapche	e768227d38	Merge range (#4749) ... * added merge range into segments * got rid of missing snapshot errors * reusing RequestSnapshotDownload * sleep out of download * ops * warning if we are missing snapshots	2022-07-19 19:27:54 +07:00
Enrique Jose Avila Asapche	8dceb6fe82	Auto download snapshots (#4729) ... * refactored request download * keeping track of missing snapshots * using slice mergeRange * request snapshots on reopen * passing arguments * passed in var * Revert "passed in var" This reverts commit 90478978dfa9f2a6dd5b1b051fc1d3f9e5f7a9c5. * Revert "passing arguments" This reverts commit 1e39c4152003796f6ff0bcfc188512d4a43bd18d. * Revert "request snapshots on reopen" This reverts commit d40212b973bc15db2b25cc1b0abb22051a3debb1. * added downloadRequest ; * downloading missing headers at start up * there shouldnt be an error anymore * not using nil; ;	2022-07-18 17:42:20 +03:00
Alex Sharov	4e7807251a	Ensure snapshotDir not created by accident (#4164) ... * save * save * save	2022-05-17 09:40:45 +07:00
Alex Sharov	32d8ab34d9	atomic snapshot dir, step 2 (#4093) ... * atomic snapshot dir * atomic snapshot dir	2022-05-07 14:53:21 +07:00
Alex Sharov	2655d57288	reduce downloader deps (#4010) ... * reduce downloader deps * reduce downloader deps	2022-04-28 12:13:30 +07:00
Alex Sharov	6aa4999729	Parallel indexing (#3921)	2022-04-21 10:34:10 +07:00
Alex Sharov	777412e0bb	Snapshots: notify before remove (#3885) ... * goerli * goerli	2022-04-14 14:56:08 +07:00
Alex Sharov	7d86283910	Sapshots: idx merge (#3841) ... * return err on interruption * save * save * save * save * save * save * save * save * save	2022-04-07 11:27:57 +07:00
Alex Sharov	8b03582558	compressor: log lvl #408 ... * save * save	2022-04-01 10:44:30 +07:00
Alex Sharov	89d4477df3	Snapshots: nil indices on p2p fix (#3772)	2022-03-27 10:07:58 +07:00
Alex Sharov	a357421719	Snapshots: notify rpcdaemon about new snapshot (#3755)	2022-03-24 09:25:38 +07:00
alex.sharov	752a52c4af	fix test	2022-03-21 19:33:26 +07:00
Alex Sharov	f314222180	Snapshots: start seed new large .seg files (#3724)	2022-03-18 11:12:18 +07:00
Alex Sharov	469b75c3d3	Snapshots: retire blocks by default (#3707)	2022-03-16 09:57:48 +07:00
Alex Sharov	aed679c8a0	snapshots: enum file types (#3683)	2022-03-12 15:27:55 +07:00
Alex Sharov	f5be8919ef	snapshots: merge segments strategy (#3645) ... * save * save * save	2022-03-04 14:16:16 +07:00
Alex Sharov	f8c1fb9563	snapshots: speedup slow test (#3623)	2022-02-25 11:42:54 +07:00
Alex Sharov	96e0691d4a	snapshots: delete .idx after merge (#3619)	2022-02-25 11:41:49 +07:00
Alex Sharov	809cfdcf19	snapshots: indexing of recently merged range (#3606) ... * snapshots: fix indexing of recently merged range * snapshots: fix indexing of recently merged range * snapshots: fix indexing of recently merged range * snapshots: fix indexing of recently merged range * snapshots: fix indexing of recently merged range	2022-02-24 14:15:03 +07:00
Alex Sharov	81d51e1589	snapshots: better files sort and filter (#3582)	2022-02-23 10:54:35 +07:00
Alex Sharov	ab01d64916	fix close files error on win (#3572)	2022-02-22 16:24:33 +07:00
Alex Sharov	fc278327b9	"erigon snapshots recompress" add test (#3573)	2022-02-22 16:02:09 +07:00
alex.sharov	f624d1cc22	save	2022-02-22 15:33:07 +07:00
alex.sharov	d3c8634df8	fix windows tests	2022-02-22 14:44:57 +07:00
Alex Sharov	5cd561bd74	block snapshots merge (#3558)	2022-02-22 08:55:24 +07:00
Alex Sharov	226982d293	Use class dir.Rw - to separate Ro and Rw access to snapshotDir (#3534) ... * save * save * save * save * save * save * save	2022-02-18 09:24:17 +07:00
Alex Sharov	c9cee7a884	path -> filepath (path package is for urls) (#3493)	2022-02-12 20:33:09 +07:00
Alex Sharov	bb1d19060f	Add downloader to docker-compose (#3348)	2022-01-26 22:26:33 +07:00
Alex Sharov	304b40dd0a	Snapshot: prohibit to change cli flags (#3311)	2022-01-22 11:18:24 +07:00
Alex Sharov	6fd002eb5a	Snapshot: move old blocks to snapshots (non-async version) (#3309) ... * save * save	2022-01-20 12:01:02 +07:00
Alex Sharov	9188705849	Switch to parallel (#3285) ... * save * save * save * save * save * save * save * save * save * save	2022-01-18 15:01:36 +07:00
Alex Sharov	7390db7b84	Snapshots hashes for mainnet (#3150)	2021-12-21 21:12:32 +07:00
Alex Sharov	ecb10e8548	Snapshots download and seed (#3117) ... * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * Squashed 'interfaces/' content from commit e5b1945d0 git-subtree-dir: interfaces git-subtree-split: e5b1945d02da7a7f00e2289034ee90a6edd60184 * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save * save	2021-12-14 10:13:17 +00:00
Alex Sharov	178fd1931d	Genesis sync from existing snapshots (#3087)	2021-12-05 09:03:08 +07:00
Alex Sharov	d4850b6adc	Hack: dump bodies and headers (#2994)	2021-11-20 09:41:01 +07:00
Alex Sharov	861ef7a6c1	Open blocks snapshots (#2957)	2021-11-16 15:33:41 +07:00