Commit Graph

181 Commits

Author SHA1 Message Date
Alex Sharov
2276f438aa
downloader: fix log progress race #5535 2022-09-27 10:57:00 +07:00
Alex Sharov
9cac57bcc9
erigon3: set seedable files to 32 steps #5534 2022-09-27 10:51:14 +07:00
Alex Sharov
9fb8a190bc
erigon22: folder snapshots/history (#5351) 2022-09-18 17:41:01 +07:00
Nathan (Blaise) Bruer
002aba4686
Add STOP_AFTER_STAGE environ (#5207)
Adds ability to stop after a stage instead of just before a stage.
This will allow users to use something like:
`STOP_AFTER_STAGE=Finish erigon`
And erigon will stop after a full cycle of syncing.
2022-08-31 07:46:27 +07:00
Håvard Anda Estensen
7c15ed59e4
Enable prealloc linter (#5177)
* Enable prealloc linter

* Set inital slice len to 0
2022-08-26 10:04:36 +07:00
Andrew Ashikhmin
992ae01a7e
WithTablessCfg -> WithTableCfg (#5163) 2022-08-24 11:29:07 +02:00
Enrique Jose Avila Asapche
6e18bef60a
added mutex lock to avoid race condition in downloader (#5089)
* added mutex lock to avoid race condition in downloader

* Revert "added mutex lock to avoid race condition in downloader"

This reverts commit cc14bf539a7cdf552ffceda3a9aef2949ccac5c2.

* using lock
2022-08-17 18:33:03 +07:00
Håvard Anda Estensen
8460fd8e25
Remove deprecated functions (#5086) 2022-08-17 12:17:32 +07:00
Alex Sharov
52fd0d0e8b
Aggregator22.Unwind() (#5039)
* save

* save
2022-08-13 18:51:25 +07:00
Alex Sharov
206f41811d
save (#5010) 2022-08-11 21:37:14 +07:00
Alex Sharov
351cd49c21
go1.19 gofmt (#4988) 2022-08-10 19:04:13 +07:00
Alex Sharov
0beb295745
torrent: try burst limit fix panic (#4983)
* save

* save
2022-08-10 18:52:36 +07:00
Alex Sharov
1b20322b60
snap: no tmp subfolder (#4940)
* save

* save

* save

* save

* save
2022-08-08 09:24:39 +07:00
Leonard Chinonso
43f5ab09f8
Fixed lint errors for gosec linter (#4933)
* Fixed lint errors for gosec linter

* Changed uint64 to int64 in common/GetRandInt

* Changed naming of function
2022-08-04 14:59:40 +01:00
Alex Sharov
db0c4e9d41
torrent: reduce network packet size, to increase network responsiveness (#4910) 2022-08-03 09:39:08 +07:00
Alex Sharov
5cf933d0b0
torrent logs better (#4896) 2022-08-02 11:43:26 +07:00
Alex Sharov
2681ee392a
rpc: fix error stream (#4860) 2022-07-29 10:01:13 +07:00
Alex Sharov
aee4b53788
save list of snapshots in db (#4777)
* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save
2022-07-28 16:57:38 +07:00
Alex Sharov
1ecacde3a9
trackerslist: convert from git submodule to go package (#4761) 2022-07-20 09:47:58 +07:00
Alex Sharov
d3b424c9f6
Mdbx: GC BigFoot (#4750) 2022-07-19 16:53:18 +07:00
Enrique Jose Avila Asapche
e04401491f
checking if we build torrent file (#4723)
* checking if we build torrent file

* only if torrentHash != nil

* clearer separation of scenario

* refactored Download

* comments

* ops

* not using magnet with empty hash

* moved log to top

* ops

* logs

* log warns

* bumped up log lvl

* log
2022-07-16 11:06:26 +03:00
Alex Sharov
36586e52a1
Torrent: add fsync after piece download (#4700) 2022-07-13 17:39:20 +07:00
Alex Sharov
f19101d33b
macos retry reopen torrent client (#4645)
* save

* save

* save

* save

* save

* save

* save

* save

* save
2022-07-06 16:27:01 +06:00
Alex Sharov
ff847cd459
Snapshots: save initial list to db, to avoid future snapshots downloading #4625 2022-07-04 18:44:15 +06:00
Alex Sharov
2415fecb26
--downloader.verfiy flag to verify once on startup (#4597)
* save

* save

* save

* save

* save

* save
2022-07-01 16:52:43 +06:00
Alex Sharov
c03d57356c
prevent downloading new snapshots after initial sync (#4585) 2022-06-30 22:35:44 +06:00
Alex Sharov
cfa8b545fc
downloader: fix tmp dir detection check #4575 2022-06-29 19:53:52 +06:00
Alex Sharov
f613fcafd2
torrent verbosity allow debug #4569 Open 2022-06-29 08:42:11 +06:00
Enrique Jose Avila Asapche
64697a9647
torrent verbosity now uses int (#4551)
* torrent verbosity now uses int

* logging torrent verbosity

* moved crit correctly
2022-06-29 08:29:59 +06:00
Alex Sharov
b9cb6d953e
Fix nil td (#4546)
* save

* save
2022-06-26 17:27:14 +06:00
Alex Sharov
afd07e5dee
--no-downloader flag support (#4545) 2022-06-26 17:13:32 +06:00
Alex Sharov
6612cf42d6
"torrent_hashes --verify" to detect "snapshots/tmp" dir (#4501) 2022-06-20 14:31:57 +06:00
laughship
f376d0a7a0
Remove debug output (#4442) 2022-06-14 05:31:42 +01:00
Alex Sharov
feabb96e69
Snapshots: allow delete .seg files #4403 2022-06-08 09:29:59 +07:00
Alex Sharov
454c7aa87f
torrent: allow del db #4394 2022-06-07 13:12:27 +07:00
Alex Sharov
a53642b4bf
datadir.Dirs configuration object to group dir config (#4387) 2022-06-07 10:24:50 +07:00
Alex Sharov
f6c9d2beea
downloader torrent_hashes --verify: 1 error line per file #4386 2022-06-07 09:36:42 +07:00
Alex Sharov
fe77819458
Snap: use tmp sub-dir to allow mount datadir/snapshot to another drive (#4349) 2022-06-04 10:13:55 +07:00
Alex Sharov
d37447727a
torrent: reduce deps of cfg #4305 2022-05-30 17:36:02 +07:00
Alex Sharov
0795bcb865
integration: validate syncmode flag (#4300) 2022-05-30 09:59:38 +07:00
Alex Sharov
11e96460cf
Torrent: verify is more informative (#4283)
* save

* save
2022-05-27 10:44:07 +07:00
Alex Sharov
66248c4bfb
Torrent: verify all files (#4270) 2022-05-26 12:27:44 +07:00
Alex Sharov
9fd05cd812
lastDup no key (#4258) 2022-05-25 15:26:20 +07:00
Alex Sharov
1eb9aec08a
Better validate --torrent.verbosity flag (#4257)
* lastDup no key

* lastDup no key

* lastDup no key
2022-05-25 15:24:11 +07:00
Alex Sharov
b9bf97362b
save (#4251) 2022-05-24 18:04:26 +01:00
Alex Sharov
10bcbf4a68
Snap: faster Erigon re-start (#4201) 2022-05-19 12:28:33 +07:00
Alex Sharov
726ef081ce
option to disable runtime.ReadMemStats (#4200) 2022-05-19 11:48:07 +07:00
Alex Sharov
78f1d01a82
Update readme.md (#4192) 2022-05-18 13:50:28 +07:00
Alex Sharov
80d1d8a114
Trackers: split file lines cross-platform way #4191 2022-05-18 10:28:14 +07:00
Alex Sharov
4e7807251a
Ensure snapshotDir not created by accident (#4164)
* save

* save

* save
2022-05-17 09:40:45 +07:00