Alex Sharov
8afeee56c8
Downloader extract, step2 ( #6076 )
2022-11-20 10:41:30 +07:00
Alex Sharov
e7a3c0789a
Disable ci3 ( #6063 )
2022-11-16 15:53:46 +03:00
Alex Sharov
93926646f8
e3: prepare downloader for extraction ( #6061 )
2022-11-16 15:48:23 +03:00
Alex Sharov
26fdf9169d
move all packages from "internal" folder - to simplify users live ( #5857 )
2022-10-25 09:58:25 +07:00
Alex Sharov
8641d81511
downloader: nil ptr verify ( #5833 )
2022-10-22 11:52:05 +07:00
Alex Sharov
b9f6b098c3
downloader: log files progress at debug level ( #5818 )
2022-10-21 15:08:16 +07:00
Alex Sharov
86551e82f4
e3: parallel build missed indices ( #5817 )
2022-10-21 13:45:20 +07:00
Alex Sharov
606ce5c99a
add logging cli flags to various cmd ( #5816 )
2022-10-21 12:36:17 +07:00
Max Revitt
07ffa36d44
File system logging ( #5812 )
...
- lives in internal/logging
- all log flags moved to internal/logging/flags
- allows continued use of root logger via log.Info etc.
- update logger to take change allowing string to lvl for 'trace'
Verbosity flag is overridden by log.console.verbosity. Logs will be
colocated if all run as one process, only split where progs are run as
separate processes, in a future update this will be addressed so for
example rpcdeamon will always log to it's own file
2022-10-20 19:25:06 +01:00
Alex Sharov
4795217e4e
e3: prevent files ranges overlap ( #5684 )
2022-10-12 10:18:55 +07:00
Alex Sharov
ca9aa4723c
Compress params change ( #5631 )
...
as of https://github.com/ledgerwatch/erigon-lib/pull/651
2022-10-05 17:54:54 +07:00
Alex Sharov
2276f438aa
downloader: fix log progress race #5535
2022-09-27 10:57:00 +07:00
Alex Sharov
9cac57bcc9
erigon3: set seedable files to 32 steps #5534
2022-09-27 10:51:14 +07:00
Alex Sharov
9fb8a190bc
erigon22: folder snapshots/history ( #5351 )
2022-09-18 17:41:01 +07:00
Nathan (Blaise) Bruer
002aba4686
Add STOP_AFTER_STAGE environ ( #5207 )
...
Adds ability to stop after a stage instead of just before a stage.
This will allow users to use something like:
`STOP_AFTER_STAGE=Finish erigon`
And erigon will stop after a full cycle of syncing.
2022-08-31 07:46:27 +07:00
Håvard Anda Estensen
7c15ed59e4
Enable prealloc linter ( #5177 )
...
* Enable prealloc linter
* Set inital slice len to 0
2022-08-26 10:04:36 +07:00
Andrew Ashikhmin
992ae01a7e
WithTablessCfg -> WithTableCfg ( #5163 )
2022-08-24 11:29:07 +02:00
Enrique Jose Avila Asapche
6e18bef60a
added mutex lock to avoid race condition in downloader ( #5089 )
...
* added mutex lock to avoid race condition in downloader
* Revert "added mutex lock to avoid race condition in downloader"
This reverts commit cc14bf539a7cdf552ffceda3a9aef2949ccac5c2.
* using lock
2022-08-17 18:33:03 +07:00
Håvard Anda Estensen
8460fd8e25
Remove deprecated functions ( #5086 )
2022-08-17 12:17:32 +07:00
Alex Sharov
52fd0d0e8b
Aggregator22.Unwind() ( #5039 )
...
* save
* save
2022-08-13 18:51:25 +07:00
Alex Sharov
206f41811d
save ( #5010 )
2022-08-11 21:37:14 +07:00
Alex Sharov
351cd49c21
go1.19 gofmt ( #4988 )
2022-08-10 19:04:13 +07:00
Alex Sharov
0beb295745
torrent: try burst limit fix panic ( #4983 )
...
* save
* save
2022-08-10 18:52:36 +07:00
Alex Sharov
1b20322b60
snap: no tmp subfolder ( #4940 )
...
* save
* save
* save
* save
* save
2022-08-08 09:24:39 +07:00
Leonard Chinonso
43f5ab09f8
Fixed lint errors for gosec linter ( #4933 )
...
* Fixed lint errors for gosec linter
* Changed uint64 to int64 in common/GetRandInt
* Changed naming of function
2022-08-04 14:59:40 +01:00
Alex Sharov
db0c4e9d41
torrent: reduce network packet size, to increase network responsiveness ( #4910 )
2022-08-03 09:39:08 +07:00
Alex Sharov
5cf933d0b0
torrent logs better ( #4896 )
2022-08-02 11:43:26 +07:00
Alex Sharov
2681ee392a
rpc: fix error stream ( #4860 )
2022-07-29 10:01:13 +07:00
Alex Sharov
aee4b53788
save list of snapshots in db ( #4777 )
...
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
2022-07-28 16:57:38 +07:00
Alex Sharov
1ecacde3a9
trackerslist: convert from git submodule to go package ( #4761 )
2022-07-20 09:47:58 +07:00
Alex Sharov
d3b424c9f6
Mdbx: GC BigFoot ( #4750 )
2022-07-19 16:53:18 +07:00
Enrique Jose Avila Asapche
e04401491f
checking if we build torrent file ( #4723 )
...
* checking if we build torrent file
* only if torrentHash != nil
* clearer separation of scenario
* refactored Download
* comments
* ops
* not using magnet with empty hash
* moved log to top
* ops
* logs
* log warns
* bumped up log lvl
* log
2022-07-16 11:06:26 +03:00
Alex Sharov
36586e52a1
Torrent: add fsync after piece download ( #4700 )
2022-07-13 17:39:20 +07:00
Alex Sharov
f19101d33b
macos retry reopen torrent client ( #4645 )
...
* save
* save
* save
* save
* save
* save
* save
* save
* save
2022-07-06 16:27:01 +06:00
Alex Sharov
ff847cd459
Snapshots: save initial list to db, to avoid future snapshots downloading #4625
2022-07-04 18:44:15 +06:00
Alex Sharov
2415fecb26
--downloader.verfiy flag to verify once on startup ( #4597 )
...
* save
* save
* save
* save
* save
* save
2022-07-01 16:52:43 +06:00
Alex Sharov
c03d57356c
prevent downloading new snapshots after initial sync ( #4585 )
2022-06-30 22:35:44 +06:00
Alex Sharov
cfa8b545fc
downloader: fix tmp dir detection check #4575
2022-06-29 19:53:52 +06:00
Alex Sharov
f613fcafd2
torrent verbosity allow debug #4569 Open
2022-06-29 08:42:11 +06:00
Enrique Jose Avila Asapche
64697a9647
torrent verbosity now uses int ( #4551 )
...
* torrent verbosity now uses int
* logging torrent verbosity
* moved crit correctly
2022-06-29 08:29:59 +06:00
Alex Sharov
b9cb6d953e
Fix nil td ( #4546 )
...
* save
* save
2022-06-26 17:27:14 +06:00
Alex Sharov
afd07e5dee
--no-downloader flag support ( #4545 )
2022-06-26 17:13:32 +06:00
Alex Sharov
6612cf42d6
"torrent_hashes --verify" to detect "snapshots/tmp" dir ( #4501 )
2022-06-20 14:31:57 +06:00
laughship
f376d0a7a0
Remove debug output ( #4442 )
2022-06-14 05:31:42 +01:00
Alex Sharov
feabb96e69
Snapshots: allow delete .seg files #4403
2022-06-08 09:29:59 +07:00
Alex Sharov
454c7aa87f
torrent: allow del db #4394
2022-06-07 13:12:27 +07:00
Alex Sharov
a53642b4bf
datadir.Dirs configuration object to group dir config ( #4387 )
2022-06-07 10:24:50 +07:00
Alex Sharov
f6c9d2beea
downloader torrent_hashes --verify: 1 error line per file #4386
2022-06-07 09:36:42 +07:00
Alex Sharov
fe77819458
Snap: use tmp sub-dir to allow mount datadir/snapshot to another drive ( #4349 )
2022-06-04 10:13:55 +07:00
Alex Sharov
d37447727a
torrent: reduce deps of cfg #4305
2022-05-30 17:36:02 +07:00
