Alex Sharov
63c92010cd
remove txsV3 cli flag ( #7644 )
2023-06-03 15:54:27 +07:00
Alex Sharov
ad72b7178e
prune speedup. stage_senders: don't re-calc existing senders ( #7643 )
...
- stage_senders: don't re-calc existing senders
- stage_tx_lookup: prune less blocks per iteration - because
random-deletes are expensive. pruning must not slow-down sync.
- prune data even if --snap.stop is set
- "prune as-much-as-possible at startup" is not very good idea: at
initialCycle machine can be cold and prune will cause big downtime, no
reason to produce much freelist in 1 tx. People may also restart erigon
- because of some bug - and it will cause unexpected downtime (usually
Erigon startup very fast). So, I just remove all `initialSync`-related
logic in pruning.
- fix lost metrics about disk write byte/sec
2023-06-03 12:30:53 +07:00
Alex Sharov
d40317c905
preparation for --txs.v3, step 2 ( #7636 )
2023-06-03 07:20:22 +07:00
Alex Sharov
c6b12ed7ca
stageLoop: unbound canRunCycleInOneTransaction logic from initialCycle variable ( #7616 )
2023-06-01 16:50:19 +07:00
Alex Sharov
6c0b531eca
add "erigon snapshots diff" sub-command to find difference between 2 snapshots ( #7619 )
2023-06-01 16:29:26 +07:00
Alex Sharov
279e1bec33
use blockReader as service-provider of RoSnapshots ( #7584 )
2023-05-26 17:12:33 +07:00
Alex Sharov
23bd14744b
blockReader: use in ethstat ( #7565 )
2023-05-23 16:30:47 +07:00
Alex Sharov
18990ff91a
e2: reduce StageSyncStep interface size ( #7561 )
2023-05-23 12:28:31 +07:00
Anshul Yadav
2c194e10a1
Args usage msg bug fix ( #7554 )
...
## What's this PR is about?
Minor fix in args usage message of support flag. The current message
says that the flag should be 'metrics.url' but it reality it should be
'metrics.urls'
2023-05-20 21:57:23 +01:00
ledgerwatch
b382f96f6c
Introduce logger into etl ( #7537 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-05-18 21:20:07 +01:00
Alex Sharov
c0096ee8c8
StageLoopStep: if node synced - then run initialCycle in 1 tx also (for data consistency) ( #7532 )
2023-05-17 13:39:21 +01:00
ledgerwatch
e75ea786c0
[devnet tool] separate logging ( #7526 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-05-17 07:36:06 +01:00
ledgerwatch
3f9ae3ec77
[devnet tool] separate logging ( #7525 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-05-16 10:53:50 +01:00
ledgerwatch
6ef3fc3a3c
[devnet tool] Side-quest logging, step 5 ( #7484 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-05-10 19:36:27 +01:00
ledgerwatch
f38ec1e772
[devnet tool] side-quest: logging, step 3 ( #7471 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-05-09 18:11:31 +01:00
ledgerwatch
3c1448afed
[devnet tool] Side-quest logging - replace quiet parameter ( #7464 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-05-08 17:52:31 +01:00
ledgerwatch
fdd385cef1
[Devnet tool] Side-quest to improve logging - part 1 ( #7445 )
...
This is the beginning of the series of changes to make it possible to
run multiple instances of erigon inside a single process (as devnet tool
does), with the logging from these processes going to respective log
files correctly.
This is the first part where the initial infrastructure is being
established
---------
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-05-07 07:28:15 +01:00
alex.sharov
061d3ff1a4
fix cli metrics flag
2023-05-05 09:36:02 +07:00
a
30430d585a
begin refactor of beacon state ( #7433 )
...
this first major move separates the transient beacon state cache from
the underlying tree.
leaf updates are enforced in the setters, which should make programming
easier.
all exported methods of the raw.BeaconState should be safe to call
(without disrupting internal state)
changes many functions to consume *raw.BeaconState in perparation for
interface
beyond refactor it also:
adds a pool for the leaves of the validator ssz hash
adds a pool for the snappy writers
removed the parallel hash experiment (high memory use)
2023-05-04 15:18:42 +02:00
alex.sharov
b53c2b1775
comment out "erigon alpha_backup" cmd
2023-05-02 13:06:22 +07:00
alex.sharov
6cfd2cec61
erigon backup: docs
2023-05-01 09:27:35 +07:00
Alex Sharov
76580441b8
new command "erigon alpha_backup" - an alpha version of command to all Erigon's databases ( #7415 )
2023-05-01 08:27:34 +07:00
Alex Sharov
ded8283df7
erigon backup: v0 of sub-command ( #7396 )
2023-04-27 10:42:12 +07:00
ledgerwatch
d002861f5f
[Diagnostics] fix erigon support connection to diagnostics system ( #7391 )
2023-04-26 15:57:39 +01:00
ledgerwatch
d70c9f0979
[Diagnostics] initial support for body downloader visualisation ( #7373 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-04-23 18:56:37 +01:00
Alex Sharov
b14ca7508f
e3: remove garbage files ( #7357 )
2023-04-21 09:51:03 +07:00
Alex Sharov
62d1e8a66c
e3: in-general merge must not see "overlaps/deleted" files, but merge of history need access to corresponding index files (even if they marked as deleted or already merged - before kill -9) ( #7321 )
2023-04-17 05:54:29 +00:00
ledgerwatch
a41ad2d94b
[Diagnostics] introduce versioning and improve usability of support c… ( #7300 )
...
…ommand
---------
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-04-12 21:23:49 +00:00
ledgerwatch
db52bbafb3
[Diagnostics] Re-enable log support, more reliable reconnection ( #7286 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-04-10 07:35:24 +00:00
ledgerwatch
9690228ede
[Diagnostics] Simplify logging settings, introduce correct log rotation with lumberjack ( #7273 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-04-07 21:08:44 +00:00
ledgerwatch
3d904d509e
[Diagnostics] expose command line args via metrics ( #7271 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-04-06 15:34:06 +00:00
ledgerwatch
56bc16b7ab
[Diagnostics] reconnect to diagnostics server when session is timed out ( #7263 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-04-05 14:39:54 +00:00
ledgerwatch
3a740ee0f2
Diagnostics system - step 3 ( #7231 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-03-31 15:17:59 +00:00
ledgerwatch
fac796d921
Diagnostics - step 2 ( #7214 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-03-30 20:59:03 +00:00
Alex Sharov
417a437584
Break dependency of ethcfg
package to core
/consensus
/etc... move genesis struct to 'types' package ( #7206 )
2023-03-29 07:27:06 +00:00
alex.sharov
d748b686d3
save
2023-03-07 14:31:40 +07:00
ledgerwatch
9c9449a059
Mock of Erigon support - step 1 ( #6930 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-02-22 12:38:22 +00:00
Alex Sharov
999899d66d
e3: read files list from db ( #6833 )
2023-02-13 05:17:01 +00:00
Alex Sharov
60a4b8bc7b
Snapshots Indexing: avoid loop with semaphore locking before logging ( #6845 )
2023-02-12 02:49:20 +00:00
ledgerwatch
ee83447fa1
CL lightclient to create memdb in the tmpdir which gets cleaned up on… ( #6829 )
...
… startup
---------
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-02-11 20:44:51 +00:00
Alex Sharov
7b1b86ff8f
remove disable_libutp
tag ( #6814 )
2023-02-09 15:26:57 +07:00
Alex Sharov
ec52990c43
e3: Thread safe reopen folder ( #6810 )
2023-02-09 12:11:40 +07:00
Alex Sharov
82c478a419
e3: getLogs on iterators ( #6683 )
2023-01-25 16:29:41 +07:00
Alex Sharov
4fbbdf9186
e3: move txnum to erigon-lib ( #6663 )
2023-01-22 19:39:33 +07:00
Alex Sharov
5ad4eb936a
split backend.go:new to 2 funcs ( #6595 )
...
Split backend.go:New method to 2. 1st will create db and basic
configuration. 2nd will create instances of stagedsync, txpool, etc...
based on this configuration.
2023-01-17 13:20:31 +07:00
ledgerwatch
2941e754e9
Fix hive tests and reorganise the fix for body download problem ( #6515 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-01-06 12:43:46 +00:00
Alex Sharov
17e0afbe44
"erigon snapshots retire" save progress ( #6486 )
2023-01-02 12:38:03 +07:00
Alex Sharov
94fd30c5eb
"erigon snapshots retire" to save progress ( #6485 )
2023-01-02 12:26:56 +07:00
Alex Sharov
c04668d0ff
e3: agg cancel background jobs ( #6463 )
2022-12-29 15:04:07 +07:00
Andrew Ashikhmin
0fdd60a0d1
Execution Spec Tests & HashCheck() ( #6444 )
...
Run tests from a new repo
https://github.com/ethereum/execution-spec-tests .
Also introduce `HashCheck()` function that checks correctness of block's
uncle, transaction, and withdrawals hashes.
2022-12-28 17:01:40 +01:00