ledgerwatch
56bc16b7ab
[Diagnostics] reconnect to diagnostics server when session is timed out ( #7263 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-04-05 14:39:54 +00:00
ledgerwatch
3a740ee0f2
Diagnostics system - step 3 ( #7231 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-03-31 15:17:59 +00:00
ledgerwatch
fac796d921
Diagnostics - step 2 ( #7214 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-03-30 20:59:03 +00:00
Alex Sharov
417a437584
Break dependency of ethcfg package to core/consensus/etc... move genesis struct to 'types' package ( #7206 )
2023-03-29 07:27:06 +00:00
alex.sharov
d748b686d3
save
2023-03-07 14:31:40 +07:00
ledgerwatch
9c9449a059
Mock of Erigon support - step 1 ( #6930 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-02-22 12:38:22 +00:00
Alex Sharov
999899d66d
e3: read files list from db ( #6833 )
2023-02-13 05:17:01 +00:00
Alex Sharov
60a4b8bc7b
Snapshots Indexing: avoid loop with semaphore locking before logging ( #6845 )
2023-02-12 02:49:20 +00:00
ledgerwatch
ee83447fa1
CL lightclient to create memdb in the tmpdir which gets cleaned up on… ( #6829 )
...
… startup
---------
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-02-11 20:44:51 +00:00
Alex Sharov
7b1b86ff8f
remove disable_libutp tag ( #6814 )
2023-02-09 15:26:57 +07:00
Alex Sharov
ec52990c43
e3: Thread safe reopen folder ( #6810 )
2023-02-09 12:11:40 +07:00
Alex Sharov
82c478a419
e3: getLogs on iterators ( #6683 )
2023-01-25 16:29:41 +07:00
Alex Sharov
4fbbdf9186
e3: move txnum to erigon-lib ( #6663 )
2023-01-22 19:39:33 +07:00
Alex Sharov
5ad4eb936a
split backend.go:new to 2 funcs ( #6595 )
...
Split backend.go:New method to 2. 1st will create db and basic
configuration. 2nd will create instances of stagedsync, txpool, etc...
based on this configuration.
2023-01-17 13:20:31 +07:00
ledgerwatch
2941e754e9
Fix hive tests and reorganise the fix for body download problem ( #6515 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-01-06 12:43:46 +00:00
Alex Sharov
17e0afbe44
"erigon snapshots retire" save progress ( #6486 )
2023-01-02 12:38:03 +07:00
Alex Sharov
94fd30c5eb
"erigon snapshots retire" to save progress ( #6485 )
2023-01-02 12:26:56 +07:00
Alex Sharov
c04668d0ff
e3: agg cancel background jobs ( #6463 )
2022-12-29 15:04:07 +07:00
Andrew Ashikhmin
0fdd60a0d1
Execution Spec Tests & HashCheck() ( #6444 )
...
Run tests from a new repo
https://github.com/ethereum/execution-spec-tests .
Also introduce `HashCheck()` function that checks correctness of block's
uncle, transaction, and withdrawals hashes.
2022-12-28 17:01:40 +01:00
Alex Sharov
05f715ca51
E3: chain rules fix ( #6448 )
2022-12-27 13:14:24 +07:00
Alex Sharov
c32d88f729
simplify StageLoopStep ( #6390 )
2022-12-21 14:39:19 +07:00
Alex Sharov
dfa6505f93
e3: kv/temporal prototype ( #6367 )
2022-12-19 15:38:54 +07:00
Alex Sharov
d45bddc5ad
StagedSync: break dependency to CurrentHeader. Always run non-initial cycle in 1 RwTx ( #6348 )
...
cc: @AlexeyAkhunov
2022-12-18 07:59:31 +07:00
Alex Sharov
863e1ed07b
e3: handle "kill -9" during merge, auto-hide history .ef file if not corresponding .v file ( #6304 )
2022-12-15 13:49:06 +07:00
alex.sharov
62125a0dc1
save
2022-12-14 21:41:54 +07:00
Alex Sharov
99a3ab88f2
e3: cli command to retire/prune history ( #6300 )
2022-12-14 10:01:11 +07:00
alex.sharov
b9e54fa2e1
save
2022-12-14 09:53:38 +07:00
Alex Sharov
ce9203d80d
e3: more aggressive prune #780 ( #6299 )
2022-12-14 09:50:48 +07:00
Alex Sharov
8afeee56c8
Downloader extract, step2 ( #6076 )
2022-11-20 10:41:30 +07:00
Alex Sharov
93926646f8
e3: prepare downloader for extraction ( #6061 )
2022-11-16 15:48:23 +03:00
Andrew Ashikhmin
d9f342bb43
Restore MigrateFlags ( #6055 )
...
Another postfix to PR #6047 . This fixes `--datadir` flag passed to
`erigon init`. See also
https://github.com/ethereum/go-ethereum/pull/24751 .
2022-11-15 21:38:31 +01:00
Andrew Ashikhmin
32629bdce4
Upgrade urfave/cli to v2 ( #6047 )
...
See also
https://github.com/urfave/cli/blob/main/docs/migrate-v1-to-v2.md
2022-11-14 17:33:57 +01:00
hexoscott
636586c1b5
cache state check ( #5844 )
...
draft for now to get some early feedback on approach
2022-11-07 13:04:31 +00:00
Alex Sharov
1e5a513657
e3: configurable recon workers ( #5983 )
2022-11-07 11:42:44 +07:00
Alex Sharov
e490d2d0c7
e3: background merge ( #5921 )
2022-11-01 09:55:38 +07:00
Leonard Chinonso
3163f40e58
Added Mechanism For Sending Raw Transaction ( #5825 )
...
- Added new requests for sending raw transactions
- Made provisions for other types of transactions generated, including
contracts
- Modified the models and services to accommodate general values
2022-10-31 17:46:49 +07:00
Alex Sharov
ba02673e4d
e3: try move old data from db as early as possible #712 ( #5897 )
2022-10-29 14:58:34 +07:00
Alex Sharov
26fdf9169d
move all packages from "internal" folder - to simplify users live ( #5857 )
2022-10-25 09:58:25 +07:00
Alex Sharov
86551e82f4
e3: parallel build missed indices ( #5817 )
2022-10-21 13:45:20 +07:00
Alex Sharov
606ce5c99a
add logging cli flags to various cmd ( #5816 )
2022-10-21 12:36:17 +07:00
Alex Sharov
b8dbb53d3b
e3: write history and indices to etl ( #5742 )
2022-10-15 08:20:58 +07:00
Alex Sharov
b12b0d4627
e3: history bsc and mainnet snapshots ( #5725 )
2022-10-13 09:46:32 +07:00
Alex Sharov
a2e51a2469
e3: prune limited amount before commit #675 ( #5693 )
2022-10-11 11:25:13 +07:00
Alex Sharov
6a7f8fb2a6
erigon3: cli command to force merge snapshots ( #5680 )
2022-10-10 09:47:01 +07:00
Alex Sharov
ca9aa4723c
Compress params change ( #5631 )
...
as of https://github.com/ledgerwatch/erigon-lib/pull/651
2022-10-05 17:54:54 +07:00
Alex Sharov
c48d51a582
snapshot index workers amount - based on available RAM and CPU ( #5524 )
2022-10-05 17:07:01 +07:00
ledgerwatch
94f4ea805d
Fixing hive SideChain reorg test ( #5620 )
...
the root cause is that when `inMemoryExecution` lambda gets created in
the `eth/backend.go`, it captures the reference of
`backend.notifications`, and so the execution of side-forks actually
adds notifications to there, and it all gets sent out to tx pool (and
RPC daemon) at the end of the stage loop (regardless of whether there
was forkchoice update or not)
so we can create a separate notification, but then somehow flush it to
the "main" nofitications when the in-memory exec state is flushed
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-10-05 05:42:38 +01:00
Alex Sharov
fa16d5e855
erigon3: step toward background snapshots build ( #5588 )
2022-10-02 10:21:17 +07:00
Alex Sharov
f4a7d2cf6d
erigon3: build .vi after download ( #5568 )
2022-09-29 12:14:51 +07:00
Alex Sharov
9cac57bcc9
erigon3: set seedable files to 32 steps #5534
2022-09-27 10:51:14 +07:00
Alex Sharov
da7ca3cacf
erigon3: build .efi after download #654 ( #5523 )
2022-09-26 15:51:39 +07:00
Alex Sharov
ef9e296efd
erigon method to test decompression speed ( #5464 )
2022-09-22 14:11:39 +07:00
Alex Sharov
50811f9cd6
"erigon snapshots ram" command ( #5449 )
...
* save
* save
* save
2022-09-21 09:18:37 +07:00
Alex Sharov
9fb8a190bc
erigon22: folder snapshots/history ( #5351 )
2022-09-18 17:41:01 +07:00
Enrique Jose Avila Asapche
473ca51830
Adding back stage snapshots ( #5331 )
...
* added snapshots into stages list && deleted snapshots from defaul unwind
* added verkle trie
* using the same sentries client hd
* need to safe the stage progress of headers as well
2022-09-12 10:26:00 +07:00
Leonard Chinonso
7495986515
Reverting Adding snapshots as a separate stage commit ( #5329 )
...
* reverting Adding snapshots as a separate stage commit
* more fixes to merge conflicts
2022-09-10 19:05:18 +02:00
Enrique Jose Avila Asapche
6d1d3a9f47
moved retiring of blocks from senders into snapshot stage ( #5290 )
2022-09-09 21:48:16 +07:00
Alex Sharov
caa23b9532
erigon22: simplify interhashes stage ( #5315 )
2022-09-08 14:02:50 +07:00
Enrique Jose Avila Asapche
8fc7c78620
Bor txlookup ( #5260 )
...
* printing
* logging
* spam off
* ops
* clean up
* deleted all bor related stuff in snapshots
* adding bor tx to BorTxLookUp
* added readBorTxLookUp
* getting bor tx from bor lookup
* comments
* deleted bor related stuff
* deleting bor tx
* writing borTxLookUp in stage_txlookup
* using bytes
* little fixes
* updated erigon-lib
* using biEndian
* clean up
* setting bytes for big int
* log
* logging
* more logs
* delete logs
2022-09-02 17:41:58 +03:00
Enrique Jose Avila Asapche
12331e018a
Fix bor txlookup ( #5170 )
2022-08-30 17:23:16 +03:00
Alex Sharov
69fbfc9bef
Snapshots: Erigon update list in db only after Downloader confirmation, rpcdaemon read list from db ( #5150 )
2022-08-23 16:28:07 +07:00
Alex Sharov
4594ce5ef7
erigon22: history.v2 flag, align rpcdaemon22 ( #5016 )
...
* save
* save
* save
* save
* save
2022-08-12 16:13:14 +07:00
Alex Sharov
aee4b53788
save list of snapshots in db ( #4777 )
...
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
2022-07-28 16:57:38 +07:00
Andrew Ashikhmin
c1f848746d
Update consensus tests to v11 ( #4724 )
...
* Consensus tests update 11
* Add GrayGlacier fork
* Wire currentRandom from tests into PREVRANDAO
* Serenity engine
* Support insertion of PoS blocks in MockSentry
* Introduce marshallTypedTransactionsAsRlpStrings arg into (*Block) RawBody()
* Revert "Introduce marshallTypedTransactionsAsRlpStrings arg into (*Block) RawBody()"
This reverts commit 903fca572be03c7de33318ce177a03a4be34927b.
* Post-merge fix
* Don't wait for Beacon Chain in tests
* Skip powToPosBlockRejection transition test
* ForkChoice in insertPoSBlocks
* Add withPosDownloader arg to MockWithEverything in order to fix TestPoSDownloader
2022-07-26 09:35:38 +02:00
Alex Sharov
68e35417fc
RetireBlocks: encapsulate delete logic
2022-07-23 11:09:16 +07:00
Alex Sharov
cd8b10f57e
snapshot merger: smaller interface ( #4786 )
...
* save
* save
* save
2022-07-22 16:54:05 +07:00
Alex Sharov
66758c7960
RetireBlocks: less arguments ( #4785 )
...
* save
* save
2022-07-22 13:44:42 +07:00
Alex Sharov
e146b66e35
more usage of dirs object #4390
2022-06-07 11:54:04 +07:00
Alex Sharov
a53642b4bf
datadir.Dirs configuration object to group dir config ( #4387 )
2022-06-07 10:24:50 +07:00
Alex Sharov
f838268e44
[wip] Snapshots: more runtime invariants check ( #4350 )
2022-06-03 18:50:01 +07:00
ledgerwatch
bcbb8bec65
Try to prevent double block retire ( #4330 )
...
* Try to prevent double block retire
* Remove print
* More careful setting of segmentsMax
* Print snapshots max
* Clean lists
* Print
* Use Reopen
* Fix
* Remove prints
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-06-02 16:58:38 +01:00
Alex Sharov
0795bcb865
integration: validate syncmode flag ( #4300 )
2022-05-30 09:59:38 +07:00
Alex Sharov
66248c4bfb
Torrent: verify all files ( #4270 )
2022-05-26 12:27:44 +07:00
Alex Sharov
b1b5a319e1
It's safe now to open snapshots at app start ( #4216 )
2022-05-20 14:46:04 +07:00
Alex Sharov
4e7807251a
Ensure snapshotDir not created by accident ( #4164 )
...
* save
* save
* save
2022-05-17 09:40:45 +07:00
Alex Sharov
4ba1f03efe
Snapshots: atomic dir, step 3 ( #4103 )
2022-05-10 09:29:44 +07:00
Alex Sharov
32d8ab34d9
atomic snapshot dir, step 2 ( #4093 )
...
* atomic snapshot dir
* atomic snapshot dir
2022-05-07 14:53:21 +07:00
ledgerwatch
ba987cf262
Remove preverified hashes ( #4088 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-06 15:15:01 +01:00
Alex Sharov
2655d57288
reduce downloader deps ( #4010 )
...
* reduce downloader deps
* reduce downloader deps
2022-04-28 12:13:30 +07:00
Alex Sharov
58c86d550d
Snapshots: Max index parallelism to 4 ( #3925 )
...
* save
* save
* Readme update: built-in rpc daemon and syncmode=snap
* save
* save
* save
2022-04-21 17:49:42 +07:00
Alex Sharov
6aa4999729
Parallel indexing ( #3921 )
2022-04-21 10:34:10 +07:00
Alex Sharov
8d81c3b0f8
Rwdir fix2 ( #3915 )
2022-04-19 08:55:46 +07:00
Alex Sharov
e1d7cc3d3f
Enable: syncmode=snap by default (goerli, mainnet, bsc) ( #3910 )
2022-04-18 14:40:40 +07:00
ledgerwatch
78a58047dc
Fix in recompression ( #3884 )
...
* Fix in recompression
* Fix error handling
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-14 11:07:17 +07:00
ledgerwatch
156da607e7
More compact representation of huffman trees in the seg files ( #3875 )
...
* More compact representation of huffman trees in the seg files
* Update to latest erigon-lib
* recompress
* recompress
* recompress
* uncompress: buf fix
* Update to latest erigon-lib
* Revert default sync mode
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2022-04-13 16:29:44 +01:00
alex.sharov
482e06ead3
uncompress: buf fix
2022-04-13 16:35:21 +07:00
alex.sharov
594477ab23
uncompress: buf fix
2022-04-13 12:45:22 +07:00
alex.sharov
6cbbfb46eb
recompress
2022-04-12 14:53:21 +07:00
Alex Sharov
b6334870e8
Snapshots: recompress.sh ( #3845 )
...
* save
* save
2022-04-07 13:26:14 +07:00
Alex Sharov
80bd44fce5
Snapsthos: build indices on retire blocks ( #3823 )
...
* grpc up
* grpc up
* grpc up
2022-04-05 16:22:11 +07:00
alex.sharov
4fb2a14756
add readahead to segment uncompress pipe
2022-04-04 21:07:02 +07:00
alex.sharov
32467007c1
snapshots: auto fix
2022-04-02 13:28:18 +07:00
Alex Sharov
8b03582558
compressor: log lvl #408
...
* save
* save
2022-04-01 10:44:30 +07:00
Alex Sharov
328c7b28a6
compress uncompress cli methods ( #3798 )
2022-03-31 14:10:40 +07:00
Alex Sharov
89d4477df3
Snapshots: nil indices on p2p fix ( #3772 )
2022-03-27 10:07:58 +07:00
Alex Sharov
a357421719
Snapshots: notify rpcdaemon about new snapshot ( #3755 )
2022-03-24 09:25:38 +07:00
EXEC
a6ff889db9
Fix erigon version miss git commit ( #3738 )
2022-03-19 09:36:00 +07:00
Alex Sharov
f314222180
Snapshots: start seed new large .seg files ( #3724 )
2022-03-18 11:12:18 +07:00
Alex Sharov
469b75c3d3
Snapshots: retire blocks by default ( #3707 )
2022-03-16 09:57:48 +07:00
Alex Sharov
f03d08c5ce
Snapshots: retire testing tool ( #3684 )
2022-03-12 17:26:11 +07:00
