Alex Sharov
da7ca3cacf
erigon3: build .efi after download #654 ( #5523 )
2022-09-26 15:51:39 +07:00
Alex Sharov
ef9e296efd
erigon method to test decompression speed ( #5464 )
2022-09-22 14:11:39 +07:00
Alex Sharov
50811f9cd6
"erigon snapshots ram" command ( #5449 )
...
* save
* save
* save
2022-09-21 09:18:37 +07:00
Alex Sharov
9fb8a190bc
erigon22: folder snapshots/history ( #5351 )
2022-09-18 17:41:01 +07:00
Enrique Jose Avila Asapche
473ca51830
Adding back stage snapshots ( #5331 )
...
* added snapshots into stages list && deleted snapshots from defaul unwind
* added verkle trie
* using the same sentries client hd
* need to safe the stage progress of headers as well
2022-09-12 10:26:00 +07:00
Leonard Chinonso
7495986515
Reverting Adding snapshots as a separate stage commit ( #5329 )
...
* reverting Adding snapshots as a separate stage commit
* more fixes to merge conflicts
2022-09-10 19:05:18 +02:00
Enrique Jose Avila Asapche
6d1d3a9f47
moved retiring of blocks from senders into snapshot stage ( #5290 )
2022-09-09 21:48:16 +07:00
Alex Sharov
caa23b9532
erigon22: simplify interhashes stage ( #5315 )
2022-09-08 14:02:50 +07:00
Enrique Jose Avila Asapche
8fc7c78620
Bor txlookup ( #5260 )
...
* printing
* logging
* spam off
* ops
* clean up
* deleted all bor related stuff in snapshots
* adding bor tx to BorTxLookUp
* added readBorTxLookUp
* getting bor tx from bor lookup
* comments
* deleted bor related stuff
* deleting bor tx
* writing borTxLookUp in stage_txlookup
* using bytes
* little fixes
* updated erigon-lib
* using biEndian
* clean up
* setting bytes for big int
* log
* logging
* more logs
* delete logs
2022-09-02 17:41:58 +03:00
Enrique Jose Avila Asapche
12331e018a
Fix bor txlookup ( #5170 )
2022-08-30 17:23:16 +03:00
Alex Sharov
69fbfc9bef
Snapshots: Erigon update list in db only after Downloader confirmation, rpcdaemon read list from db ( #5150 )
2022-08-23 16:28:07 +07:00
Alex Sharov
4594ce5ef7
erigon22: history.v2 flag, align rpcdaemon22 ( #5016 )
...
* save
* save
* save
* save
* save
2022-08-12 16:13:14 +07:00
Alex Sharov
aee4b53788
save list of snapshots in db ( #4777 )
...
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
2022-07-28 16:57:38 +07:00
Andrew Ashikhmin
c1f848746d
Update consensus tests to v11 ( #4724 )
...
* Consensus tests update 11
* Add GrayGlacier fork
* Wire currentRandom from tests into PREVRANDAO
* Serenity engine
* Support insertion of PoS blocks in MockSentry
* Introduce marshallTypedTransactionsAsRlpStrings arg into (*Block) RawBody()
* Revert "Introduce marshallTypedTransactionsAsRlpStrings arg into (*Block) RawBody()"
This reverts commit 903fca572be03c7de33318ce177a03a4be34927b.
* Post-merge fix
* Don't wait for Beacon Chain in tests
* Skip powToPosBlockRejection transition test
* ForkChoice in insertPoSBlocks
* Add withPosDownloader arg to MockWithEverything in order to fix TestPoSDownloader
2022-07-26 09:35:38 +02:00
Alex Sharov
68e35417fc
RetireBlocks: encapsulate delete logic
2022-07-23 11:09:16 +07:00
Alex Sharov
cd8b10f57e
snapshot merger: smaller interface ( #4786 )
...
* save
* save
* save
2022-07-22 16:54:05 +07:00
Alex Sharov
66758c7960
RetireBlocks: less arguments ( #4785 )
...
* save
* save
2022-07-22 13:44:42 +07:00
Alex Sharov
e146b66e35
more usage of dirs object #4390
2022-06-07 11:54:04 +07:00
Alex Sharov
a53642b4bf
datadir.Dirs configuration object to group dir config ( #4387 )
2022-06-07 10:24:50 +07:00
Alex Sharov
f838268e44
[wip] Snapshots: more runtime invariants check ( #4350 )
2022-06-03 18:50:01 +07:00
ledgerwatch
bcbb8bec65
Try to prevent double block retire ( #4330 )
...
* Try to prevent double block retire
* Remove print
* More careful setting of segmentsMax
* Print snapshots max
* Clean lists
* Print
* Use Reopen
* Fix
* Remove prints
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-06-02 16:58:38 +01:00
Alex Sharov
0795bcb865
integration: validate syncmode flag ( #4300 )
2022-05-30 09:59:38 +07:00
Alex Sharov
66248c4bfb
Torrent: verify all files ( #4270 )
2022-05-26 12:27:44 +07:00
Alex Sharov
b1b5a319e1
It's safe now to open snapshots at app start ( #4216 )
2022-05-20 14:46:04 +07:00
Alex Sharov
4e7807251a
Ensure snapshotDir not created by accident ( #4164 )
...
* save
* save
* save
2022-05-17 09:40:45 +07:00
Alex Sharov
4ba1f03efe
Snapshots: atomic dir, step 3 ( #4103 )
2022-05-10 09:29:44 +07:00
Alex Sharov
32d8ab34d9
atomic snapshot dir, step 2 ( #4093 )
...
* atomic snapshot dir
* atomic snapshot dir
2022-05-07 14:53:21 +07:00
ledgerwatch
ba987cf262
Remove preverified hashes ( #4088 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-06 15:15:01 +01:00
Alex Sharov
2655d57288
reduce downloader deps ( #4010 )
...
* reduce downloader deps
* reduce downloader deps
2022-04-28 12:13:30 +07:00
Alex Sharov
58c86d550d
Snapshots: Max index parallelism to 4 ( #3925 )
...
* save
* save
* Readme update: built-in rpc daemon and syncmode=snap
* save
* save
* save
2022-04-21 17:49:42 +07:00
Alex Sharov
6aa4999729
Parallel indexing ( #3921 )
2022-04-21 10:34:10 +07:00
Alex Sharov
8d81c3b0f8
Rwdir fix2 ( #3915 )
2022-04-19 08:55:46 +07:00
Alex Sharov
e1d7cc3d3f
Enable: syncmode=snap by default (goerli, mainnet, bsc) ( #3910 )
2022-04-18 14:40:40 +07:00
ledgerwatch
78a58047dc
Fix in recompression ( #3884 )
...
* Fix in recompression
* Fix error handling
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-04-14 11:07:17 +07:00
ledgerwatch
156da607e7
More compact representation of huffman trees in the seg files ( #3875 )
...
* More compact representation of huffman trees in the seg files
* Update to latest erigon-lib
* recompress
* recompress
* recompress
* uncompress: buf fix
* Update to latest erigon-lib
* Revert default sync mode
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2022-04-13 16:29:44 +01:00
alex.sharov
482e06ead3
uncompress: buf fix
2022-04-13 16:35:21 +07:00
alex.sharov
594477ab23
uncompress: buf fix
2022-04-13 12:45:22 +07:00
alex.sharov
6cbbfb46eb
recompress
2022-04-12 14:53:21 +07:00
Alex Sharov
b6334870e8
Snapshots: recompress.sh ( #3845 )
...
* save
* save
2022-04-07 13:26:14 +07:00
Alex Sharov
80bd44fce5
Snapsthos: build indices on retire blocks ( #3823 )
...
* grpc up
* grpc up
* grpc up
2022-04-05 16:22:11 +07:00
alex.sharov
4fb2a14756
add readahead to segment uncompress pipe
2022-04-04 21:07:02 +07:00
alex.sharov
32467007c1
snapshots: auto fix
2022-04-02 13:28:18 +07:00
Alex Sharov
8b03582558
compressor: log lvl #408
...
* save
* save
2022-04-01 10:44:30 +07:00
Alex Sharov
328c7b28a6
compress uncompress cli methods ( #3798 )
2022-03-31 14:10:40 +07:00
Alex Sharov
89d4477df3
Snapshots: nil indices on p2p fix ( #3772 )
2022-03-27 10:07:58 +07:00
Alex Sharov
a357421719
Snapshots: notify rpcdaemon about new snapshot ( #3755 )
2022-03-24 09:25:38 +07:00
EXEC
a6ff889db9
Fix erigon version miss git commit ( #3738 )
2022-03-19 09:36:00 +07:00
Alex Sharov
f314222180
Snapshots: start seed new large .seg files ( #3724 )
2022-03-18 11:12:18 +07:00
Alex Sharov
469b75c3d3
Snapshots: retire blocks by default ( #3707 )
2022-03-16 09:57:48 +07:00
Alex Sharov
f03d08c5ce
Snapshots: retire testing tool ( #3684 )
2022-03-12 17:26:11 +07:00
Alex Sharov
b003d07839
Add system-txs to begin end of block ( #3654 )
...
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* up torrent
* up torrent
* up torrent
* up torrent
* up torrent
* up torrent
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
2022-03-10 07:48:58 +00:00
Alex Sharov
ac15d2b922
snapshots: better logging ( #3611 )
2022-02-24 16:28:46 +07:00
Alex Sharov
b94bc84a3b
snapshots: command to debug retire blocks ( #3603 )
...
* snapshots: command_to_debug_retire
* snapshots: command_to_debug_retire
2022-02-24 11:30:34 +07:00
battlmonstr
e6c056e666
Rename Datadir/dataDir to follow conventions. ( #3576 )
...
* rename from Datadir to DataDir (functions and public vars)
* rename dataDir to datadir (local variables)
2022-02-22 17:39:48 +00:00
Giulio rebuffo
b49381821f
Fixed get-payload and Hanging ForkChoice ( #3575 )
...
* done
* removed sleep
* f
* errors.Is(err, io.EOF) instead of err == io.EOF
Co-authored-by: yperbasis <andrey.ashikhmin@gmail.com>
2022-02-22 14:47:23 +01:00
Alex Sharov
fc278327b9
"erigon snapshots recompress" add test ( #3573 )
2022-02-22 16:02:09 +07:00
Alex Sharov
dbd8a93fa8
"erigon snapshots recompress" to apply new compression rules without db access ( #3571 )
...
* mainnet
* save
* save
* save
* save
2022-02-22 15:35:04 +07:00
Alex Sharov
5cd561bd74
block snapshots merge ( #3558 )
2022-02-22 08:55:24 +07:00
Alex Sharov
226982d293
Use class dir.Rw - to separate Ro and Rw access to snapshotDir ( #3534 )
...
* save
* save
* save
* save
* save
* save
* save
2022-02-18 09:24:17 +07:00
ledgerwatch
d4e623b9e5
[header downloader] introduce queues instead of insertList ( #3489 )
...
* First change for header queues
* Fix
* Fix import
* trigger verification when highestInDb changes
* Print hash, fix MarkAllPreverified
* Fix test
* Cleanup
* More cleanup
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-02-13 11:27:53 +00:00
Alex Sharov
c9cee7a884
path -> filepath (path package is for urls) ( #3493 )
2022-02-12 20:33:09 +07:00
Alex Sharov
2e17b8f515
snapshot: parallel transaction index, recsplit: reset offset collector, etl: faster flush and load ( #3465 )
2022-02-10 14:40:29 +07:00
Alex Sharov
bbf1b5b4bd
Torrent less goroutines ( #3423 )
2022-02-04 12:42:55 +07:00
Alex Sharov
304b40dd0a
Snapshot: prohibit to change cli flags ( #3311 )
2022-01-22 11:18:24 +07:00
Somu Bhargava
c620b1e7c9
Add Erigon Import feature for Hive integration purpose ( #3298 )
2022-01-20 07:34:50 +00:00
