Alex Sharov
86551e82f4
e3: parallel build missed indices ( #5817 )
2022-10-21 13:45:20 +07:00
Alex Sharov
b12b0d4627
e3: history bsc and mainnet snapshots ( #5725 )
2022-10-13 09:46:32 +07:00
Alex Sharov
a9853d2ef8
Recon parallel: split ReconState to 2 objects to avoid lock contention between .Done() and .Get(), less ram in beginning ( #5713 )
2022-10-12 17:23:10 +07:00
Alex Sharov
4795217e4e
e3: prevent files ranges overlap ( #5684 )
2022-10-12 10:18:55 +07:00
Alex Sharov
93e912b0ee
fix nil ptr in integration ( #5656 )
...
for https://github.com/ledgerwatch/erigon/issues/5651
2022-10-07 13:37:52 +07:00
Alex Sharov
ca9aa4723c
Compress params change ( #5631 )
...
as of https://github.com/ledgerwatch/erigon-lib/pull/651
2022-10-05 17:54:54 +07:00
Alex Sharov
c48d51a582
snapshot index workers amount - based on available RAM and CPU ( #5524 )
2022-10-05 17:07:01 +07:00
ledgerwatch
fd52a788b7
Fix creation of block snapshots ( #5579 )
...
* Print snapshot prune
* More print
* Print
* Print
* Print
* Move snapshots stage forward
* Cleanup
* Fix tests
* Print
* Too much logging
* Remove print
* Log, check
* Revert
* No panic, print
* Fix tx numbering
* Harder condition to start retiring blocks
* Disable Pow verification after TTD is reached
* Fix POW verifying
* Print
* Prints
* Fix?
* cleanup
* Add migrations and hack
* More diagnostics
* More print
* Reset sequence only once
* Fix migration
* Remove print reset
* Fix lint
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-10-04 11:14:18 +01:00
Alex Sharov
15cac71f3f
madv helpers ( #5610 )
...
* save
* save
* save
2022-10-04 10:52:56 +01:00
Alex Sharov
fa16d5e855
erigon3: step toward background snapshots build ( #5588 )
2022-10-02 10:21:17 +07:00
Alex Sharov
f4a7d2cf6d
erigon3: build .vi after download ( #5568 )
2022-09-29 12:14:51 +07:00
Alex Sharov
9cac57bcc9
erigon3: set seedable files to 32 steps #5534
2022-09-27 10:51:14 +07:00
Alex Sharov
54343d1d69
save ( #5439 )
2022-09-20 13:09:24 +01:00
Alex Sharov
db622cba4a
remove async snapshots interator ( #5429 )
2022-09-20 09:36:48 +07:00
Alex Sharov
9fb8a190bc
erigon22: folder snapshots/history ( #5351 )
2022-09-18 17:41:01 +07:00
Enrique Jose Avila Asapche
473ca51830
Adding back stage snapshots ( #5331 )
...
* added snapshots into stages list && deleted snapshots from defaul unwind
* added verkle trie
* using the same sentries client hd
* need to safe the stage progress of headers as well
2022-09-12 10:26:00 +07:00
Leonard Chinonso
7495986515
Reverting Adding snapshots as a separate stage commit ( #5329 )
...
* reverting Adding snapshots as a separate stage commit
* more fixes to merge conflicts
2022-09-10 19:05:18 +02:00
Alex Sharov
d1ddb5ee82
erigon22: fix txn overlap ( #5327 )
...
* save
* save
2022-09-10 11:26:58 +07:00
Enrique Jose Avila Asapche
6d1d3a9f47
moved retiring of blocks from senders into snapshot stage ( #5290 )
2022-09-09 21:48:16 +07:00
Alex Sharov
8813ea87fd
Erigon22: add state reconstitution to stage_exec ( #5321 )
2022-09-09 14:40:25 +07:00
Alex Sharov
caa23b9532
erigon22: simplify interhashes stage ( #5315 )
2022-09-08 14:02:50 +07:00
ledgerwatch
da90c9752e
Fix for goerli resync ( #5269 )
...
* Fix for goerli resync
* Fix
* Fix lint
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-09-04 14:51:36 +01:00
Enrique Jose Avila Asapche
8fc7c78620
Bor txlookup ( #5260 )
...
* printing
* logging
* spam off
* ops
* clean up
* deleted all bor related stuff in snapshots
* adding bor tx to BorTxLookUp
* added readBorTxLookUp
* getting bor tx from bor lookup
* comments
* deleted bor related stuff
* deleting bor tx
* writing borTxLookUp in stage_txlookup
* using bytes
* little fixes
* updated erigon-lib
* using biEndian
* clean up
* setting bytes for big int
* log
* logging
* more logs
* delete logs
2022-09-02 17:41:58 +03:00
Enrique Jose Avila Asapche
8b3162a4c7
Small capacity ( #5244 )
...
* typo
* no log
* using headerBuf[1:]
2022-08-31 21:25:03 +07:00
Enrique Jose Avila Asapche
12331e018a
Fix bor txlookup ( #5170 )
2022-08-30 17:23:16 +03:00
Alex Sharov
c898c2a242
allow nil segment ( #5224 )
...
* Alpha modification
* save
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-08-30 11:01:26 +07:00
Alex Sharov
d33096eaa7
erigon22: tests support ( #5196 )
2022-08-26 16:54:54 +07:00
Håvard Anda Estensen
beeccc0f5f
Remove capitalization and trailing newlines from err strings ( #5186 )
2022-08-26 13:20:19 +07:00
Håvard Anda Estensen
7c15ed59e4
Enable prealloc linter ( #5177 )
...
* Enable prealloc linter
* Set inital slice len to 0
2022-08-26 10:04:36 +07:00
Alex Sharov
69fbfc9bef
Snapshots: Erigon update list in db only after Downloader confirmation, rpcdaemon read list from db ( #5150 )
2022-08-23 16:28:07 +07:00
Alex Sharov
db95b9a194
RPCDaemon: improve UX - when erigon not available - still can use snpashots ( #5073 )
2022-08-16 15:45:27 +07:00
Alex Sharov
a9801d36db
fix nil pointer at startup when not all indices available yet #5070
2022-08-16 08:44:41 +07:00
Alex Sharov
1a1b606146
erigon22: unwind code ( #5058 )
2022-08-15 10:27:32 +07:00
Alex Sharov
e27f669a3f
erigon2.2: save stage progress to chainDB, can run "integration stage_exec" and "state erigon22" on same datadir ( #5033 )
2022-08-13 11:17:24 +07:00
Alex Sharov
4594ce5ef7
erigon22: history.v2 flag, align rpcdaemon22 ( #5016 )
...
* save
* save
* save
* save
* save
2022-08-12 16:13:14 +07:00
Alex Sharov
a7d07ad04d
erigon22 add to exec stage ( #5008 )
...
* save
* save
* save
2022-08-11 21:06:41 +07:00
cgst
f560f3788f
HeaderByHash segment loop should break on result ( #4969 )
2022-08-09 15:03:39 +07:00
Alex Sharov
9595c239c2
erigon22: optimize index.add #571 ( #4965 )
...
* save
* bsc
2022-08-09 10:28:36 +07:00
Alex Sharov
05e5634653
snap indexing: fix logging #4937
2022-08-05 09:01:17 +07:00
Leonard Chinonso
43f5ab09f8
Fixed lint errors for gosec linter ( #4933 )
...
* Fixed lint errors for gosec linter
* Changed uint64 to int64 in common/GetRandInt
* Changed naming of function
2022-08-04 14:59:40 +01:00
Leonard Chinonso
592fe32217
Refactoring To Increase Code Quality ( #4842 )
...
* General cleanup and fixes
* Cleaning part 2
* cleanup part 3
* Refactored staterunner to have a handler function
* Fixed linting
* Cleanup part 4
* Changed the initialization of the require package and updated .golangci.yml
* Fixed lint errors from golangci-lint
* deleted state_recon_1.go
* fixed build error
* Added ReadHeaderTimeouts for httpServer
* made changes to golangci
* Reset golangci.yml
2022-08-04 20:23:00 +07:00
Enrique Jose Avila Asapche
a0da31bb1d
Transaction count fix ( #4888 )
...
* getBlockTransactionCountByHash using snapshots
* got body from block reader
* requesting block body with transactions
* tests
* added tx amount into blocreader body
* using txAmount from body
2022-08-04 18:49:53 +07:00
Alex Sharov
1413b1c37c
Sn: parallel files indexing progress logs ( #4925 )
2022-08-04 12:31:25 +07:00
Alex Sharov
eb07869065
fix --snap.keepblocks flag use ( #4924 )
2022-08-04 10:03:39 +07:00
Alex Sharov
c3777f2820
Sn better log indexing2 ( #4923 )
...
* auto-build-idx
* save
* save
2022-08-04 09:55:06 +07:00
Alex Sharov
b1db36eb09
snap: better log indexing ( #4921 )
2022-08-04 09:39:29 +07:00
Alex Sharov
e60b38e283
decompress: catch maxDepth underflow ( #4882 )
...
* save
* save
2022-08-01 12:40:00 +07:00
Alex Sharov
a50d4c2852
snap indexing: less logs ( #4877 )
2022-08-01 11:07:07 +07:00
Alex Sharov
bd4bed5933
fix 64kb pageSize page_full corner case ( #4847 )
2022-08-01 11:03:28 +07:00
Alex Sharov
aee4b53788
save list of snapshots in db ( #4777 )
...
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
2022-07-28 16:57:38 +07:00
