mirror/erigon-pulse
1
0
Fork 0
mirror of https://gitlab.com/pulsechaincom/erigon-pulse.git synced 2024-12-22 19:50:36 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
18,232 Commits 5 Branches 14 Tags 294 MiB
1e575ea172
Commit Graph

49 Commits

Author SHA1 Message Date
Alex Sharov
6439bdd835
txsv3: release small parts (#7632) 2023-06-02 11:38:20 +07:00
Alex Sharov
2865b85888
move e2 snapshots management closer to e3: step 1 (#7543) 
- always RLock all snapshots - to guarantee consistency
- introduce class View (analog of RoTx and MakeContext)
- move read methods to View object
- View object will be managed by temporal_tx

---------

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
 2023-05-22 10:09:46 +07:00
ledgerwatch
b382f96f6c
Introduce logger into etl (#7537) 
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
 2023-05-18 21:20:07 +01:00
alex.sharov
03144279ef fix lint 2023-01-22 20:47:36 +07:00
hexoscott
7dcbfbc283
reference hash, address, and chain config from lib (#6536) 2023-01-13 18:12:18 +00:00
Alex Sharov
8afeee56c8
Downloader extract, step2 (#6076) 2022-11-20 10:41:30 +07:00
Alex Sharov
93926646f8
e3: prepare downloader for extraction (#6061) 2022-11-16 15:48:23 +03:00
Alex Sharov
9fb8a190bc
erigon22: folder snapshots/history (#5351) 2022-09-18 17:41:01 +07:00
Enrique Jose Avila Asapche
8fc7c78620
Bor txlookup (#5260) 
* printing

* logging

* spam off

* ops

* clean up

* deleted all bor related stuff in snapshots

* adding bor tx to BorTxLookUp

* added readBorTxLookUp

* getting bor tx from bor lookup

* comments

* deleted bor related stuff

* deleting bor tx

* writing borTxLookUp in stage_txlookup

* using bytes

* little fixes

* updated erigon-lib

* using biEndian

* clean up

* setting bytes for big int

* log

* logging

* more logs

* delete logs
 2022-09-02 17:41:58 +03:00
Enrique Jose Avila Asapche
12331e018a
Fix bor txlookup (#5170) 2022-08-30 17:23:16 +03:00
Alex Sharov
aee4b53788
save list of snapshots in db (#4777) 
* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save
 2022-07-28 16:57:38 +07:00
Alex Sharov
cd8b10f57e
snapshot merger: smaller interface (#4786) 
* save

* save

* save
 2022-07-22 16:54:05 +07:00
Alex Sharov
5805d963ea
erigon-snapshot: convert from git sumbodule to golang package (#4760) 2022-07-20 09:34:12 +07:00
Enrique Jose Avila Asapche
e768227d38
Merge range (#4749) 
* added merge range into segments

* got rid of missing snapshot errors

* reusing RequestSnapshotDownload

* sleep out of download

* ops

* warning if we are missing snapshots
 2022-07-19 19:27:54 +07:00
Enrique Jose Avila Asapche
8dceb6fe82
Auto download snapshots (#4729) 
* refactored request download

* keeping track of missing snapshots

* using slice mergeRange

* request snapshots on reopen

* passing arguments

* passed in var

* Revert "passed in var"

This reverts commit 90478978dfa9f2a6dd5b1b051fc1d3f9e5f7a9c5.

* Revert "passing arguments"

This reverts commit 1e39c4152003796f6ff0bcfc188512d4a43bd18d.

* Revert "request snapshots on reopen"

This reverts commit d40212b973bc15db2b25cc1b0abb22051a3debb1.

* added downloadRequest
;

* downloading missing headers at start up

* there shouldnt be an error anymore

* not using nil;
;
 2022-07-18 17:42:20 +03:00
Alex Sharov
4e7807251a
Ensure snapshotDir not created by accident (#4164) 
* save

* save

* save
 2022-05-17 09:40:45 +07:00
Alex Sharov
32d8ab34d9
atomic snapshot dir, step 2 (#4093) 
* atomic snapshot dir

* atomic snapshot dir
 2022-05-07 14:53:21 +07:00
Alex Sharov
2655d57288
reduce downloader deps (#4010) 
* reduce downloader deps

* reduce downloader deps
 2022-04-28 12:13:30 +07:00
Alex Sharov
6aa4999729
Parallel indexing (#3921) 2022-04-21 10:34:10 +07:00
Alex Sharov
777412e0bb
Snapshots: notify before remove (#3885) 
* goerli

* goerli
 2022-04-14 14:56:08 +07:00
Alex Sharov
7d86283910
Sapshots: idx merge (#3841) 
* return err on interruption

* save

* save

* save

* save

* save

* save

* save

* save

* save
 2022-04-07 11:27:57 +07:00
Alex Sharov
8b03582558
compressor: log lvl #408 
* save

* save
 2022-04-01 10:44:30 +07:00
Alex Sharov
89d4477df3
Snapshots: nil indices on p2p fix (#3772) 2022-03-27 10:07:58 +07:00
Alex Sharov
a357421719
Snapshots: notify rpcdaemon about new snapshot (#3755) 2022-03-24 09:25:38 +07:00
alex.sharov
752a52c4af fix test 2022-03-21 19:33:26 +07:00
Alex Sharov
f314222180
Snapshots: start seed new large .seg files (#3724) 2022-03-18 11:12:18 +07:00
Alex Sharov
469b75c3d3
Snapshots: retire blocks by default (#3707) 2022-03-16 09:57:48 +07:00
Alex Sharov
aed679c8a0
snapshots: enum file types (#3683) 2022-03-12 15:27:55 +07:00
Alex Sharov
f5be8919ef
snapshots: merge segments strategy (#3645) 
* save

* save

* save
 2022-03-04 14:16:16 +07:00
Alex Sharov
f8c1fb9563
snapshots: speedup slow test (#3623) 2022-02-25 11:42:54 +07:00
Alex Sharov
96e0691d4a
snapshots: delete .idx after merge (#3619) 2022-02-25 11:41:49 +07:00
Alex Sharov
809cfdcf19
snapshots: indexing of recently merged range (#3606) 
* snapshots: fix indexing of recently merged range

* snapshots: fix indexing of recently merged range

* snapshots: fix indexing of recently merged range

* snapshots: fix indexing of recently merged range

* snapshots: fix indexing of recently merged range
 2022-02-24 14:15:03 +07:00
Alex Sharov
81d51e1589
snapshots: better files sort and filter (#3582) 2022-02-23 10:54:35 +07:00
Alex Sharov
ab01d64916
fix close files error on win (#3572) 2022-02-22 16:24:33 +07:00
Alex Sharov
fc278327b9
"erigon snapshots recompress" add test (#3573) 2022-02-22 16:02:09 +07:00
alex.sharov
f624d1cc22 save 2022-02-22 15:33:07 +07:00
alex.sharov
d3c8634df8 fix windows tests 2022-02-22 14:44:57 +07:00
Alex Sharov
5cd561bd74
block snapshots merge (#3558) 2022-02-22 08:55:24 +07:00
Alex Sharov
226982d293
Use class dir.Rw - to separate Ro and Rw access to snapshotDir (#3534) 
* save

* save

* save

* save

* save

* save

* save
 2022-02-18 09:24:17 +07:00
Alex Sharov
c9cee7a884
path -> filepath (path package is for urls) (#3493) 2022-02-12 20:33:09 +07:00
Alex Sharov
bb1d19060f
Add downloader to docker-compose (#3348) 2022-01-26 22:26:33 +07:00
Alex Sharov
304b40dd0a
Snapshot: prohibit to change cli flags (#3311) 2022-01-22 11:18:24 +07:00
Alex Sharov
6fd002eb5a
Snapshot: move old blocks to snapshots (non-async version) (#3309) 
* save

* save
 2022-01-20 12:01:02 +07:00
Alex Sharov
9188705849
Switch to parallel (#3285) 
* save

* save

* save

* save

* save

* save

* save

* save

* save

* save
 2022-01-18 15:01:36 +07:00
Alex Sharov
7390db7b84
Snapshots hashes for mainnet (#3150) 2021-12-21 21:12:32 +07:00
Alex Sharov
ecb10e8548
Snapshots download and seed (#3117) 
* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* Squashed 'interfaces/' content from commit e5b1945d0

git-subtree-dir: interfaces
git-subtree-split: e5b1945d02da7a7f00e2289034ee90a6edd60184

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save
 2021-12-14 10:13:17 +00:00
Alex Sharov
178fd1931d
Genesis sync from existing snapshots (#3087) 2021-12-05 09:03:08 +07:00
Alex Sharov
d4850b6adc
Hack: dump bodies and headers (#2994) 2021-11-20 09:41:01 +07:00
Alex Sharov
861ef7a6c1
Open blocks snapshots (#2957) 2021-11-16 15:33:41 +07:00