Commit Graph

852 Commits

Author SHA1 Message Date
Alex Sharov
9f5b2b6391
don't log inside library about db close #442 2022-05-10 08:55:32 +07:00
Alex Sharov
da133c2d97
save (#440) 2022-05-07 12:39:03 +01:00
ledgerwatch
dd3e7fd537
Update decompress.go (#439) 2022-05-06 14:55:11 +01:00
Artem Tsebrovskiy
abd93fe9c9
implement bin_patricia_hashed trie (#430)
* commitment: implemented semi-working bin patricia trie

* commitment: added initialize function to select commitment implementation

* deleted reference implementation of binary trie

* added branch merge function selection in accordance with current commitment type

* smarter branch prefix convolution to reduce disk usage

* implemented DELETE update

* commitment/bin-trie: fixed merge processing and storage encoding

* added changed hex to bin patricia trie

* fixed trie variant select

* allocate if bufPos larger than buf size

* added tracing code

* Fix lint

* Skip test

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-05 13:08:58 +01:00
Alex Sharov
c18fea3a8c
fuzzbeta try 2 (#438)
* save

* save
2022-05-04 11:11:34 +07:00
Alex Sharov
625c9f5385
Typed sender (#435)
* save

* Squashed 'interfaces/' content from commit 477d121a

git-subtree-dir: interfaces
git-subtree-split: 477d121aafa9566e1f2f7d478852d800d3822bc5

* save
2022-04-28 15:35:08 +07:00
Alex Sharov
ef2df83bfb
rename field "type" (#434)
* save

* Squashed 'interfaces/' content from commit 9fdbffd

git-subtree-dir: interfaces
git-subtree-split: 9fdbffd8ff5cc8d1061939e9f6dc2e966ba5b284

* save

* save

* save

* save
2022-04-28 15:11:28 +07:00
Alex Sharov
42355b17ee
shorter common.ByteCount for shorter logs #433 2022-04-28 09:56:26 +07:00
Alex Sharov
14f53eefaf
Downloader: calc stat inside, add --torrent.download.slots and limit downloads inside (#432)
* Remove interfaces for replacement

* Squashed 'interfaces/' content from commit cb09f4f

git-subtree-dir: interfaces
git-subtree-split: cb09f4fd4eb9caccf7ece5b5ba05b380a4ce9e33

* save

* save

* Squashed 'interfaces/' content from commit f4847ba

git-subtree-dir: interfaces
git-subtree-split: f4847baccf2c5e35e955f14cbee428f90111dfbf

* save

* save

* Squashed 'interfaces/' content from commit 17196d5

git-subtree-dir: interfaces
git-subtree-split: 17196d54cff8233b1c0c5eadc2f806ac260c2e9d

* save
2022-04-28 09:08:26 +07:00
battlmonstr
5dc5ab7fe1
RPC/Sentry: Peers method (#429)
* interfaces: Peers method in RPC/Sentry

* RPC/Sentry: Peers method

Wrappers and mocks.
GRPC regenerated.
See https://github.com/ledgerwatch/interfaces/pull/102
2022-04-25 19:54:05 +07:00
battlmonstr
c3b4804092
Sentry GRPC: rename Peers to PeerEvents (#427)
* sentry.proto: rename Peers to PeerEvents

* rename Peers() -> PeerEvents()
* rename PeersRequest -> PeerEventsRequest
* rename PeerEvent -> PeerEventId
* rename PeersReply -> PeerEvent

* Sentry GRPC: rename Peers to PeerEvents
2022-04-23 15:43:24 +01:00
battlmonstr
998d2d0d2f
Makefile improvements (#426)
* use $GOBIN everywhere
* make lint builds golangci-lint if needed
* moq rebuilt only if needed
* download protoc only if needed
* separate clean targets
* $PROTOC_INCLUDE
* refactor mkdir $GOBIN
2022-04-22 21:18:44 +07:00
ledgerwatch
64c13d7bdf
Update ci.yml (#425) 2022-04-22 12:56:54 +01:00
Alex Sharov
5f1c2e9011
Torrent peers stat (#424)
* Remove interfaces for replacement

* Squashed 'interfaces/' content from commit 27a7c33

git-subtree-dir: interfaces
git-subtree-split: 27a7c33025b5736ad4ba2b4112634b61d28a26ad

* save
2022-04-22 17:49:38 +07:00
Artem Tsebrovskiy
2a7ebd8e87
[#389] fuzz tests on hex patricia hashed trie (#420)
* commitment: added UniqueRepresentation and fuzz test on HexPatriciaHashed trie

* commitment: added another fuzz test with different inputs

* commitment: fix of roothash of size 33

* adds new updates for unique representation  test to broke it

* Fix lint

* Fix test

* Remove prints

* updated fuzz test and removed useless code

* Remove print

* Cleanup

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-04-22 11:48:59 +01:00
Alex Sharov
6a4882ac98
Min requirement to go 1.18 (#423) 2022-04-22 10:56:29 +07:00
Alex Sharov
3c52757526
Downloader tables (#422)
* save

* save

* save
2022-04-21 10:43:46 +07:00
Alex Sharov
1ac7357005
KV: ReadAhead helper #419 2022-04-18 09:37:01 +07:00
Alex Sharov
fcb49c713a
linter: add rules.go from erigon #418 Open 2022-04-17 09:12:09 +07:00
Alex Sharov
04337fd090
Compress: reduce maxlen to 512 (#416) 2022-04-17 07:59:29 +07:00
ledgerwatch
f18e05186d
Compact huffman representation in files (#414)
* More compact huffman represenation

* Intermediate

* Intermediate

* fix

* Fix lint

* Fix lint

* Fix lint

* Change min file size

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-04-13 12:55:15 +01:00
Alex Sharov
308e04a47b
mdbx: fix assert (#415) 2022-04-12 09:57:21 +07:00
Alex Sharov
da0666bd83
ErigonLib: move types to own package (#413) 2022-04-11 10:02:44 +07:00
alex.sharov
7e185dd983 github actions/cache@v3 2022-04-11 08:54:34 +07:00
ledgerwatch
fbbcc5f48a
Switch to 512 bit peer ID in gprc bindings (#412)
* Remove interfaces for replacement

* Squashed 'interfaces/' content from commit 8d42c07

git-subtree-dir: interfaces
git-subtree-split: 8d42c078a1d5196a02b26b1397716f44974d1bf7

* Regenerate peerId to be 512 bits

* Fixup

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-04-10 07:14:00 +01:00
Alex Sharov
338fe7895a
grpc up (#411) 2022-04-07 11:29:32 +07:00
alex.sharov
9a170d8949 download on empty 2022-04-06 09:34:05 +07:00
Alex Sharov
10d5010b31
validate even no senders #409 2022-04-04 09:46:18 +07:00
Alex Sharov
75b64f01a3
compressor: log lvl #408 2022-04-01 10:44:25 +07:00
Andrew Ashikhmin
8c89288cbc
Add LastForkchoice table (#405)
* Deprecate TransitionBlock

* Add ForkchoiceHead/Safe/Finalized tables

* Merge Forkchoice* into LastForkchoice
2022-03-31 10:51:23 +02:00
Alex Sharov
af4391d7f9
fix nil pointer in fetch.go (#406) 2022-03-31 15:13:11 +07:00
Alex Sharov
5315a677b5
gsa example to calc repeats (#403) 2022-03-28 10:52:39 +07:00
Alex Sharov
dff0f93abb
GSA simplify and more examples (#402) 2022-03-28 09:02:01 +07:00
Alex Sharov
8846b406eb
gsa: remove terminator (make it closer to SAIS) #400 2022-03-27 13:41:16 +07:00
Alex Sharov
54629aaf7c
Mdbx fix after v0.11.6 (#398)
* save

* save
2022-03-27 07:23:35 +01:00
alex.sharov
3de8cfedd0 gsa print 2022-03-27 11:36:30 +07:00
Alex Sharov
2c61236c58
Generalized suffix array (#396)
* gsa

* gsa

* save

* save
2022-03-26 20:47:27 +07:00
Alex Sharov
8ffada811a
save (#394) 2022-03-25 08:46:18 +00:00
ledgerwatch
7a961a9fc5
Close cursors (#393)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-03-24 22:17:15 +00:00
Andrew Ashikhmin
8d5499792e
[Fix] missing Spammer in (DiscardReason) String() (#391) 2022-03-24 16:24:30 +01:00
ledgerwatch
4e8d577d1d
[erigon2] Switch back to MDBX (#388)
* Switch back to MDBX

* Fix test

* No restore

* Fix overwrite

* Fix change file opening

* Verify state vs change files

* Add WriteMap

* Print

* Not to go to the end of the file when reading

* Fix rebuild

* prefixLen

* Print

* Print

* Print

* Fix for rebuild

* Remove prints

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-03-23 14:35:13 +00:00
alex.sharov
d57ac60832 mocks go1.18 compatible 2022-03-23 09:20:59 +07:00
alex.sharov
9bdcecfec4 clean logs 2022-03-21 19:28:26 +07:00
ledgerwatch
26a8c3c571
[erigon2] Fix rebuild state (#386)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-03-21 07:26:21 +00:00
Alex Sharov
8c4a3df7f1
etl: collector log level (#385) 2022-03-21 11:22:17 +07:00
Alex Sharov
3336796c41
grpc event - new snapshot created (#376) 2022-03-21 11:22:06 +07:00
ledgerwatch
7939c56571
[erigon2] Forward change files (#384)
* Start

* Forward change files

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-03-20 16:14:26 +00:00
ledgerwatch
71751426bc
Fix windows CI for go1.18 (#383)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-03-19 12:37:03 +00:00
ledgerwatch
2b14d6da29
[erigon2] debug delays in the main thread (#379)
* Split handover time

* Clean up

* Correctly compute handover time

* not use compression when aggregating

* Fix for etl collector

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-03-19 12:02:27 +00:00
EXEC
f739b43d8a
Fix OpenFile permission (#382)
`0o755` -> `0755`
2022-03-19 10:50:08 +00:00