Commit Graph

866 Commits

Author SHA1 Message Date
Artem Tsebrovskiy
59d810650c
[erigon2] cleanup obsolete code for bin-commitment-trie (#451)
* cleanup obsolete code for bin-commitment-trie

* renamed back test functions for hex, renamed test file for bin trie for consistency
2022-05-19 21:18:03 +01:00
Alex Sharov
7908982ed9
MatchPrefix: limit 2nd loop iterations (#458)
* sf

* sf

* save
2022-05-19 12:27:36 +07:00
Alex Sharov
a8ce14e8cc
option to disable runtime.ReadMemStats (#457)
* save

* save

* save

* save
2022-05-19 11:46:55 +07:00
Alex Sharov
e304418d5a
MatchPrefix: working version (#456) 2022-05-18 14:36:01 +07:00
Alex Sharov
b4776607dc
MatchPrefix: don't compare if prefix longer than word (#455)
* save

* save

* save

* save

* save

* fd
2022-05-18 10:29:19 +07:00
Alex Sharov
b1dc1bfbbf
run go fix ./... (#453) 2022-05-17 14:48:16 +07:00
Artem Tsebrovskiy
6d2181968a
reduce memory footprint during decompression (#452) 2022-05-17 12:38:48 +07:00
Alex Sharov
a86660187d
Test: support of nil value for prefixMatch (#450)
* save

* save

* save

* save
2022-05-16 20:59:29 +01:00
Alex Sharov
91f7d84e60
Generic sort of slices (no allocs, inlinable) (#449)
* save

* save
2022-05-16 08:23:43 +01:00
ledgerwatch
900c03b1ba
Fixes for bin_patricia_hashed (#441)
* Debug bin commitment

* Fix print

* Fix print

* Print

* Print

* Print

* Print

* Print

* Print

* Print

* Print

* Fix binString

* Fix binString

* Fix binString

* Print

* Print

* Print

* Print

* Print

* Print

* Print

* Print

* Print

* Print

* Print

* Print

* Print

* No print

* No print

* Clean up

* Fix lint

* Fixing test

* Skip some tests

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-05-14 20:45:37 +01:00
Alex Sharov
f3f655ec26
Txn tip is u256 (#447)
* save

* save

* save

* save
2022-05-13 12:21:29 +07:00
Alex Sharov
4e257396f4
Kv: GetBool helper (#445)
* save

* save
2022-05-10 14:51:32 +07:00
Alex Sharov
bf0e20e80c
Rename sentry.ControlServerImpl to sentry.MultyClient and sentry.SentryServerImpl to sentry.GrpcServer #444 2022-05-10 12:17:19 +07:00
Alex Sharov
d882a11c67
up linter version (#443)
* save

* save

* save

* save
2022-05-10 10:14:02 +07:00
Alex Sharov
9f5b2b6391
don't log inside library about db close #442 2022-05-10 08:55:32 +07:00
Alex Sharov
da133c2d97
save (#440) 2022-05-07 12:39:03 +01:00
ledgerwatch
dd3e7fd537
Update decompress.go (#439) 2022-05-06 14:55:11 +01:00
Artem Tsebrovskiy
abd93fe9c9
implement bin_patricia_hashed trie (#430)
* commitment: implemented semi-working bin patricia trie

* commitment: added initialize function to select commitment implementation

* deleted reference implementation of binary trie

* added branch merge function selection in accordance with current commitment type

* smarter branch prefix convolution to reduce disk usage

* implemented DELETE update

* commitment/bin-trie: fixed merge processing and storage encoding

* added changed hex to bin patricia trie

* fixed trie variant select

* allocate if bufPos larger than buf size

* added tracing code

* Fix lint

* Skip test

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-05-05 13:08:58 +01:00
Alex Sharov
c18fea3a8c
fuzzbeta try 2 (#438)
* save

* save
2022-05-04 11:11:34 +07:00
Alex Sharov
625c9f5385
Typed sender (#435)
* save

* Squashed 'interfaces/' content from commit 477d121a

git-subtree-dir: interfaces
git-subtree-split: 477d121aafa9566e1f2f7d478852d800d3822bc5

* save
2022-04-28 15:35:08 +07:00
Alex Sharov
ef2df83bfb
rename field "type" (#434)
* save

* Squashed 'interfaces/' content from commit 9fdbffd

git-subtree-dir: interfaces
git-subtree-split: 9fdbffd8ff5cc8d1061939e9f6dc2e966ba5b284

* save

* save

* save

* save
2022-04-28 15:11:28 +07:00
Alex Sharov
42355b17ee
shorter common.ByteCount for shorter logs #433 2022-04-28 09:56:26 +07:00
Alex Sharov
14f53eefaf
Downloader: calc stat inside, add --torrent.download.slots and limit downloads inside (#432)
* Remove interfaces for replacement

* Squashed 'interfaces/' content from commit cb09f4f

git-subtree-dir: interfaces
git-subtree-split: cb09f4fd4eb9caccf7ece5b5ba05b380a4ce9e33

* save

* save

* Squashed 'interfaces/' content from commit f4847ba

git-subtree-dir: interfaces
git-subtree-split: f4847baccf2c5e35e955f14cbee428f90111dfbf

* save

* save

* Squashed 'interfaces/' content from commit 17196d5

git-subtree-dir: interfaces
git-subtree-split: 17196d54cff8233b1c0c5eadc2f806ac260c2e9d

* save
2022-04-28 09:08:26 +07:00
battlmonstr
5dc5ab7fe1
RPC/Sentry: Peers method (#429)
* interfaces: Peers method in RPC/Sentry

* RPC/Sentry: Peers method

Wrappers and mocks.
GRPC regenerated.
See https://github.com/ledgerwatch/interfaces/pull/102
2022-04-25 19:54:05 +07:00
battlmonstr
c3b4804092
Sentry GRPC: rename Peers to PeerEvents (#427)
* sentry.proto: rename Peers to PeerEvents

* rename Peers() -> PeerEvents()
* rename PeersRequest -> PeerEventsRequest
* rename PeerEvent -> PeerEventId
* rename PeersReply -> PeerEvent

* Sentry GRPC: rename Peers to PeerEvents
2022-04-23 15:43:24 +01:00
battlmonstr
998d2d0d2f
Makefile improvements (#426)
* use $GOBIN everywhere
* make lint builds golangci-lint if needed
* moq rebuilt only if needed
* download protoc only if needed
* separate clean targets
* $PROTOC_INCLUDE
* refactor mkdir $GOBIN
2022-04-22 21:18:44 +07:00
ledgerwatch
64c13d7bdf
Update ci.yml (#425) 2022-04-22 12:56:54 +01:00
Alex Sharov
5f1c2e9011
Torrent peers stat (#424)
* Remove interfaces for replacement

* Squashed 'interfaces/' content from commit 27a7c33

git-subtree-dir: interfaces
git-subtree-split: 27a7c33025b5736ad4ba2b4112634b61d28a26ad

* save
2022-04-22 17:49:38 +07:00
Artem Tsebrovskiy
2a7ebd8e87
[#389] fuzz tests on hex patricia hashed trie (#420)
* commitment: added UniqueRepresentation and fuzz test on HexPatriciaHashed trie

* commitment: added another fuzz test with different inputs

* commitment: fix of roothash of size 33

* adds new updates for unique representation  test to broke it

* Fix lint

* Fix test

* Remove prints

* updated fuzz test and removed useless code

* Remove print

* Cleanup

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-04-22 11:48:59 +01:00
Alex Sharov
6a4882ac98
Min requirement to go 1.18 (#423) 2022-04-22 10:56:29 +07:00
Alex Sharov
3c52757526
Downloader tables (#422)
* save

* save

* save
2022-04-21 10:43:46 +07:00
Alex Sharov
1ac7357005
KV: ReadAhead helper #419 2022-04-18 09:37:01 +07:00
Alex Sharov
fcb49c713a
linter: add rules.go from erigon #418 Open 2022-04-17 09:12:09 +07:00
Alex Sharov
04337fd090
Compress: reduce maxlen to 512 (#416) 2022-04-17 07:59:29 +07:00
ledgerwatch
f18e05186d
Compact huffman representation in files (#414)
* More compact huffman represenation

* Intermediate

* Intermediate

* fix

* Fix lint

* Fix lint

* Fix lint

* Change min file size

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-04-13 12:55:15 +01:00
Alex Sharov
308e04a47b
mdbx: fix assert (#415) 2022-04-12 09:57:21 +07:00
Alex Sharov
da0666bd83
ErigonLib: move types to own package (#413) 2022-04-11 10:02:44 +07:00
alex.sharov
7e185dd983 github actions/cache@v3 2022-04-11 08:54:34 +07:00
ledgerwatch
fbbcc5f48a
Switch to 512 bit peer ID in gprc bindings (#412)
* Remove interfaces for replacement

* Squashed 'interfaces/' content from commit 8d42c07

git-subtree-dir: interfaces
git-subtree-split: 8d42c078a1d5196a02b26b1397716f44974d1bf7

* Regenerate peerId to be 512 bits

* Fixup

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-04-10 07:14:00 +01:00
Alex Sharov
338fe7895a
grpc up (#411) 2022-04-07 11:29:32 +07:00
alex.sharov
9a170d8949 download on empty 2022-04-06 09:34:05 +07:00
Alex Sharov
10d5010b31
validate even no senders #409 2022-04-04 09:46:18 +07:00
Alex Sharov
75b64f01a3
compressor: log lvl #408 2022-04-01 10:44:25 +07:00
Andrew Ashikhmin
8c89288cbc
Add LastForkchoice table (#405)
* Deprecate TransitionBlock

* Add ForkchoiceHead/Safe/Finalized tables

* Merge Forkchoice* into LastForkchoice
2022-03-31 10:51:23 +02:00
Alex Sharov
af4391d7f9
fix nil pointer in fetch.go (#406) 2022-03-31 15:13:11 +07:00
Alex Sharov
5315a677b5
gsa example to calc repeats (#403) 2022-03-28 10:52:39 +07:00
Alex Sharov
dff0f93abb
GSA simplify and more examples (#402) 2022-03-28 09:02:01 +07:00
Alex Sharov
8846b406eb
gsa: remove terminator (make it closer to SAIS) #400 2022-03-27 13:41:16 +07:00
Alex Sharov
54629aaf7c
Mdbx fix after v0.11.6 (#398)
* save

* save
2022-03-27 07:23:35 +01:00
alex.sharov
3de8cfedd0 gsa print 2022-03-27 11:36:30 +07:00