Commit Graph

923 Commits

Author SHA1 Message Date
Andrew Ashikhmin
8c89288cbc
Add LastForkchoice table (#405)
* Deprecate TransitionBlock

* Add ForkchoiceHead/Safe/Finalized tables

* Merge Forkchoice* into LastForkchoice
2022-03-31 10:51:23 +02:00
Alex Sharov
af4391d7f9
fix nil pointer in fetch.go (#406) 2022-03-31 15:13:11 +07:00
Alex Sharov
5315a677b5
gsa example to calc repeats (#403) 2022-03-28 10:52:39 +07:00
Alex Sharov
dff0f93abb
GSA simplify and more examples (#402) 2022-03-28 09:02:01 +07:00
Alex Sharov
8846b406eb
gsa: remove terminator (make it closer to SAIS) #400 2022-03-27 13:41:16 +07:00
Alex Sharov
54629aaf7c
Mdbx fix after v0.11.6 (#398)
* save

* save
2022-03-27 07:23:35 +01:00
alex.sharov
3de8cfedd0 gsa print 2022-03-27 11:36:30 +07:00
Alex Sharov
2c61236c58
Generalized suffix array (#396)
* gsa

* gsa

* save

* save
2022-03-26 20:47:27 +07:00
Alex Sharov
8ffada811a
save (#394) 2022-03-25 08:46:18 +00:00
ledgerwatch
7a961a9fc5
Close cursors (#393)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-03-24 22:17:15 +00:00
Andrew Ashikhmin
8d5499792e
[Fix] missing Spammer in (DiscardReason) String() (#391) 2022-03-24 16:24:30 +01:00
ledgerwatch
4e8d577d1d
[erigon2] Switch back to MDBX (#388)
* Switch back to MDBX

* Fix test

* No restore

* Fix overwrite

* Fix change file opening

* Verify state vs change files

* Add WriteMap

* Print

* Not to go to the end of the file when reading

* Fix rebuild

* prefixLen

* Print

* Print

* Print

* Fix for rebuild

* Remove prints

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-03-23 14:35:13 +00:00
alex.sharov
d57ac60832 mocks go1.18 compatible 2022-03-23 09:20:59 +07:00
alex.sharov
9bdcecfec4 clean logs 2022-03-21 19:28:26 +07:00
ledgerwatch
26a8c3c571
[erigon2] Fix rebuild state (#386)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-03-21 07:26:21 +00:00
Alex Sharov
8c4a3df7f1
etl: collector log level (#385) 2022-03-21 11:22:17 +07:00
Alex Sharov
3336796c41
grpc event - new snapshot created (#376) 2022-03-21 11:22:06 +07:00
ledgerwatch
7939c56571
[erigon2] Forward change files (#384)
* Start

* Forward change files

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-03-20 16:14:26 +00:00
ledgerwatch
71751426bc
Fix windows CI for go1.18 (#383)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-03-19 12:37:03 +00:00
ledgerwatch
2b14d6da29
[erigon2] debug delays in the main thread (#379)
* Split handover time

* Clean up

* Correctly compute handover time

* not use compression when aggregating

* Fix for etl collector

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-03-19 12:02:27 +00:00
EXEC
f739b43d8a
Fix OpenFile permission (#382)
`0o755` -> `0755`
2022-03-19 10:50:08 +00:00
Alex Sharov
83951a1d62
Enable more linters (#381) 2022-03-19 11:38:37 +07:00
Alex Sharov
06713f8c96
linter to support go 1.18 (#380)
* save

* save
2022-03-19 10:02:28 +07:00
ledgerwatch
ff3e074549
No handover (#378)
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-03-18 16:09:57 +00:00
ledgerwatch
f93ea948d0
[erigon2] Optimise Huffman decoder (#374)
* Update

* Intermediate

* Huffman decoding

* Fix lint

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-03-18 09:10:18 +00:00
Alex Sharov
1b0bcd89fa
snapshots: grpc event (#377) 2022-03-18 14:47:39 +07:00
Alex Sharov
758de3929f
go 1.18 on ci (#375)
* save

* save
2022-03-18 11:27:44 +07:00
Alex Sharov
e8e8e2f2e6
Pool cost (#373)
* save

* save
2022-03-17 20:16:57 +00:00
Alex Sharov
2193d570a6
Mdbx: WriteMap fallback on open error (#369)
* save

* save
2022-03-16 11:59:11 +00:00
Alex Sharov
05b59ea524
use same version of golang.org/x/crypto with erigon #368 2022-03-16 11:30:33 +07:00
Giulio rebuffo
9b99057af4
fixed bug for h2048 (#367) 2022-03-16 09:59:25 +07:00
Artem Tsebrovskiy
6687e6b4d6
during computeCommitment exits with RootHash when there are no updates to apply (#366) 2022-03-15 17:01:51 +00:00
ledgerwatch
77eb94b53e
Elias fano search and merge (#357)
* Elias fano search and merge

* Add first cut of search

* Iterator and test

* Changes in aggregator

* Elias fano bitmap

* Fix uncompress decompress

* Print

* Print

* No print

* Print

* Print

* Print

* Change to AppendBytes

* Print

* Fix NextUncompressed

* Remove print

* Fix history search

* Fix in history search

* More tracing

* More tracing

* Fix

* Print

* Print key

* More print

* Print

* No deletion for history records

* Remove print

* Fix

* Fix

* Fix test

* Fix lint

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-03-13 22:46:17 +00:00
Alex Sharov
c1f1365f92
cancel compress (#362) 2022-03-12 16:34:58 +07:00
Alex Sharov
c0fcdabf91
compress: less allocs (#361) 2022-03-12 15:33:01 +07:00
ledgerwatch
d3e05fb352
Subscriptions for logs (#279)
* Remove interfaces for replacement

* Squashed 'interfaces/' content from commit 4b4b765

git-subtree-dir: interfaces
git-subtree-split: 4b4b76598f956abcdeae67c50b7c37f055d11b17

* Regenerate bindings

* Remove interfaces for replacement

* Squashed 'interfaces/' content from commit a0b1e1c

git-subtree-dir: interfaces
git-subtree-split: a0b1e1cdbce09fd62c369f25e8ef35cf3972357e

* Rebuild gointerfaces

* Remove interfaces for replacement

* Squashed 'interfaces/' content from commit eea9297

git-subtree-dir: interfaces
git-subtree-split: eea92977065e217c385db8eefe261671fb72c529

* Update to new interfaces

* Remove interfaces for replacement

* Squashed 'interfaces/' content from commit 548970d

git-subtree-dir: interfaces
git-subtree-split: 548970d40b288ed7ef80412e5fdb1144c8ffe129

* Update to gointerfaces

* Update pb

* Add subslogs

* Upd pb

* Add direct for logs

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Andrey Rybnov <ryban92@gmail.com>
2022-03-11 16:33:47 +00:00
Alex Sharov
fb9214d8bb
lint up (#360) 2022-03-11 08:49:54 +07:00
Enrique Jose Avila Asapche
c82e350e63
fixed marshalling error with nil (#354)
* fixed marshalling error with nil

* returning empty byte slice

* returning empty byte slice pt2
2022-03-10 20:24:04 +00:00
battlmonstr
3123b6d895
kv: add NodeRecords nodedb table (#359) 2022-03-10 13:15:15 +01:00
battlmonstr
f54e4c7eae
kv: use SetSyncPeriod from mdbx-go v0.22.16 (#358) 2022-03-10 13:04:08 +01:00
Alex Sharov
6512e3c941
add emptyWordsCount field to .seg file header (breaking .seg format) (#355)
* up torrent

* save

* save

* save

* save

* save

* save

* save
2022-03-10 07:48:37 +00:00
battlmonstr
009358ab2f
kv: expose mdbx SafeNoSync and OptSyncPeriod options (#356) 2022-03-10 10:25:11 +07:00
ledgerwatch
75b52ac25e
[compress] Allow uncompressed words (#350)
* Intermediate work

* Allow uncompressed words

* Fix

* Fix tests

* Add NextUncompressed, remove g.word buffer

* Code simplifications, no goroutines when workers == 1

* Fix lint|

* Add test for MatchPrefix

* Work on patricia

* Beginning of new matcher

* Fuzz test for new longest match

* No skip

* Fixes

* Fixes

* More tracing

* Fixes

* Fixes

* Change back to old FindLongestMatches

* Switch to old match finder

* Print mismatches

* Fix

* After fix

* After fix

* After fix

* Print pointers

* Fixes and tests

* Print

* Print

* Print

* More tests

* Intermediate

* Fix

* Fix

* Prints

* Fix

* Fix

* Initialise matchStack

* Compute only once

* Compute only once

* Switch back

* Switch to old Find

* Introduce sais

* Switch patricia to sais

* Use sais in compressor

* Use sais in compressor

* Remove unused code

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2022-03-09 17:25:22 +00:00
Alex Sharov
a2cbecf373
[wip] KV: limit amount of parallel read txs (#352)
* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* save

* a

* a

* a

* a

* save

* save

* save

* save

* save
2022-03-07 12:21:59 +00:00
Alex Sharov
56d528b1f0
save (#353) 2022-03-04 09:13:15 +07:00
Alex Sharov
ebfbf92936
mdbx_v0.11.5 (#351) 2022-02-25 07:42:48 +00:00
Giulio rebuffo
2fc62cd2f5
prevrandao (#349) 2022-02-24 16:18:01 +01:00
racytech
7763945374
Reverted 3 last commits (#348)
* Revert "unnecessary includes removed"

This reverts commit 76406bb78b.

* Revert "local dev setup"

This reverts commit ac06fd9400.

* Revert "compress/cgo-addition"

This reverts commit fae7683d46, reversing
changes made to e3e108c6c4.
2022-02-24 14:39:42 +00:00
Kairat Abylkasymov
fae7683d46 compress/cgo-addition 2022-02-24 06:28:01 -05:00
Kairat Abylkasymov
76406bb78b unnecessary includes removed 2022-02-24 06:21:25 -05:00