Commit Graph

57 Commits

Author SHA1 Message Date
Alex Sharov
5932009110
MDBX: configurable corrupt error recommendations (#275)
* save

* save
2022-01-25 15:25:09 +07:00
Alex Sharov
3a2d474940
MDBX: Add recommendations to corruption error message #3337 2022-01-24 10:35:38 +07:00
Alex Sharov
5ba56ae360
Mdbx 0.11.4 (#266) 2022-01-23 09:07:46 +07:00
Alex Sharov
f16aa09cb1
mdbx: MDBX_FORCE_ASSERTIONS=0 (#256) 2022-01-21 11:45:32 +07:00
Alex Sharov
e98482670a
mdbx: fix gc "retry" issue (slowness of gc during commit) (#227)
* mdbx: fix gc "retry" issue (slowness of gc during commit)

* mdbx: fix gc "retry" issue (slowness of gc during commit)
2022-01-11 08:12:20 +00:00
Alex Sharov
0d5d8975d9
Snapshots: create .dat in tmpdir (#225) 2022-01-09 14:43:55 +07:00
Alex Sharov
f5733d438f
Parallel compression (#223) 2022-01-06 14:13:03 +07:00
alex.sharov
dd363aea75 Revert "save"
This reverts commit ef20b06b01.
2021-12-27 15:11:24 +07:00
alex.sharov
ef20b06b01 save 2021-12-27 15:11:00 +07:00
Alex Sharov
6d88f06d4d
save (#187) 2021-11-22 11:41:44 +00:00
iszubok
bf3ea94f77
Updated secp256k1 dependency to v1.0.0 (#144) 2021-11-04 08:35:55 +00:00
Alex Sharov
47f8ac208a
EliasFano: fix jump calculation, fuzzing to trigger jump logic (#145) 2021-11-04 13:25:23 +07:00
Alex Sharov
8213f020f0
recsplit add MustOpen method (#138) 2021-10-31 09:38:10 +07:00
alex.sharov
45dd09b9ae mdbx_v0.10.2_back 2021-10-29 08:15:49 +07:00
Alex Sharov
ec0155d4ed
Mdbx v0.11.0 (#123) 2021-10-22 09:12:39 +07:00
Alex Sharov
66c9c6f3f7
Pool v2: set 10K as default limit for sub-pool, check key existence before delete (#122) 2021-10-21 15:39:28 +07:00
ledgerwatch
967937151d
Fixes for compress, decompressor, and tests (#110)
* Fixes for compress, and first test

* Add decompressor and memory mapping

* Add decompressor and memory mapping

* Fix for windows

* Fix lint

* Fix compile for windows

* More on decompressor

* Fix lint

* Decompress

* Fix lint

* Use decompressor in tests, fixes

* Introduce Index for RecSplit

* Fix compilation on Windows

* close index file on failure

* Fixes to the tests

* Add single Elias Fano, fix recsplit fuzz test

* Fix elias fano

* Add two layer index

* Add two level index to the tests

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-10-16 10:43:41 +01:00
Alex Sharov
206df12e62
mdbx version v0.10.5 (#112) 2021-10-15 09:43:24 +07:00
alex.sharov
581f8c914e Revert "save"
This reverts commit b33c2eed9d.
2021-10-14 13:23:41 +07:00
alex.sharov
b33c2eed9d save 2021-10-14 13:22:37 +07:00
ledgerwatch
083ee83906
Generalise patricia tree, initial compress (#103)
* Generalise patricia tree, initial compress

* Include tranform

* Generalise Insert

* More on compression

* Fix lint

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-10-11 18:31:49 +01:00
Alex Sharov
57c724bbc6
--txpool.pricelimit support (#96) 2021-10-02 17:34:33 +07:00
Alex Sharov
b5be2a9ae3
downgrade mdbx to v0.10.1 (#95) 2021-09-30 09:50:43 +07:00
Alex Sharov
4862356290
Pool: correct new pending txs notifications (#85) 2021-09-21 16:39:41 +07:00
ledgerwatch
f2549ad6ec
Integration of recsplit (#79)
* Integration of recsplit

* Add tables

* Print bucket by bucket

* Not to print all keys

* Print correct bitSize

* switch to []byte

* Optimisation

* Fix

* Fix lint

* Performance improvements

* Print bucket info

* Add tracing

* Fixed split

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-09-20 12:14:49 +01:00
Alex Sharov
71308b02b3
Pool: switch cache to tx.ID(), more metrics (#73) 2021-09-15 20:15:32 +07:00
Alex Sharov
aa7acc120c
Pool: expose mdbx's txID to remote_kv (#71) 2021-09-15 13:11:34 +07:00
ledgerwatch
6dce34ac32
Initial recsplit (#67)
* Initial recsplit

* Move licence

* Fix bucket count and key count

* Check for duplicate kwys

* More recsplit implementation

* Skeleton of recsplit, fuzz test

* Fix lint

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-09-13 18:31:09 +01:00
Alex Sharov
5b8e019246
Pool: add coherent state cache (#68) 2021-09-13 14:31:15 +07:00
ledgerwatch
f79629b98d
Restore version of the codec (#66)
* Restore version of the codec

* Update go.sum

* Update go.sum
2021-09-11 16:48:31 +01:00
ledgerwatch
826f6ce377
Move ETL to erigon-lib (#65)
* Move ETL to erigon-lib

* Add coded

* Remove walk

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-09-11 16:11:41 +01:00
Alex Sharov
71fb498e39
Pool: add grpc server (#53) 2021-09-02 12:25:34 +07:00
Alex Sharov
3e96e72195
merge main (#50) 2021-09-01 08:20:21 +07:00
alex.sharov
036060ef77 save 2021-08-30 10:17:03 +07:00
alex.sharov
e8d09cab9d s 2021-08-29 13:59:10 +07:00
alex.sharov
7506e3c8db save 2021-08-26 09:27:33 +07:00
alex.sharov
4d58c12e37 state changes 2021-08-07 11:53:33 +07:00
Alex Sharov
8a7776090d
Merge pull request #19 from ledgerwatch/pool8
Pool: effectiveTip comparator
2021-08-07 11:42:33 +07:00
alex.sharov
f631f589f3 grpc up 2021-08-07 11:39:38 +07:00
alex.sharov
ab0bfead4f save 2021-08-06 21:20:34 +07:00
alex.sharov
9a9d017866 add localHistory 2021-08-04 11:27:06 +07:00
alex.sharov
72e58240ed save 2021-08-03 15:42:26 +07:00
alex.sharov
630f692051 run 2021-08-01 17:07:17 +07:00
alex.sharov
19373ba2e4 remove zap 2021-07-30 10:01:24 +07:00
Alex Sharov
9d8ca5579b
Merge pull request #9 from ledgerwatch/fix_kv_metrics
kv metrics
2021-07-29 17:41:03 +07:00
alex.sharov
5f20dea6b6 kv metrics 2021-07-29 17:33:03 +07:00
alex.sharov
284ac68930 initial implementation 2021-07-29 15:05:20 +07:00
alex.sharov
ef8fae8a00 log 2021-07-28 13:20:01 +07:00
alex.sharov
ee1d85bc82 move to log15 2021-07-28 11:50:45 +07:00
alex.sharov
8ddf4d68b1 move mdbx and kv 2021-07-28 10:36:06 +07:00