Commit Graph

983 Commits

Author SHA1 Message Date
Andrew Ashikhmin
55fa5d7006
Various fixes and improvements of MemoryMutation (#573)
* Remove duplicate function

* Close cursor in ForAmount

* Correct ForEach & ForPrefix

* Switch GetOne implementation to cursor

* Switch Has implementation to cursor

* Small fixes

* statelessCursors should be cleared in UpdateTxn

* cursorentry -> cursorEntry

* Fix memoryMutationCursor.NextNoDup

* Don't swallow errors

* Fix memoryMutationCursor.First for DupSort tables

* TestFirstAfterClearBucket

* Add TestAutoDupSort

* WithTablessCfg -> WithTablesCfg

* WithTablesCfg -> WithTableCfg

* Add TestAutoDupSort

* Remove memoryMutationCursor.currentPair

* Merge duplicated cursors

* goForward -> resolveCursorPriority

* Extend TestAutoDupSort

* Amend skipIntersection

* Restore currentPair

* Revert "Merge duplicated cursors"

This reverts commit 13ba28f2fd4c63d6ef17254aa93ac05172e37429.

* Revert WithTablessCfg -> WithTableCfg

* Small fix to AppendDup

* Revert "Revert "Merge duplicated cursors""

This reverts commit b94b7612617750d26eebe8b149e5a8d7f219a4db.

* Pay more attention to isTableCleared

* Remove convertAutoDupsort

* Fix DeleteCurrentDuplicates

* Small simplification of memoryMutationCursor.SeekBothRange

* Revert BaseCase -> baseCase

* Revert parameter renaming

* Restore an assertion

* Add TestAutoConversionSeekBothRange

* CursorDupSort doesn't do AutoDupSortKeysConversion
2022-08-11 09:55:28 +02:00
Alex Sharov
71d14b3d85
enable some linters (#577) 2022-08-10 19:08:09 +07:00
Alex Sharov
1e029ac6d8
go1.19 gofmt (#576)
* save

* save
2022-08-10 19:00:19 +07:00
dmitriyselivanov
4a534fd86e
add PendingBlock to EthBackend (#572) 2022-08-10 18:58:13 +07:00
Alex Sharov
3f6d59cb7d
up_metrics version (#575) 2022-08-10 18:39:19 +07:00
Alex Sharov
95e94b2eb5
erigon22: optimize index.add (#571)
* save

* save
2022-08-09 10:28:29 +07:00
Alex Sharov
2be46669d5
Progress type (#568) 2022-08-04 12:31:17 +07:00
Ryan Schneider
8fbf01ca91
mdbx: fix possible semaphore exhaustion on cancelled context (#567) 2022-08-04 11:43:56 +07:00
Andrew Ashikhmin
1d6c297797
Make Delete() remove all values for DupSort tables (#565)
* panic in MemoryMutation.Reset

* Make Delete remove all values for DupSort tables
2022-08-03 15:36:49 +02:00
Alex Sharov
0c9ada1ab0
dir.Exists() method (#564) 2022-08-03 15:07:36 +07:00
Alex Sharov
01585ae2a0
go modules instead of git-subtree (#563)
* save

* save
2022-08-03 11:54:34 +07:00
Alex Sharov
127d1bac5b
decompress: catch maxDepth underflow 2022-08-01 12:37:10 +07:00
Alex Sharov
ea2d29332c
mdbx: better error msg (#561) 2022-08-01 11:13:58 +07:00
Håvard Anda Estensen
ad2344a6cc
Replace ioutil with io and os (#560) 2022-08-01 11:03:48 +07:00
Alex Sharov
b552ed4386
fix 64kb pageSize page_full corner case #557 (#557) 2022-08-01 10:54:35 +07:00
Alex Sharov
dd32747db2
parity_listStorageKeys: *mdbx.MdbxCursor is not kv.CursorDupSort (#559) 2022-07-29 09:13:40 +07:00
Giulio rebuffo
5d7fb4ddb0
Expose Reset (#558)
* exposed Reset()

* exposed Reset()

* unimplemented commit

* complete reset

* complete reset

* complete reset

* better reset

* finished Reset

* fixed memory mutation

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-07-28 22:42:23 +02:00
ledgerwatch
fadc9b21d1
[erigon2.2] Split 2.2 and 2.3 prototype (#548)
* Introduce access functions to history

* Add missing functions

* Add missing functions

* Add missing functions

* Changeover in the aggregator

* Intermediate

* Fix domain tests

* Fix lint

* Fix lint

* Fix lint

* Close files

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-07-28 08:47:13 +01:00
Yusaku Sako
4a04d92840
Fixes an issue where pending transaction push was throttled to at most 1 per 100ms. https://github.com/ledgerwatch/erigon/issues/3892 (#555) 2022-07-27 12:09:20 +07:00
Alex Sharov
f9164fdc82
Log readable (#556)
* save

* save

* save
2022-07-27 12:09:07 +07:00
Alex Sharov
471d790348
kv.Del() remove second parameter (#554)
* save

* save

* save

* save

* save

* save

* save

* save
2022-07-26 12:47:08 +07:00
Alex Sharov
7a1c2f700b
use PrioritizedSend method (#553) 2022-07-26 10:37:29 +07:00
Alex Sharov
bc7fda6c72
fix sort test (#552) 2022-07-26 10:14:58 +07:00
Alex Sharov
e995e5a7a1
kv.Snapshots() implementation #551 2022-07-26 10:13:37 +07:00
Alex Sharov
2cd96f074d
direct_kv (#550) 2022-07-26 09:42:34 +07:00
Alex Sharov
fd0e2d5c4d
kv.Snapshots() grpc method (#549)
* Remove interfaces for replacement

* Squashed 'interfaces/' content from commit 041a3b20

git-subtree-dir: interfaces
git-subtree-split: 041a3b204cceee5348d54bfa683dec6c7cf30d14

* save

* save
2022-07-26 09:28:10 +07:00
TKartist
0436e97a72
memory_mutation_test added (#546)
* tests for GetOne and Put added

* test configured

* multiple tests added

* conflict resolve

* optimized and tests updated

* conflict fix

* tests added and tested with iteration

* conflict resolve

* lint error resolve

* resolve unnecessary code

* memory_mutation_test implemented

* test error fixed

* test error fixed
2022-07-25 09:53:58 +01:00
Alex Sharov
41265c634d
pool: allow non-parsable txs in db, skip them with warning 2022-07-25 13:01:10 +07:00
Andrew Ashikhmin
ecbc039b69
Revert "Added report bad transaction (#541)" (#543)
This reverts commit 1331bb661a.
2022-07-23 17:21:21 +02:00
ledgerwatch
596d10ea2e
Split aggregator to 2.2 and 2.3 versions (#539)
* Split History from Domain

* Add History.prune

* More on history

* Fix HistoryHistory test

* Merge history files

* Scan file test for history

* Add aggregator for erigon 2.2

* Change to generics, introduce contexts

* Delete to belong to Aggregator

* Fix lint

* Fix lint

* Fix lint

* Fix lint

* Use pointers to InvertedIndex again

* Remove prints

* Close embedded InvertedIndex

* Fix closing files

* Print

* Update ci.yml

* More printing

* Fix

* Make InvertedIndex pointer inside History

* Fix

* Update ci.yml

* Remove print

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-07-23 09:06:52 +01:00
Alex Sharov
6f7794e88b
Pool: parse rlp chain id for non-legacy transactions (#542)
* save

* save

* save

* save

* save

* save
2022-07-23 10:11:25 +07:00
Alex Sharov
904ae8d47e
lint up 47.2 (#545) 2022-07-23 10:09:16 +07:00
Alex Sharov
59aa1c78c7
pool_metrics (#544) 2022-07-23 10:04:50 +07:00
TKartist
684c3d3697
Tests with iteration have been added (#538) 2022-07-22 16:50:12 +07:00
Giulio rebuffo
1331bb661a
Added report bad transaction (#541)
Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-07-21 23:29:28 +02:00
Andrew Ashikhmin
046e4165b5
Revert change to (*PendingPool) EnforceBestInvariants() (#537) 2022-07-20 16:49:11 +02:00
Andrew Ashikhmin
114da7eca3
Fix MDBX compilation on macOS (#535) 2022-07-20 12:59:45 +02:00
Andrew Ashikhmin
af5355ee92
Idempotent (*PendingPool) Remove (#534) 2022-07-19 16:05:06 +02:00
Alex Sharov
801970abbd
Mdbx: GC BigFoot (#496) 2022-07-19 16:53:13 +07:00
Alex Sharov
1afc78507e
Grpc up v48 #532 2022-07-19 13:45:47 +07:00
Alex Sharov
378a03c8b6
linter version up #531 2022-07-19 10:55:46 +07:00
alex.sharov
246fc1aa9b save 2022-07-19 10:46:07 +07:00
Alex Sharov
b9efe56597
mdbx: use OS pagesize by default (but > 4Kb, and < 64Kb) #530 2022-07-19 10:39:48 +07:00
TKartist
8b2c02d1fb
Test for kv_mdbx optimized (#528)
* tests for GetOne and Put added

* test configured

* multiple tests added

* conflict resolve

* optimized and tests updated

* conflict fix
2022-07-18 21:36:58 +02:00
Alex Sharov
f23061eed9
compressor: generic sort (#524) 2022-07-18 17:12:39 +07:00
Alex Sharov
ebea2863c1
domain: files generic btree 2022-07-18 16:05:04 +07:00
TKartist
5821ae7bbc
kv_mdbx_test updated (#522)
* tests for GetOne and Put added

* test configured

* multiple tests added

* conflict resolve
2022-07-18 14:27:03 +07:00
Alex Sharov
79b0932f41
commitment: generic btree, part2 #525 2022-07-18 14:25:20 +07:00
Alex Sharov
763370a3ce
commitment: generic btree #523 2022-07-18 11:46:38 +07:00
Giulio rebuffo
21aa65c1c3
Silence errors for mdbx_get no data (#521)
* removed empty data cursors operations

* ops

* ops
2022-07-14 18:05:25 +02:00