Commit Graph

995 Commits

Author SHA1 Message Date
Alex Sharov
59dfcc471c
erigon22: prune - check key existance (#588) 2022-08-15 14:33:32 +07:00
Alex Sharov
4945162dd7
erigon22: unwind code #587 2022-08-15 10:27:08 +07:00
ledgerwatch
e160c1ad9c
Optimise state erigon2.2 reconstitution (#570)
* Start iterator1

* No parallel buildFiles and mergeFiles

* Optimise GetNoState

* Fixes

* Fix 2

* Another fix

* Fix

* More changes iter

* Provide keys in ScanIterator

* Tables for bitmaps

* Add X tables

* Change signature of GeNoState

* More on changes iterator

* Test for changed keys iterator

* ReconDb tables

* Changed key iterator

* Fix lint

* Fix lint

* uncovert

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alex Sharp <alexsharp@alexs-mbp.lan>
2022-08-14 14:56:47 +01:00
Alex Sharov
404276494a
state22.Unwind() (#586) 2022-08-14 17:53:53 +07:00
Alex Sharov
0b68b61b52
fix for loop 2022-08-14 10:21:38 +07:00
Enrique Jose Avila Asapche
491cdeb434
fixing c-99 (#579)
* fixing c-99

* using c99 at compile

* back to before

Co-authored-by: Enrique Jose Avila Asapche <enriavil1@Enriques-MacBook-Pro-2.local>
2022-08-13 18:15:35 +03:00
Alex Sharov
27ce06026f
Aggregator22.Unwind() (#584) 2022-08-13 18:51:23 +07:00
Alex Sharov
8e9ea275cd
txpool: reduce db growth step #583 2022-08-12 23:02:40 +07:00
Alex Sharov
dfb87cc33b
expose_growth_step (#582) 2022-08-12 22:59:28 +07:00
Alex Sharov
6289ca7519
dir.Recreate() (#581) 2022-08-12 22:38:29 +07:00
Alex Sharov
8ed848acbc
dir.Recreate() (#580) 2022-08-12 17:48:00 +07:00
Leonard Chinonso
c96a22dcdc
WIP: Fix null pointer reference error in rpcdaemon (#578)
* saving changes for draft PR

* typo

* Revert "typo"

This reverts commit a7d96e384e87eeceff1a6c51a2bed659eb014ad0.

* checking if reclected value is nil

* Removed print statements

* Removed unused import

* forcing lint ignore

Co-authored-by: Enrique Avila <eavilaasapche@gmail.com>
2022-08-12 12:12:20 +03:00
Andrew Ashikhmin
55fa5d7006
Various fixes and improvements of MemoryMutation (#573)
* Remove duplicate function

* Close cursor in ForAmount

* Correct ForEach & ForPrefix

* Switch GetOne implementation to cursor

* Switch Has implementation to cursor

* Small fixes

* statelessCursors should be cleared in UpdateTxn

* cursorentry -> cursorEntry

* Fix memoryMutationCursor.NextNoDup

* Don't swallow errors

* Fix memoryMutationCursor.First for DupSort tables

* TestFirstAfterClearBucket

* Add TestAutoDupSort

* WithTablessCfg -> WithTablesCfg

* WithTablesCfg -> WithTableCfg

* Add TestAutoDupSort

* Remove memoryMutationCursor.currentPair

* Merge duplicated cursors

* goForward -> resolveCursorPriority

* Extend TestAutoDupSort

* Amend skipIntersection

* Restore currentPair

* Revert "Merge duplicated cursors"

This reverts commit 13ba28f2fd4c63d6ef17254aa93ac05172e37429.

* Revert WithTablessCfg -> WithTableCfg

* Small fix to AppendDup

* Revert "Revert "Merge duplicated cursors""

This reverts commit b94b7612617750d26eebe8b149e5a8d7f219a4db.

* Pay more attention to isTableCleared

* Remove convertAutoDupsort

* Fix DeleteCurrentDuplicates

* Small simplification of memoryMutationCursor.SeekBothRange

* Revert BaseCase -> baseCase

* Revert parameter renaming

* Restore an assertion

* Add TestAutoConversionSeekBothRange

* CursorDupSort doesn't do AutoDupSortKeysConversion
2022-08-11 09:55:28 +02:00
Alex Sharov
71d14b3d85
enable some linters (#577) 2022-08-10 19:08:09 +07:00
Alex Sharov
1e029ac6d8
go1.19 gofmt (#576)
* save

* save
2022-08-10 19:00:19 +07:00
dmitriyselivanov
4a534fd86e
add PendingBlock to EthBackend (#572) 2022-08-10 18:58:13 +07:00
Alex Sharov
3f6d59cb7d
up_metrics version (#575) 2022-08-10 18:39:19 +07:00
Alex Sharov
95e94b2eb5
erigon22: optimize index.add (#571)
* save

* save
2022-08-09 10:28:29 +07:00
Alex Sharov
2be46669d5
Progress type (#568) 2022-08-04 12:31:17 +07:00
Ryan Schneider
8fbf01ca91
mdbx: fix possible semaphore exhaustion on cancelled context (#567) 2022-08-04 11:43:56 +07:00
Andrew Ashikhmin
1d6c297797
Make Delete() remove all values for DupSort tables (#565)
* panic in MemoryMutation.Reset

* Make Delete remove all values for DupSort tables
2022-08-03 15:36:49 +02:00
Alex Sharov
0c9ada1ab0
dir.Exists() method (#564) 2022-08-03 15:07:36 +07:00
Alex Sharov
01585ae2a0
go modules instead of git-subtree (#563)
* save

* save
2022-08-03 11:54:34 +07:00
Alex Sharov
127d1bac5b
decompress: catch maxDepth underflow 2022-08-01 12:37:10 +07:00
Alex Sharov
ea2d29332c
mdbx: better error msg (#561) 2022-08-01 11:13:58 +07:00
Håvard Anda Estensen
ad2344a6cc
Replace ioutil with io and os (#560) 2022-08-01 11:03:48 +07:00
Alex Sharov
b552ed4386
fix 64kb pageSize page_full corner case #557 (#557) 2022-08-01 10:54:35 +07:00
Alex Sharov
dd32747db2
parity_listStorageKeys: *mdbx.MdbxCursor is not kv.CursorDupSort (#559) 2022-07-29 09:13:40 +07:00
Giulio rebuffo
5d7fb4ddb0
Expose Reset (#558)
* exposed Reset()

* exposed Reset()

* unimplemented commit

* complete reset

* complete reset

* complete reset

* better reset

* finished Reset

* fixed memory mutation

Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-07-28 22:42:23 +02:00
ledgerwatch
fadc9b21d1
[erigon2.2] Split 2.2 and 2.3 prototype (#548)
* Introduce access functions to history

* Add missing functions

* Add missing functions

* Add missing functions

* Changeover in the aggregator

* Intermediate

* Fix domain tests

* Fix lint

* Fix lint

* Fix lint

* Close files

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-07-28 08:47:13 +01:00
Yusaku Sako
4a04d92840
Fixes an issue where pending transaction push was throttled to at most 1 per 100ms. https://github.com/ledgerwatch/erigon/issues/3892 (#555) 2022-07-27 12:09:20 +07:00
Alex Sharov
f9164fdc82
Log readable (#556)
* save

* save

* save
2022-07-27 12:09:07 +07:00
Alex Sharov
471d790348
kv.Del() remove second parameter (#554)
* save

* save

* save

* save

* save

* save

* save

* save
2022-07-26 12:47:08 +07:00
Alex Sharov
7a1c2f700b
use PrioritizedSend method (#553) 2022-07-26 10:37:29 +07:00
Alex Sharov
bc7fda6c72
fix sort test (#552) 2022-07-26 10:14:58 +07:00
Alex Sharov
e995e5a7a1
kv.Snapshots() implementation #551 2022-07-26 10:13:37 +07:00
Alex Sharov
2cd96f074d
direct_kv (#550) 2022-07-26 09:42:34 +07:00
Alex Sharov
fd0e2d5c4d
kv.Snapshots() grpc method (#549)
* Remove interfaces for replacement

* Squashed 'interfaces/' content from commit 041a3b20

git-subtree-dir: interfaces
git-subtree-split: 041a3b204cceee5348d54bfa683dec6c7cf30d14

* save

* save
2022-07-26 09:28:10 +07:00
TKartist
0436e97a72
memory_mutation_test added (#546)
* tests for GetOne and Put added

* test configured

* multiple tests added

* conflict resolve

* optimized and tests updated

* conflict fix

* tests added and tested with iteration

* conflict resolve

* lint error resolve

* resolve unnecessary code

* memory_mutation_test implemented

* test error fixed

* test error fixed
2022-07-25 09:53:58 +01:00
Alex Sharov
41265c634d
pool: allow non-parsable txs in db, skip them with warning 2022-07-25 13:01:10 +07:00
Andrew Ashikhmin
ecbc039b69
Revert "Added report bad transaction (#541)" (#543)
This reverts commit 1331bb661a.
2022-07-23 17:21:21 +02:00
ledgerwatch
596d10ea2e
Split aggregator to 2.2 and 2.3 versions (#539)
* Split History from Domain

* Add History.prune

* More on history

* Fix HistoryHistory test

* Merge history files

* Scan file test for history

* Add aggregator for erigon 2.2

* Change to generics, introduce contexts

* Delete to belong to Aggregator

* Fix lint

* Fix lint

* Fix lint

* Fix lint

* Use pointers to InvertedIndex again

* Remove prints

* Close embedded InvertedIndex

* Fix closing files

* Print

* Update ci.yml

* More printing

* Fix

* Make InvertedIndex pointer inside History

* Fix

* Update ci.yml

* Remove print

Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2022-07-23 09:06:52 +01:00
Alex Sharov
6f7794e88b
Pool: parse rlp chain id for non-legacy transactions (#542)
* save

* save

* save

* save

* save

* save
2022-07-23 10:11:25 +07:00
Alex Sharov
904ae8d47e
lint up 47.2 (#545) 2022-07-23 10:09:16 +07:00
Alex Sharov
59aa1c78c7
pool_metrics (#544) 2022-07-23 10:04:50 +07:00
TKartist
684c3d3697
Tests with iteration have been added (#538) 2022-07-22 16:50:12 +07:00
Giulio rebuffo
1331bb661a
Added report bad transaction (#541)
Co-authored-by: giuliorebuffo <giuliorebuffo@system76-pc.localdomain>
2022-07-21 23:29:28 +02:00
Andrew Ashikhmin
046e4165b5
Revert change to (*PendingPool) EnforceBestInvariants() (#537) 2022-07-20 16:49:11 +02:00
Andrew Ashikhmin
114da7eca3
Fix MDBX compilation on macOS (#535) 2022-07-20 12:59:45 +02:00
Andrew Ashikhmin
af5355ee92
Idempotent (*PendingPool) Remove (#534) 2022-07-19 16:05:06 +02:00