ledgerwatch
5ad449ef22
Migration to fix receipts (broken due to change of CBOR codec) ( #2221 )
...
* Scan receipts
* Not check tx type before Berlin
* Reverse
* scan receipt code in the migration
* Turn migration on
* Apply migration
* Fix
* Print last
* Remove last
* Not remove last
* Not updata in migration
* no cursors in migration
* Handle empty blocks
* Handle empty blocks
* Use the same code in hack
* Print
* Print
* Save
* Fix
* Fix lint
* Fix lint
* Fix for empty DB
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-06-23 15:05:16 +01:00
Alex Sharov
59d05dc5fe
hide file exists err ( #2218 )
2021-06-22 11:09:45 +01:00
Alex Sharov
2b59b45216
Do log tables size, db metrics - avoid concurrency, check stale readers hourly ( #2216 )
...
* add table size logs and metrics
* log stale readers
* - don't collect db metrics in background
- do check stale readers once an hour
* execution to update metrics when print logs
* hide file exists err
* hide file exists err
2021-06-22 11:08:47 +01:00
ledgerwatch
ab685e90d9
Improvement to the trimTxs ( #2215 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-06-22 08:35:34 +01:00
ledgerwatch
a79ed2fe0b
Utilities to fix DB corruption ( #2214 )
...
* Detect broken ancestry
* Print last canonical headers
* Add backExec
* Cleanup
* Add unwind util
* Add trimTxs utility
* Actually delete tx records
* Avoid infinite loop
* Change strategy
* Close cursor after commmit
* Fix RwBegin issue
* 10m records per transaction
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-06-21 21:52:51 +01:00
Alex Sharov
7d1e17712f
don't create block context twice ( #2213 )
2021-06-21 19:54:41 +01:00
ledgerwatch
04943eaa52
Fix for state corruption without performance regression ( #2208 )
...
* extractHeaders
* Print diff
* Fix for state corruption without performance regression
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-06-21 06:56:45 +01:00
Artem Vorotnikov
d8a009837b
Nuke preimage remnants ( #2203 )
2021-06-20 13:00:22 +07:00
Alex Sharov
a535e8f30c
switch to mdbx-go module, and db-tools to libmdbx submodule ( #2199 )
...
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
2021-06-19 21:30:12 +01:00
Alex Sharov
4736bac190
save ( #2197 )
2021-06-19 21:29:02 +01:00
Alex Sharov
bc271f92ce
To break dependency to db implementation - move all db classes to "ethdb/kv" and leave in "ethdb" only interfaces ( #2195 )
2021-06-19 15:21:53 +07:00
Alex Sharov
de24b427bf
save ( #2196 )
2021-06-19 13:32:35 +07:00
mempirate
ca926ce94d
net_peerCount for remote sentries ( #2192 )
...
* net_peerCount for remote sentries
* cleanup
* Simplify NetPeerCount using SentryClient
* Refactor id -> count
2021-06-18 14:34:15 +01:00
ledgerwatch
535ce8fb9c
Try to solve sentry hanging problem + p2p impovement from geth ( #2191 )
...
* Try to solve sentry hanging problem + p2p impovement from geth
* Fix import
* Finer stream lock
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-06-18 12:47:46 +01:00
Alex Sharov
e9f510c2b7
erigon as lib ( #2186 )
2021-06-18 10:35:11 +07:00
mempirate
e51b09da0d
Implements net_peerCount RPC call for internal sentries ( #2172 )
...
* Implement API and protobuf
* Squashed 'interfaces/' content from commit cd3eca28e
git-subtree-dir: interfaces
git-subtree-split: cd3eca28e50367af9de52fca863b1d7528bff774
* Implement net_peerCount RPC call
* Squashed 'interfaces/' content from commit cd3eca28e
git-subtree-dir: interfaces
git-subtree-split: cd3eca28e50367af9de52fca863b1d7528bff774
* Fixing merge conflicts
* Remove p2p.Server from Ethereum backend
* Fix peerCount calculation for internal sentries
* Bump eth backend API version
* Update rpcdaemon README
* Document version change
2021-06-17 22:55:20 +01:00
ledgerwatch
9d03cd4bf4
trace compatibility with OE (sometimes bug for bug) ( #2174 )
...
* Initial investigations
* Add compatibility option, cleanup
* More cleanup
* Better error handling for streaming RPC requests
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-06-16 18:24:56 +01:00
ledgerwatch
8a166204b4
Fix for peer not found messages ( #2181 )
...
* Fix for peer not found messages
* Print proto on disconnects too
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-06-16 17:18:19 +01:00
Alex Sharov
f63d12405a
Sender stage hangs ( #2177 )
...
* - add context for goroutines shutdown
- use 1 select for all channels to avoid deadlock
* - add context for goroutines shutdown
- use 1 select for all channels to avoid deadlock
- integration: senders to use right chainconfig
2021-06-16 14:04:44 +01:00
Artem Vorotnikov
af836a6200
Nuke LMDB ( #2167 )
2021-06-16 13:57:58 +03:00
Alex Sharov
372ab9060a
add chain support to ( #2176 )
2021-06-16 11:31:25 +07:00
Alex Sharov
dcf850dd75
fix fieldalignment linter warnings ( #2171 )
2021-06-16 11:00:35 +07:00
Artem Vorotnikov
9a8c0f9669
Always enable eth65 ( #2166 )
...
* Always enable eth65
* Add ListenAddr65 to defaults
2021-06-15 17:57:26 +01:00
Alex Sharov
b160e30652
Send GetBlockHeaders immediately if TD of connected peer >= our TD ( #2169 )
...
* empty engine
* start sync from peer right after handshake if it's TD is higher
* fixCanonicalChain to print logs
* clean
* >
2021-06-15 13:43:55 +01:00
Artem Vorotnikov
0a4e0d1fa1
Various code simplificaitons ( #2165 )
...
* simplify randomaccount
* simplify execution unwind
* Remove standalone account accessors
2021-06-14 19:52:30 +01:00
ledgerwatch
2c1fe2a3a7
Restore TD records ( #2164 )
...
* Insert missing TD values
* Print missing TD records
* Fix typo
* Apply fix
* Fixes in execution stage
* Fix tx/sec output
* Advance exec
* Reset unwind
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-06-14 19:51:57 +01:00
Alex Sharov
b79823d1b9
create dir for node keyfile ( #2161 )
2021-06-14 07:35:22 +01:00
ledgerwatch
0f64df626a
Util to dump state ( #2159 )
...
* Util to dump state
* Extract bodies info
* Fix for extractBodies
* Fix typo
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-06-14 07:34:36 +01:00
mempirate
89edfe39db
Add --maxpeers cli option ( #2150 ) ( #2158 )
...
* add --maxpeers cli options (#2150 )
* cleanup
2021-06-13 21:14:52 +01:00
BitBaseBit
7ed337cdcc
Implemented panic handling, graceful shutdown and reporting for all goroutines that don't explicitly handle them. ( #2153 )
...
* implemented crash reporting for all goroutine panics that aren't handled explicitly
* implemented crash reporting for all goroutine panics that aren't handled explicitly
* changed node defaults back to originals after testing
* implemented panic handling for all goroutines that don't explicitly handle them, outputting the stack trace to a file in crashreports
* handling panics on all goroutines gracefully
* updated missing call
* error assignment
* implemented suggestions
* path.Join added
* implemented Evgeny's suggestions
* changed path.Join to filepath.Join for cross-platform
* added err check
* updated RecoverStackTrace to LogPanic
* updated closures
* removed call of common.Go to some goroutines
* updated scope capture
* removed testing files
* reverted back to original method, I feel like its less intrusive
* update filename for clarity
2021-06-13 17:41:39 +01:00
ledgerwatch
74862ce607
Upgrade tests to 9.0.2 ( #2147 )
...
* Upgrade tests to 9.0.1
* Fix gas limit rule
* Clean up output
* Update testdata
* Fix tip assigment
* Fix genesis discrepancy
* Skip typeTwo berlin test
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-06-13 14:01:11 +01:00
Alex Sharov
925d17a238
remove lmdb from hack, integration, state packages. remove lmdb dbtools ( #2146 )
2021-06-11 20:31:37 +07:00
ledgerwatch
d1e4edb180
Better compatibility with OE for trace_call and trace_callMany ( #2137 )
...
* Better compatibility for trace_call
* Also for trace_callMany
* non canonical hash error
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-06-11 13:19:10 +01:00
Marin Ivanov
5226d98379
Add ws.compression flag to rpcdaemon ( #2143 )
...
* Add ws.compression flag to rpcdaemon
* Fix WebSocketHandler in tests
2021-06-11 10:21:39 +01:00
Alex Sharov
e1ad20460c
Less obj db in snapshot ( #2142 )
...
* less obj db in snapshot
* less obj db in snapshot
* save
2021-06-11 09:35:26 +01:00
Alex Sharov
eedabfca85
txpool_content ( #2127 )
...
* txpool_content
* txpool_content
* txpool_content
* txpool_content
* Squashed 'interfaces/' content from commit 1e916d013
git-subtree-dir: interfaces
git-subtree-split: 1e916d0137aff7bd9e9356cc203cea5f0ea9c7f1
* add test
* add test
* add test
* merge devel
* save
2021-06-11 09:34:47 +01:00
Alex Sharov
ba56e7a139
extract p2p config out of sentry ( #2126 )
...
* extract p2p config out of sentry
* extract p2p config out of sentry
* extract p2p config out of sentry
* rebase devel
* rebase devel
* add bootnodes to sentry
* add bootnodes to sentry
2021-06-11 09:34:37 +01:00
Evgeny Danilenko
de26634d8d
TEVM status pruning ( #2034 )
...
* use trace for TEVM status
* restore testdata
* fix getting contract from plain state
* unwind
* linters
* reproducible build debug
* debug
* debug
* remove debug
2021-06-11 09:34:25 +01:00
Evgeny Danilenko
20ff2c5d65
EVM test deadlock ( #2136 )
...
* fix EVM test deadlock
* set stateRoot even in case of an error
2021-06-10 16:45:45 +01:00
Alex Sharov
77aba80d8b
fix p2p nodeName ( #2129 )
2021-06-10 08:53:06 +07:00
Alex Sharov
de7d5a94f6
Update Readme.md
2021-06-10 07:50:20 +07:00
Alex Sharov
8abf0317c9
Update Readme.md
2021-06-10 07:49:02 +07:00
ledgerwatch
aae8fddaee
Update README.md ( #2125 )
2021-06-09 11:20:46 +01:00
Alex Sharov
338fc0df26
move snapshot config to constructor ( #2121 )
2021-06-08 09:43:41 +07:00
Alex Sharov
40eaf77eb8
Sokol genesis and chainconfig ( #2116 )
...
* sokol init
* test
* precompiles
* precompiles
* add code
* sokol test
* save
* save
* save
* save
* save
* save
2021-06-07 12:01:54 +01:00
ledgerwatch
c2c63a3715
Clean up DefaultStages ( #2114 )
...
* Clean up DefaultStages
* Fix compile
* Fix compile
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-06-07 12:00:16 +01:00
ledgerwatch
73bb98f686
Move tests 6 ( #2107 )
...
* Move tests 6
* Compile fixes
* Fix lint
* Compile fixes
* Fix compile
* compile fixes
* Compile fix
* Fix consesus/clique
* Cleanup
* Add gas limit
* Print
* Prints
* More print
* Fix
* Reinstate TestGetBlockReceipts66
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-06-06 22:44:14 +01:00
alex.sharov
3aeb186bd1
db faq about RAM
2021-06-06 20:02:15 +07:00
Alex Sharov
dea4378927
move ( #2113 )
2021-06-06 18:17:03 +07:00
Alex Sharov
35fd972a9e
move sync.Run() to kv ( #2112 )
...
* less objdb in tests
* move sync.Run to tx
* move
* move
* move
2021-06-06 10:32:55 +01:00
Artem Vorotnikov
231a130e2d
Remove remnants of silkworm integration ( #2110 )
2021-06-06 09:06:06 +01:00
Andrea Lanfranchi
e6e0a5de3d
Add repo tag to build info ( #2108 )
...
* Add repo tag to build info
* Update Dockerfile
2021-06-06 09:05:30 +01:00
alex.sharov
ef380a0e89
docs of rpcdaemon batch requests
2021-06-06 08:09:25 +07:00
Alex Sharov
5ba3ea162a
Simulated backend and genesis to kv ( #2104 )
...
* move to kv
* move to kv
* move to kv
* move to kv
* move to kv
* move to kv
* merge
* merge
* merge
* merge
* merge
* merge
* merge
* merge
2021-06-05 16:17:04 +01:00
Alex Sharov
6fc8905ce5
Docs read db ( #2103 )
...
* docs for
* allow anonymous viewers of grafana board
2021-06-05 15:10:01 +01:00
ledgerwatch
f7fc4d66ec
Move tests 5 ( #2069 )
...
* Remove silkworm and reader builders
* Switch tests
* Stop from hanging
* Update tests to 9.0.0
* Move tests back
* Moving code around
* Fix lint
* More fixes
* Intermediate
* Fix compile
* Fix compile errors
* Compile errors
* Fix lint
* Comment out more printing
* More simplifications
* Compile fixes
* Compile fix
* More replacements
* More fixes
* More muddling through
* lint
* Exclude dao split test
* Restore sidechains after unwind
* Errors in senders stage, stopped in bodies stage
* Fix compile
* Fix compile
* Fix tests
* More fixes
* More fixes
* Code cleanup
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2021-06-05 11:00:21 +01:00
Alex Sharov
1f13f73045
up version of uint256 lib ( #2082 )
...
* eip 1559_tx_constraints
* eip 1559_tx_constraints
* return error on uint256 overflow
* up uint256 version
* merge master
* fix master
Co-authored-by: ledgerwatch <akhounov@gmail.com>
2021-06-04 17:25:28 +01:00
Chase Wright
4a18262cca
Add eth_callBundle to README ( #2099 )
...
For #2093
2021-06-04 17:25:17 +01:00
Alex Sharov
eee871aedf
Add db label (later will add txpool db) ( #2081 )
...
* add db label - later will add txpool db
* move commit marker to kv_mdbx behind Chain label
* Update migrations.go
* clean
Co-authored-by: ledgerwatch <akhounov@gmail.com>
2021-06-04 15:56:49 +01:00
Alex Sharov
7cd8046c35
Enable p2p receipts ( #2080 )
...
* enable receipts
* enable receipts
* return error on uint256 overflow
* wait for subscription
Co-authored-by: ledgerwatch <akhounov@gmail.com>
2021-06-04 14:33:10 +01:00
b00ris
66c7c669fb
Snapshot builder simplification ( #2064 )
...
* fix test
* get rid of ObjectDatabase
* sn_builder_prototype2
* save state
* save state
* integration step1
* fix lint
* fix
* fix test
* integrate migrator.finish
* fix lint
* fix build
* fix typo
* fix
2021-06-04 13:30:02 +01:00
Alex Sharov
52d35930e8
simplify receipts reading ( #2094 )
...
* simplify receipts reading
* test
2021-06-04 13:28:18 +01:00
Kushal Babel
d509757f8c
Implement historical tx simulation rpc api ( #2093 )
2021-06-04 13:27:21 +01:00
ledgerwatch
43915a73a8
Migration to fix trace_filter ( #2095 )
...
* Migration to fix trace_filter
* Fix to db/tx
* Fix to db/tx
* Error fixes
* Bump KV version
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-06-04 12:45:06 +01:00
ledgerwatch
67d0a2d3ab
Reproduce and fix trace_filter index problem ( #2084 )
...
* Intermediate
* Test for trace_filter
* Clean up
* Clean up
* clean up
* More to the test
* Hack
* Block parameter
* Block parameter
* use mdbx
* Print number of records
* Print keys
* Print index records
* Print block numbers
* Print values in tracecallset
* Print some more
* More printing
* Print froms and tos
* Print startBlock and endBlock
* Tests and fixes
* Cleanup
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-06-04 09:09:57 +01:00
Alex Sharov
0de4ad670a
eip 1559_tx_constraints ( #2079 )
...
* eip 1559_tx_constraints
* eip 1559_tx_constraints
* return error on uint256 overflow
* Fix gas bailout
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-06-03 08:09:56 +01:00
Alex Sharov
759af6a15d
cli param to enable eth65 and counfigure it's port ( #2075 )
...
* cli param to enable eth65
* save
* save
2021-06-02 08:43:24 +01:00
Alex Sharov
50dd17f36c
switch from baikal to calaveras ( #2078 )
2021-06-02 08:42:52 +01:00
Alex Sharov
e34d73f162
Dont exec all blocks in 1 tx ( #2076 )
...
* save
* save
* save
* save
2021-06-02 08:15:17 +01:00
Alex Sharov
737fdcd365
move ethash dags to datadir ( #2074 )
...
* move ethash dags to datadir
* save
2021-06-02 08:03:50 +01:00
Alex Sharov
29fa1aa35a
sentry join streams ( #2059 )
2021-06-01 17:41:10 +07:00
Alex Sharov
017fb69da1
Fix GC chart ( #2071 )
...
* save
* save
2021-06-01 16:53:28 +07:00
ledgerwatch
26904a1851
Remove silkworm and reader builders ( #2068 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-31 18:13:10 +01:00
Alex Sharov
ce006d089d
rpcdaemon allow disable compression ( #2066 )
2021-05-31 17:18:32 +01:00
Alex Sharov
a6dfafd5cd
rename headers to sentry ( #2060 )
2021-05-31 17:20:56 +07:00
alex.sharov
6ca2aacab4
remove left usage of object db in rpcdaemon
2021-05-31 17:12:48 +07:00
ledgerwatch
297e7f44ff
Fetcher fixes ( #2053 )
...
* Fetcher fixes
* Add missing message code
* Avoid warnings
* Correct loop
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-30 19:08:06 +01:00
ledgerwatch
ccc16012a4
Fix typo in sentry (pooledtx 65/66) ( #2051 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-30 13:14:29 +01:00
Alex Sharov
3016b96e88
1 Sentry per protocol ( #2046 )
2021-05-30 09:53:30 +07:00
ledgerwatch
acc562e815
Test refactoring to move to new staged sync ( #2047 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-29 12:46:49 +01:00
Alex Sharov
0d82fc210a
sentry datadir to use same default as erigon ( #2044 )
2021-05-29 10:57:21 +01:00
Alex Sharov
0f2b3cc3de
sentry: better handle grpc errors ( #2045 )
...
* sentry handle grpc errors
* sentry direct client to support context
2021-05-29 10:56:37 +01:00
Alex Sharov
1a943da232
sentry addr comma separate ( #2043 )
2021-05-29 08:12:36 +01:00
Alex Sharov
d27dfafcc6
nat settings similar to tg behaviour ( #2042 )
2021-05-29 08:12:28 +01:00
alex.sharov
e4ee6a1f5b
allow lmdb_to_mdbx create buckets
2021-05-28 08:54:23 +07:00
ledgerwatch
5d6305952a
Simplifications of gas price oracle ( #2036 )
...
* Simplifications of gas price oracle
* Make price suggestion non-concurrent
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-27 20:33:02 +01:00
Evgeny Danilenko
7352b81122
Tevm stage 1 ( #1845 )
...
* convert contracts after block execution
* check if has tevm code
* after review-1
* handle ErrNotFound
* typo
* tests
* tevm code bucket
* testdata
* execute pre-stage
* after merge
* test fix
* test fix
* fix test after merge
* disable translation stage
* after merge
* rename params
* rename to Erigon
* parallelize EVM translation
* fix
* logging and fixes
* fix
* todos
* cleanup
* revert erigorn renaming
* unwind
* tevm unwind
* fix AppData
* non-parallel version
* comments
2021-05-27 14:54:55 +01:00
ledgerwatch
c4f5e9ae08
Update README.md
2021-05-27 11:48:06 +01:00
ledgerwatch
d5c2e5fd9a
checkChangeSet to work with MDBX, load senders for better performance ( #2024 )
...
* CheckchangeSets switch to MDBX
* Load senders
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-27 08:37:23 +01:00
Evgeny Danilenko
74847d77e6
Rename to Erigon ( #2018 )
...
* turbo-geth to erigon
* tg, turbo to erigon
2021-05-26 11:35:39 +01:00
Alex Sharov
e98c1d217b
Sentry mock: mine block with 1 tx ( #2017 )
2021-05-26 14:02:19 +07:00
ledgerwatch
03cb54a606
Activate refund reduction EIP, simplify code ( #2016 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-25 23:26:25 +01:00
ledgerwatch
95bcaf4362
Filter out duplicate messages in sentry ( #2014 )
...
* Filter out duplicate messages in sentry
* Move cache to the function
* Fix usage of blake3
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-25 18:14:17 +01:00
ledgerwatch
81acb34688
Anchor replacement fix 2 ( #2013 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-25 15:00:41 +01:00
ledgerwatch
48940013e9
Anchor replacement fix (Stage1 stuck on minor branch of a fork) ( #2012 )
...
* Anchor replacement fix (Stage1 stuck on minor branch of a fork)
* Remove stray update
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-25 12:18:39 +01:00
ledgerwatch
d8f5df0fd9
Turn on synced status only after initial cycle ( #2006 )
...
* Turn on synced status only after initial cycle
* Update log messages
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-24 16:51:00 +01:00
ledgerwatch
7d98b6504a
Improvements in the mock sentry tests ( #1997 )
...
* Improvements in the mock sentry tests
* GenerateChain to return chainpack
* Fix consensus
* Fix core
* Fix core/state
* Fix eth
* Fix eth/download
* Fix eth/fetcher
* Fix eth/filters
* Fix eth/gasprice
* Fix eth/protocols/eth
* Fix tests
* Fix turbo/stages
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-23 17:10:34 +01:00
ledgerwatch
835b954f5c
State stream to RPC daemon ( #1986 )
...
* Remove interfaces
* Squashed 'interfaces/' content from commit e06631eb4
git-subtree-dir: interfaces
git-subtree-split: e06631eb4d0926c2d6a4f552497b920b4ed8d1bd
* Update KV interface
* Squashed 'interfaces/' changes from e06631eb4..014677ffe
014677ffe Merge remote-tracking branch 'origin/master' into stream
08c32a09e add version method to txPool and ethbackend
5b6bf70b9 Update README.md
7712cb267 Update README.md
f895ece4c save (#37 )
git-subtree-dir: interfaces
git-subtree-split: 014677ffe5bff0dee1a333f06c92e6110d791468
* Fix old interfaces
* Squashed 'interfaces/' changes from 014677ffe..df31e1146
df31e1146 remove action from storage change
git-subtree-dir: interfaces
git-subtree-split: df31e1146c368eda2e2b15ab252b78fba7a0a6f3
* add Accumulator
* add location
* Squashed 'interfaces/' changes from df31e1146..472584639
472584639 Merge remote-tracking branch 'origin/master' into stream
dd6a42724 Refactor of consensus interface (#28 )
git-subtree-dir: interfaces
git-subtree-split: 472584639f637189dfb906ef1ed03665f98d55d2
* Fix compilation in cons
* Pass accumulator to Execution stage
* Fix test
* Pass accumulator to unwind and plain writer
* Add accumulator use to plain writer
* Squashed 'interfaces/' changes from 472584639f..5c36f038b8
5c36f038b8 State change stream to KV (#38 )
REVERT: 472584639f Merge remote-tracking branch 'origin/master' into stream
REVERT: df31e1146c remove action from storage change
REVERT: 014677ffe5 Merge remote-tracking branch 'origin/master' into stream
REVERT: e06631eb4d Fix
REVERT: 9c10d79d2d Fix
REVERT: 61ae9307de Fix
REVERT: 4fcf34ecc5 State change stream to KV
git-subtree-dir: interfaces
git-subtree-split: 5c36f038b87096ffb6b07e90c6762c21b864cd3b
* Add state.stream flag
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-23 15:53:18 +01:00
Alex Sharov
450c79e3ab
move integration to kv ( #1996 )
2021-05-23 12:41:42 +07:00
Alex Sharov
a8e8cab4c5
Less blockchain obj in test ( #1995 )
2021-05-23 10:48:31 +07:00
alex.sharov
be11e9ded4
move setry mock and StageLoopStep to Kv
2021-05-23 10:43:45 +07:00
alex.sharov
defd59d490
move setry mock and StageLoopStep to Kv
2021-05-23 10:39:25 +07:00
Artem Vorotnikov
5655409616
Do not write old block changesets in pruning storage mode ( #1964 )
...
* Remove incremental staged sync
* Do not write old block changesets in pruning storage mode
* Remove pruning flag, put behaviour behind !StorageMode.History
2021-05-22 11:57:10 +01:00
Alex Sharov
14c15cba43
Check version of remote services ( #1989 )
...
* save
* save
* Squashed 'interfaces/' content from commit 08c32a09e
git-subtree-dir: interfaces
git-subtree-split: 08c32a09e40b1e6fcb5922e723191c9477545356
* Revert "Squashed 'interfaces/' content from commit 08c32a09e"
This reverts commit 8393d9fd
* save
* seve
* Squashed 'interfaces/' content from commit dd6a42724
git-subtree-dir: interfaces
git-subtree-split: dd6a42724401f34c21662ca1aa1718effb92320d
* ensure versions compatibility of all remote services
* Revert "Squashed 'interfaces/' content from commit dd6a42724"
This reverts commit 2a764bf9
* Squashed 'interfaces/' content from commit dd6a42724
git-subtree-dir: interfaces
git-subtree-split: dd6a42724401f34c21662ca1aa1718effb92320d
* Revert "Squashed 'interfaces/' content from commit dd6a42724"
This reverts commit 52621846
* Squashed 'interfaces/' content from commit dd6a42724
git-subtree-dir: interfaces
git-subtree-split: dd6a42724401f34c21662ca1aa1718effb92320d
* a
* a
* a
* a
* a
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-22 11:00:13 +01:00
ledgerwatch
729bfab988
Split DBSchema version depending on the database type ( #1990 )
...
* Split DBSchema version depending on the database type
* Fix test
* Fix test
* Fix lint
* Update migrations.go
* Update bucket.go
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-22 10:20:43 +01:00
Alex Sharov
545fe32f68
Mdbx - make it default db. Lazy buckets renaming. ( #1982 )
2021-05-22 10:03:02 +07:00
ledgerwatch
7622e45713
Execution stage slow in download.v2 - drop all tx messages until after initial cycle ( #1985 )
...
* Rollback earlier
* Drop tx messages until after initial cycle
* Fix for stuck Ctrl-C
* Disable windows tests
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-21 20:07:23 +01:00
Alex Sharov
1df1b85d64
move_integration_to_replacement_stages ( #1980 )
2021-05-21 12:21:06 +07:00
Alex Sharov
0be3044b7e
rename ( #1978 )
...
* rename
* rename "make grpc"
* rename "abi bindings templates"
* rename "abi bindings templates"
2021-05-20 19:25:53 +01:00
Alex Sharov
215623da80
Windows support ( #1944 )
2021-05-20 23:46:12 +07:00
ledgerwatch
5f048bc82f
Wrong receipt problem - utility to recover DB ( #1970 )
...
* Wrong receipt hack
* Advance5
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-20 14:28:38 +01:00
Alex Sharov
a92026c218
fix interface conversion ( #1974 )
2021-05-20 19:44:01 +07:00
b00ris
c1bd26cc1f
Add snapshot stages to ReplacementStages ( #1953 )
...
* add snapshot layout stages
* fix lint
2021-05-20 13:17:47 +01:00
Alex Sharov
50934fa5d3
Move chain maiker to kv ( #1972 )
2021-05-20 18:49:33 +07:00
Alex Sharov
9d66aa0fe3
better support for mdbx in snapshots ( #1971 )
2021-05-20 18:12:07 +07:00
Alex Sharov
57880b8817
fixes for dv2 cancelation ( #1968 )
...
* fixes
* fixes
* fixes
* fixes
* fixes
2021-05-20 06:33:55 +01:00
ledgerwatch
79084ede47
[download.v2] Make default ( #1963 )
...
* [download.v2] Make default
* Update server.go
* Fix for tmp files appearing in the current dir
* Fix test
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharov <AskAlexSharov@gmail.com>
2021-05-19 16:19:29 +01:00
Alex Sharov
781a67a4ee
Auto-Close db in tests by using t.Cleanup ( #1956 )
2021-05-19 10:47:28 +07:00
ledgerwatch
2b2153f387
[download.v2] No double p2p server ( #1960 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-19 00:49:38 +01:00
ledgerwatch
19b602a135
Stuck unwind fix, test, and recovery ( #1959 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-19 00:00:57 +01:00
Alex Sharov
cceaf75b16
use t.TempDir() ( #1955 )
2021-05-18 19:13:16 +07:00
ledgerwatch
b2d00c97d8
Mock sentry and initial tests ( #1952 )
...
* More on mock
* Working test with mock sentry
* Simulate unwinding
* Fix MDBX overlapping txs
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-17 21:26:18 +01:00
Alex Sharov
1770beaf9b
fix for nil ( #1950 )
2021-05-17 14:45:57 +01:00
Alex Sharov
0c91bfbf3e
RPCDaemon: support Pending block ( #1942 )
...
* clean
* save
* pubsub
* pubsub
* pubsub
* pubsub
* pubsub
* pubsub
* save
* tx pub-sub
* tx pub-sub
* clean
* clean
* save
* save
* save
* save
* save
* Squashed 'interfaces/' content from commit c469f3ae0
git-subtree-dir: interfaces
git-subtree-split: c469f3ae073b60c8821b61fed2910191080ef835
* save
* save
* save
* save
* Squashed 'interfaces/' changes from c469f3ae0..958dfc669
958dfc669 save
git-subtree-dir: interfaces
git-subtree-split: 958dfc669f8daeefe686a13aa852fb95f1537886
* save
* save
* up some deps
* up some deps
* clean
* test
* test
* test
* test
* test
* test
* test
* test
* test
* test
* test
* test
2021-05-17 13:15:19 +01:00
Alex Sharov
617baac56b
move db tests to kv interface ( #1946 )
2021-05-17 16:54:29 +07:00
Alex Sharov
3d3298cc17
Fix lint ci ( #1945 )
2021-05-17 09:42:24 +07:00
ledgerwatch
86a94e8478
Avoid parsing transactions at Stage3 ( #1940 )
...
* RawBody
* Do not parse transaction during Stage3
* Reinstate delivery channel capacity, add comment
* Correct calculation of tx encoding for hashing
* fix logging of senders stage
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-16 20:01:14 +01:00
ledgerwatch
896be5fbe3
Trace Filter 7 ( #1941 )
...
* use roaring64
* Fix bitmap finalisation
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-16 20:01:04 +01:00
ledgerwatch
f6ac04e53e
Skip flaky tests ( #1943 )
...
* Update send_transaction_test.go
* Update snapshot_builder_test.go
2021-05-16 19:09:12 +01:00
Artem Vorotnikov
66a8c23c37
Remove TrieDbState + other things ( #1925 )
...
* Remove old table from script
* Simplify ChangeSetWriter
* Move state tests to KV
* Simplify TrieCfg
* Port state tests away from TrieDbState
* Remove old MakePreState
* Upgrade t8ntool's MakePreState
* MakePreState2 -> MakePreState
* Remove TrieDbState
2021-05-16 06:21:29 +01:00
ledgerwatch
b47367eb8d
Defer tx pool start until the initial cycle end ( #1937 )
...
* Defer tx pool start until the initial cycle end
* Not print dropped messages
* Fix mock sentry test
* Fix test import cycle|
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-15 12:35:28 +01:00
ledgerwatch
7eefcbe6a6
fix RPC notification, add boilerplate for tests ( #1936 )
...
* fix RPC notification, add boilerplate for tests
* Fix test
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-14 22:16:16 +01:00
Alex Sharov
2ff6ce7d92
move staged sync to tx ( #1897 )
2021-05-14 18:00:20 +07:00
ledgerwatch
44cb94b906
Use chainname for preverified hashes ( #1927 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-13 09:32:09 +01:00
ledgerwatch
ebf20b1adc
Peer logging in sentry + fresh hashes for mainnet and ropsten ( #1924 )
...
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-13 01:04:07 +01:00
ledgerwatch
61df34b080
Fix headers subscriptions for download.v2 ( #1923 )
...
* Fix headers subscriptions for download.v2
* Use datadir to place nodes database for sentry
* Enable request chaining only after initial cycle
* Support for baikal and other in sentry
* Properly solve problem of stage1
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-12 22:37:43 +01:00
Alex Sharov
47d22773b9
[wip] dv2: Validate body ( #1913 )
...
* validate body
* validate body
* save
* save
* body deliveries messages handling into staged sync
* body deliveries messages handling into staged sync
* body deliveries messages handling into staged sync
* body deliveries messages handling into staged sync
* body deliveries messages handling into staged sync
* penalize right after verifyUncles and stop, don't batch
* penalize right after verifyUncles and stop, don't batch
* penalize right after verifyUncles and stop, don't batch
* penalize right after verifyUncles and stop, don't batch
* penalize right after verifyUncles and stop, don't batch
* penalize right after verifyUncles and stop, don't batch
* penalize right after verifyUncles and stop, don't batch
* penalize right after verifyUncles and stop, don't batch
* penalize right after verifyUncles and stop, don't batch
2021-05-12 14:57:35 +01:00
ledgerwatch
0aabf85c1d
Sentry fixes (for very frequent peer not found error) ( #1918 )
...
* Extra prints
* Remove printouts
* Printing back
* Fix the stuck stage 1
* Not allow peers to connect more than once
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-12 09:36:43 +01:00
ledgerwatch
7f51f13804
Fix for removed peers ( #1917 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-11 20:35:59 +01:00
ledgerwatch
bf0ea48823
Deadline-based permits in sentry ( #1915 )
...
* Not increase permit on announcements
* Init permits
* Deadlines
* Fix NPEs
* Fix NPE
* Fix findPeer
* Reduce max permits to 4
* 8 max permits, but 30 seconds timeout
* Back to 4
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-11 18:20:00 +01:00
ledgerwatch
0b7d185d1f
Trace filter 5 (and sentry improvement) ( #1914 )
...
* Append/AppendDup
* Print appends
* Remove printing
* Increase permit on announcements
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-11 13:58:43 +01:00
ledgerwatch
447f20d395
Baikal testnet configuration ( #1910 )
...
* Baikal testnet configuration
* Fixes
* Change AsMessage signature
* Fixes in t8ntool
* More updates
* Fix misspelling
* Skip eip1559 transition test
* More bootnodes
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-11 10:54:20 +01:00
Alex Sharov
921c6a53c9
set default mdbx log level to warning ( #1912 )
2021-05-11 15:22:34 +07:00
ledgerwatch
a99d22c313
Trace filter 4 + fixes for download.v2 ( #1907 )
...
* Introduce TraceCallSet bucket and fill it up
* Fix compile
* Reset TraceCallSet
* Add database.verbosity
* Warn about dropped messages
* Unwind for call traces
* Fixes for headers download
* Fix for the slow stage 3
* Remove wakeup channels
* Permit system for peer load balancing
* Reduce aggressiveness
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-10 16:07:22 +01:00
Artem Vorotnikov
80bbbf62c2
Misc fixes ( #1908 )
...
* Fix debug levels
* try this
* remove adapter
* fix
* fix bodies stage
2021-05-10 06:59:29 +01:00
ledgerwatch
128f446e7c
Download v2 fixes ( #1903 )
...
* [download.v2] Fix endianness of Difficulty in Status message
* Add comments
* Finish stage to use RwTx
* Print header age in stage 1
* Print new block messages
* TopSeenHeight to be updated from any header
* block in the future handling and skip the test
* Fix downloader test
* Fix test
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-09 08:22:08 +01:00
ledgerwatch
5c512fbddb
Trace filter 2 ( #1898 )
...
* Fix error message about write protection
* Clean up of trace_filter
* Add CallTraces to Execution Stage
* Fix compile
* Say something
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-08 16:17:17 +01:00
ledgerwatch
4a214d38e4
Fix integration after snapshot PR ( #1901 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-08 11:42:34 +01:00
b00ris
565a4250d6
Snapshot sync headers stage ( #1836 )
...
* save state
* snapshot update works
* save state
* snapshot migrator
* tx test
* save state
* migrations stages refactor
* refactor snapshot migrator
* compilation fixed
* integrate snapshot migrator
* goerli sync headers
* debug async snapshotter on goerly
* move verify headers, remove experiments, fix remove old snapshot
* save state
* refactor snapshotsync injection
* fix deadlock
* replace snapshot generation stage logic to migrate method
* change done for body snapshot
* clean
* clean&&change deleted value
* clean
* fix hash len
* fix hash len
* remove one of wrap methods, add remove snapshots on start
* add err check
* fix shadowing
* stages unwind order debug
* matryoshka experiments
* steam test
* fix build
* fix test
* fix lint
* fix test
* fix test datarace
* add get test
* return timeout
* fix mdbx overlap
* fix after merge
* change epoch size
* clean todo
* fix
* return testdata
* added return from sndownloader gorutine
* fix review comments
* Fix
* More info
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-08 09:45:40 +01:00
Artem Vorotnikov
09788dbc02
Pruning flag, incremental staged sync ( #1899 )
2021-05-08 00:07:49 +03:00
