Alex Sharov
b2bcbaa895
Compact flag ( #783 )
...
* compact flag
* compact flag
* compact flag
* compact flag
* compact flag
2020-07-25 08:35:08 +01:00
Alex Sharov
7cc0b7e391
On mac lmdb can't start with error "cannot allocate memory" until I not reduced magic number ( #779 )
2020-07-24 14:47:03 +01:00
Alex Sharov
95365c8f37
remove ReadLastBlockNumber method = read execution stage status instead ( #780 )
...
* remove ReadLastBlockNumber method = read execution stage status instead
* make linter happy
2020-07-24 14:46:49 +01:00
ledgerwatch
cf5b0c8836
Integrate txPool into staged sync, fix tx_pool_test ( #778 )
...
* cmd/tester to initiate reorg
* Second commit
* Turn on profile
* More
* Unwind function
* More fixes
* Before fixing tests
* Fix compile error
* Fix lint
* Fix formatting
* Fix lint
* Fix nil in tests
* Fix lint
* Decouple txpool from rawdb
* Fix some tx tests
* One more test
* Fix the rest of tests in tx_pool_test.go
* Fix formatting
2020-07-23 21:52:41 +01:00
Igor Mandrigin
9b599b8ce4
Workaround panic in staged sync. ( #777 )
...
Fixes #776
2020-07-23 21:52:25 +01:00
Alex Sharov
5f0da1ef66
Rpc receipt, getLogs ( #771 )
...
* v0
* v1
* got logs
* got logs
* cleanup
* return more errors
2020-07-22 08:31:47 +07:00
Evgeny Danilenko
f11f960814
Rpc getBalance ( #775 )
...
* rpc addBalance
* handle isCanonical case
* fmt
2020-07-21 17:31:02 +03:00
Evgeny Danilenko
8971624ec6
GetModifiedAccounts by hash and block number ( #773 )
2020-07-21 13:36:29 +03:00
Alex Sharov
1a075b10f1
re-create bucket on b.Clear - to easier change bucket settings (for example by releasing new version or just by switching git branches) ( #766 )
2020-07-21 15:33:30 +07:00
Alex Sharov
e65b743878
Prometheus dashboard revisit ( #767 )
2020-07-21 15:33:03 +07:00
Alex Sharov
a7e5c4b453
Remove remote_chain package, fix rpc methods: eth_blockNumber and eth_getBlockByNumber ( #769 )
2020-07-21 15:19:04 +07:00
Alex Sharov
621e3a2074
Ci lmdb - reduce memory usage ( #762 )
2020-07-21 08:58:00 +07:00
Alex Sharov
1faa9dbcd4
add senders bucket to py ( #763 )
2020-07-20 16:11:47 +07:00
ledgerwatch
b765ff0e33
cmd/tester initiates staged sync, and unwind (but not reorg) ( #758 )
...
* First push
* Remove batch from Blockchain
* Fix compile error in cmd/integration
* Fix compile errors in cmd/state
* Fix compile errors
* Save changes
* Fix core tests (skip tx tests)
* More test fixes
* Fix compile error
* Fix formatting
* Fix formatting
* Fix lint
* Fixes
* Skip some miner tests
* Fix tests
* Cleanup
2020-07-19 09:11:53 +01:00
Alex Sharov
7f60d1b535
Remove load start key from etl ( #757 )
...
* limit incremental step size of stages 5 and 6
* remove limit, make incremental
* remove_load_start_key_from_etl
* switch to "struct of arrays" from "array of structs"
* switch to "struct of arrays" from "array of structs"
Co-authored-by: Alexey Akhunov <akhounov@gmail.com>
2020-07-18 10:17:04 +01:00
Alex Sharov
03e136c7b8
remove all pools from bolt, badger, lmdb ( #750 )
2020-07-18 09:39:18 +01:00
b00ris
12aa55bcbb
Remove incarnation inversion ( #755 )
...
* remove incarnation inversion
* fix lint
* remove incarnation inversion
* remove comment
* remove inversion from new code
* revert for unwind
2020-07-17 15:18:31 +01:00
Evgeny Danilenko
f79b156a0b
delete keys ( #756 )
2020-07-17 08:34:52 +01:00
Alex Sharov
c8a594dec6
Limit incremental step size of stages 5 and 6. ( #754 )
2020-07-17 12:52:09 +07:00
Alex Sharov
4d54f0ec0c
fix error "could not apply NextKey for the empty key" ( #753 )
2020-07-17 06:59:22 +07:00
Alex Sharov
086435117f
remove atomic from stage4 ( #751 )
2020-07-17 06:59:03 +07:00
Evgeny Danilenko
5ead20e288
close tx_cache and peer.handle goruotines properly ( #748 )
...
* close goruotines
* fix using defer
* close pm managers a bit later
* fmt
* finalizer for in-mem db
* after cr
* revert finalizer
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2020-07-16 14:27:24 +01:00
Andrew Ashikhmin
165ae21ae3
Support multiple incarnations of the same contract in a single StorageChangeSet ( #749 )
...
* Support multiple incarntions of the same contract in a single StorageChangeSet
* linter
* Remove common.ToHex
2020-07-16 10:53:34 +01:00
ledgerwatch
18e67cd07d
cmd/tester to initiate correct staged sync (but not reorg yet) ( #747 )
...
* Disable caches
* Fix cmd/integration?
* state root hash matches
* Cleanup
* Skip TestForkIDSplit
* Try to fix the test
2020-07-15 13:26:59 +01:00
Alex Sharov
8b8094d72c
integration: fix problem with interruption ( #743 )
...
* store stageData correctly
* integration: use State of sync, use stage data, don't skip persistent steps even if they complete before interruption
* reset_state: clear unwind stages info
* stage4: stop where previous stage stopped, print to logs digits which represent what exactly is in DB, rename variable 'nextBlockNumber' to 'stateProgress'
* rebase to master
* simplify chainconfig
* try increase sleep time on ci
* try increase sleep time on ci
* try increase sleep time on ci
* try increase sleep time on ci
2020-07-15 12:53:12 +01:00
ledgerwatch
3359ba7a04
Make cmd/tester initiate staged sync, remove some pools and caches ( #746 )
...
* no pools
* Remove excessive logging
* Revert
* Initial commit
* Cleanup
* Fix some compile errors
* Fix core tests
* Fix more tests
* Fix eth/downloader
* go mod tidy
* Fix core/vm
* Fix formatting
* Fix formatting
* Fix lint
* Fix lint
* Switch tests to StagedSync
* Cleanup
* Reuse cache in stage4
* Fix
* Fix formatting
* Try to fix test
2020-07-15 07:15:48 +01:00
Evgeny Danilenko
2ce24c3274
dont stop txPool stage on error ( #745 )
2020-07-15 06:10:17 +01:00
Evgeny Danilenko
2cccf6d02c
Tx pool: prevent double start or stop ( #744 )
...
* use isStarted
* set on stop
2020-07-14 14:14:43 +01:00
Alex Sharov
9da86a2737
stop exactly on "--block" ( #740 )
2020-07-14 08:57:41 +07:00
Alex Sharov
6043c09ddf
Replace global buff pool by local, because of buffer leaks to larger pools ( #739 )
2020-07-14 08:56:47 +07:00
b00ris
6e8c027d68
fix go run for integration ( #741 )
2020-07-14 08:56:29 +07:00
Evgeny Danilenko
9d1ba168de
safe closing txpool reorgShutdownCh ( #738 )
...
* fix
* linters
* buffered chan to prevent blocking
* create channel on start
* fmt
* fix
2020-07-12 08:27:08 +01:00
Alex Sharov
e01f936b35
improve dupsort experiment ( #737 )
2020-07-11 09:56:29 +07:00
ledgerwatch
665b1d88b9
Speed up GenerateChain by using intermediate hashes ( #736 )
...
* GenerateChain to support intermediate hashes
* Fix formatting
* Changeset stats
* Fix formatting
2020-07-10 22:37:34 +01:00
ledgerwatch
16695eb100
Log Info and duplication fix ( #735 )
2020-07-10 11:40:13 +01:00
Alex Sharov
8335700331
Integration: compare to reference_db after all cycles, better cancelation, add to makefile ( #733 )
...
* cmp to reference db if --reference_chaindata provided
* graceful shutdown
* add ./cmd/integration to makefile
* add interruption support for different stages
* don't compare errors directly
2020-07-10 07:03:18 +01:00
ledgerwatch
72dcf478d3
Fix debug_storageRangeAt in rpc daemon ( #732 )
...
* Fix storageRangeAt
* Fix formatting
* Fix lint
* Fix lint
* Prevent racing by closing db after the blockchain
2020-07-10 06:44:01 +01:00
Alex Sharov
df2241f13e
remove debug ( #734 )
2020-07-10 10:29:30 +07:00
Alex Sharov
de5dd0f55e
use non-empty buffer to encode changest ( #729 )
2020-07-10 10:26:48 +07:00
Alex Sharov
d98382fdf8
Integration add checkChangeSet into state_stages command ( #728 )
...
Integration add checkChangeSet into state_stages command (#728 )
2020-07-10 10:25:40 +07:00
Andrew Ashikhmin
bae2e7094a
Fix limit = 0 (unlimited) ( #731 )
2020-07-09 16:08:26 +01:00
Alex Sharov
686f186545
integration - to use same blockchain config as production ( #727 )
2020-07-09 13:54:10 +01:00
Evgeny Danilenko
5f77570556
Make transaction pool startable and stoppable. Staged sync. ( #730 )
...
* after concurrency testing
* fixes for linters
* add an extra parameter
* change init order for protocolManager
* green tests
2020-07-09 13:53:35 +01:00
ledgerwatch
887fc4f99c
GenerateChain without using TrieDbState ( #726 )
...
* Different chain generation
* More fixes
* Fix TestSideLogRebirth
* Fix the rest of core tests
* Fix accounts/abi/bind
* Fix compile errors for cmd/pics
* Fix consensus/clique tests
* More fixes
* Fix core/state tests
* Fix eth tests
* Fix eth/downloader tests
* Fix more tests
* Fix compile errors
* Some more fixes
* Save
* Exists
* Fix last tests
* Clean up
* Fix formatting
* Fix linter
* Fix formatting
* Fix linter
* Fix lint
* Fix lint
* Fix lint
* Fix lint
* Fix lint
* Fix lint
* Fix lint
* Fix lint
2020-07-09 07:15:28 +01:00
b00ris
eca0f233ec
[WIP] WalkAsOf ( #724 )
...
* save state
* walkAsOf by cs test passed
* cs search for plain state
* save state
* fix accounts tests
* refactor walkAsOf account tests
* fix storage test
* refactor walkAsOf storage tests
* fix lint
* fix test
* save state
* save state
* add test with fixed bits
* fmt
* add stages check
* fix lint
* fix lint
* remove obsoleted methods
2020-07-09 07:13:45 +01:00
Alex Sharov
2689b35da9
TxLookup unwind: Remove entries for blocks between unwindPoint+1 and stage.BlockNumber ( #723 )
2020-07-08 05:46:04 +01:00
Igor Mandrigin
9881a2ccb3
Fix broken witness generation. ( #721 )
2020-07-07 12:24:55 +01:00
Alex Sharov
495f95f688
Add commands "compare_states", add command "stage9", fix unwind of stage9 (it walked over whole db) ( #722 )
...
* ./cmd/integration compare_states, ./cmd/integration stage9
* TxLookup fix unwind - it walked over all db
2020-07-07 17:07:14 +07:00
Alex Sharov
fb933bc9e3
move lmdb-go under ledgerwatch org ( #720 )
2020-07-07 16:18:09 +07:00
Alex Sharov
f7cc86452c
Move stages from hack.go to ./cmd/integration ( #719 )
...
* move stages from hack.go to ./cmd/integration
* move stages from hack.go to ./cmd/integration
2020-07-07 08:11:10 +01:00
