Alex Sharov
cceaf75b16
use t.TempDir() ( #1955 )
2021-05-18 19:13:16 +07:00
Alex Sharov
594097a523
Up some deps (geth has similar) ( #1933 )
2021-05-14 09:00:08 +07:00
b00ris
565a4250d6
Snapshot sync headers stage ( #1836 )
...
* save state
* snapshot update works
* save state
* snapshot migrator
* tx test
* save state
* migrations stages refactor
* refactor snapshot migrator
* compilation fixed
* integrate snapshot migrator
* goerli sync headers
* debug async snapshotter on goerly
* move verify headers, remove experiments, fix remove old snapshot
* save state
* refactor snapshotsync injection
* fix deadlock
* replace snapshot generation stage logic to migrate method
* change done for body snapshot
* clean
* clean&&change deleted value
* clean
* fix hash len
* fix hash len
* remove one of wrap methods, add remove snapshots on start
* add err check
* fix shadowing
* stages unwind order debug
* matryoshka experiments
* steam test
* fix build
* fix test
* fix lint
* fix test
* fix test datarace
* add get test
* return timeout
* fix mdbx overlap
* fix after merge
* change epoch size
* clean todo
* fix
* return testdata
* added return from sndownloader gorutine
* fix review comments
* Fix
* More info
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-08 09:45:40 +01:00
ledgerwatch
59e5502744
Initial work on RPC streaming ( #1880 )
...
* Initial work on RPC streaming
* Create the stream and pass it on
* trace_filter expressed as streamable (not finished)
* Reenable call trace index
* Add new line
* Remove storage mode override
* Tool for overriding storage mode
* Diagnostics
* Make trace_filter more streamy
* Streaming debug_traceTransaction and debug_traceCall
* Fix test
* Log error on stream flush
* Enable streaming for http
* Flush the stream too
* Make trace_filter flush too
* Stop streaming if client is not interested
* Try to quiet annoying test|
* Revert "Try to quiet annoying test|"
This reverts commit 42849257bfa52e90140aa535af34b957cd97a222.
* Debug log for test
* Proceed with handshake regardless of whether peer notification worked
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-06 18:37:38 +01:00
Alex Sharov
a627bc2d14
use same keepalive settings in sentry and rpcdaemon ( #1883 )
...
* use same keepalive settings in sentry and rpcdaemon
* use same keepalive settings in sentry and rpcdaemon
2021-05-05 11:32:04 +01:00
Alex Sharov
64d68bcc04
switch to roaring release version #1865
2021-05-03 16:58:14 +07:00
ledgerwatch
75ca6b8c76
Initial work on integration tests ( #1797 )
...
* Initial work on integration tests
* Delete subtree
* Squashed 'interfaces/' content from commit 41a082ba4
git-subtree-dir: interfaces
git-subtree-split: 41a082ba4bde38647325eb0416cb1da1b4ca2b12
* Add consensus interfaces
* More stuff
* comments
* Fix compile
* Squashed 'interfaces/' changes from 41a082ba4..1b13a42a7
1b13a42a7 Add chainspec to consensus interface
git-subtree-dir: interfaces
git-subtree-split: 1b13a42a7803f5464722867a71065c27a7ebe8c3
* Squashed 'interfaces/' changes from 1b13a42a7..93a072c4c
93a072c4c Add missing import
git-subtree-dir: interfaces
git-subtree-split: 93a072c4c099d169322a3a53b95e40203276820b
* New consensus interfaces
* More on clique
* Fix tests
* Squashed 'interfaces/' changes from 93a072c4c..62f4ec4b2
62f4ec4b2 Add test service for consensus engine
git-subtree-dir: interfaces
git-subtree-split: 62f4ec4b263107635ffa3aabd5d634af22e813c6
* Squashed 'interfaces/' changes from 62f4ec4b2..061a63543
061a63543 Fix
git-subtree-dir: interfaces
git-subtree-split: 061a63543babdeb51ab7e3a96dec56b2485d4389
* Configuring clique engine with toml specs - start
* More toml parsing
* Constructed rinkeby genesis
* Simplify VerifyHeaders functions
* Fix lint
* Remove concurrent verification tests
* Fix lint
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-04-29 16:14:10 +01:00
Evgeny Danilenko
17c07c50a5
Move clique buckets to separate DB ( #1703 )
...
* debug
* debug
* it works
* rename clique bucket
* remove genesis special case
* copy snapshot
* remove debug
* migration
* debug
* regenerate snapshots
* simplify
* regeneration
* after merge
* tests
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-04-19 22:58:05 +01:00
Alex Sharov
6ba15b9e38
Revert "lmdb v0.9.70 ( #1705 )" ( #1706 )
...
This reverts commit 672ed5e16d
2021-04-10 16:43:13 +07:00
Alex Sharov
672ed5e16d
lmdb v0.9.70 ( #1705 )
2021-04-10 16:31:22 +07:00
Alex Sharov
566594593e
Multi sentry ( #1682 )
2021-04-07 15:54:25 +07:00
Alex Sharov
ea7425adea
tests ( #1631 )
2021-03-31 08:26:01 +07:00
Artem Vorotnikov
9b8cdc0f22
Fix lints and remove more unused code ( #1621 )
2021-03-29 10:58:45 +07:00
Artem Vorotnikov
afe551ba1c
Remove puppeth & account management ( #1610 )
2021-03-26 21:05:42 +03:00
Artem Vorotnikov
e67be2b1be
Remove unused code ( #1604 )
...
* Remove graphql, legacy options
* Remove CODEOWNERS
* Remove EWASM and custom EVM interpreter
2021-03-26 09:08:01 +07:00
Artem Vorotnikov
a6742a4cf8
Kill cmd/state/stateless ( #1592 )
...
* Move stuff around
* Remove
* tidy
* Fix for writeReceipt printing
* fix lint typo
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-03-23 16:33:58 +00:00
Alex Sharov
aff859edc0
Mining stage ( #1554 )
2021-03-23 16:00:07 +07:00
Alex Sharov
7024a7a35f
mining uncles ( #1581 )
2021-03-22 18:29:33 +07:00
Alex Sharov
0953c11c04
grpc version up ( #1568 )
2021-03-20 16:35:13 +07:00
Alex Sharov
909fd42bee
go 1.16 support ( #1509 )
2021-03-19 16:32:52 +07:00
Alexey Sharp
132da24d0f
Fixes
2021-03-15 18:34:22 +00:00
Igor Mandrigin
57f2c10d36
remove unneded les fuzzers
2021-03-15 17:32:50 +01:00
Alexey Sharp
7fd3417f52
Fix more compile errors
2021-03-14 19:07:19 +00:00
Alexey Sharp
519b19f8aa
Compilation fixes
2021-03-14 08:00:37 +00:00
Marius van der Wijden
e052d8e268
accounts/keystore: use github.com/google/uuid ( #22217 )
...
This replaces the github.com/pborman/uuid dependency with
github.com/google/uuid because the former is only a wrapper for
the latter (since v1.0.0).
Co-authored-by: Felix Lange <fjl@twurst.com>
# Conflicts:
# accounts/keystore/key.go
# accounts/keystore/passphrase.go
# accounts/keystore/presale.go
# cmd/ethkey/generate.go
# go.mod
# go.sum
2021-03-12 15:52:15 +01:00
Marius van der Wijden
67f26fad00
fuzzers: added consensys/gurvy library to bn256 differential fuzzer ( #21812 )
...
This pr adds consensys' gurvy bn256 variant into the code for differential fuzzing.
# Conflicts:
# go.mod
# go.sum
# tests/fuzzers/bn256/bn256_fuzz.go
2021-03-10 10:08:43 +01:00
Igor Mandrigin
2ea14f63cc
go.mod: upgrade github.com/huin/goupnp
2021-03-09 12:37:27 +01:00
Marius van der Wijden
75d76876a6
go.mod: update dependencies ( #22216 )
...
This updates go module dependencies as discussed in #22050 .
# Conflicts:
# go.mod
# go.sum
2021-03-09 12:36:25 +01:00
ucwong
13eecf52cf
go.mod: upgrade golang-lru ( #22134 )
...
# Conflicts:
# go.mod
# go.sum
2021-03-09 11:13:31 +01:00
Martin Holst Swende
adf219ea76
go.mod: use github.com/holiman/bloomfilter/v2 ( #22044 )
...
* deps: use improved bloom filter implementation
* eth/handler, trie: use 4 keys for syncbloom + minor fixes
* eth/protocols, trie: revert change on syncbloom method signature
# Conflicts:
# core/state/snapshot/difflayer.go
# go.mod
# go.sum
# trie/sync.go
# turbo/trie/sync_bloom.go
2021-03-09 10:36:02 +01:00
ledgerwatch
b743b88218
Revert "Extract validating interface ( #1120 )" ( #1543 )
...
* Revert "Extract validating interface (#1120 )"
This reverts commit e4e36c152e
2021-03-05 20:34:23 +00:00
Alex Sharov
f556af6276
Prometheus metrics: more virtual memory visibility, more cross-platform metrics ( #1520 )
2021-02-28 11:11:28 +07:00
Evgeny Danilenko
e4e36c152e
Extract validating interface ( #1120 )
...
* interface
* generalize interface
* linters
* fix deadlock
* fix linters
* close goroutine
* fix
* debug
* id+ttl
* refactor downloader tests
* tests
* lru
* handle genesis, extract fake consensuses
* fix fake consensus
* test uncles, verify
* after a new master
* fmt
* fix close
* debug
* debug
* fix chain length
* remove test field
* use single account
* fix data race on closing channel
* remove postponed blocks queue
* miner test
* VerifyHeaderRequests
* fmt
* fmt
* fix data race
* handle validating errors
* simplify matchParents
* remove copy-paste
* move sort to constructor
* clean up
* debug for 10 parents
* debug
* debug
* batch responses
* batch requests
* works for many ancestors
* remove debug
* always Close an engine
* linters
* ancestors deduplication
* fix test
* reduce interface
* api
* clique
* green clique sync
* stable
* perpermance per second
* full sync
* linters
* gitignore
* deps
* fix panic after master merge
* init consensus
* clique tests
* fix tests
* fix tests
* clean up
* reuse snap
* store vefified snapshots
* optimize snapshots
* safe close
* cleanup loop
* after downloader
* downloader and consensus tests
* update tests
* hack.go
* clique flags
* fix cliuqe config
* review
* gitignore
* remove additional bucket
* blk/sec instead of blk/microsecond
* rename
* deps
* optimize
* debug
* test
* tests without extracted validation process
* same base performance as on master
* benchmark
* simplify ethash verification
* ethash
* ethash
* linters
* ethash
* master stats
* cleanup
* gomod
* linters
* tests
* better locks
* Fix
* Remove logging for verifyHeaders
* Verification speed in the logs
* Fix compile error
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-02-25 19:40:45 +00:00
Alex Sharov
b77dfec055
remove debug-web-ui and restapi ( #1480 )
2021-02-09 19:42:14 +07:00
yperbasis
21aba6327f
Update snappy to prevent crash on Apple M1
2021-02-05 16:13:28 +01:00
ledgerwatch
7c8bae8591
Implementation of debug_traceCall, add stateDiff to trace_call ( #1442 )
...
* Implementation of debug_traceCall
* Fix compile error
* Implementing stateDiff in trace_call - WIP
* fixes to stateDiff, better parsing in rpctest
* Fix lint
* Fix lint
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-01-18 11:13:19 +00:00
Alex Sharov
7fd1f19435
txdb lazy cursors creation, grpc version up ( #1440 )
...
* txdb lazy, grpc version up
* tidy
* fix lint
2021-01-15 09:38:09 +00:00
Alex Sharov
fa1d92bd15
Rm zstd ( #1427 )
2020-12-28 22:14:16 +07:00
Alex Sharov
98b36126b2
History bitmap 64 ( #1374 )
...
* squash
* squash
* squash
* squash
* squash
* squash
* subscription_doesnt_preserve_shutdown
2020-12-04 21:16:51 +00:00
ledgerwatch
e71c3cae70
Lmdb visualisation + freelist stability fixes ( #1345 )
...
* Visualisations
* Use graphviz records
* Fix lint
* Fix lint
* Reduced leaf pages
* Fix
* Overflow pages
* Fix lint
* Fix lint
* Fix lint
* Add dupsort generate
* DupSort experiments
* Add dupsort nodes
* More interesting dupsort
* freelist
* Fragmented freelist
* Fix lint
* drop T2 too
* Handle overflow pages in FREE_DBI
* Skipping in the MAIN_DBI leaves
* Switch to double-tap LMDB
* Fix to double-tap
* With/without reader visualisations
* Flip flopping without reader
* Tidy mods
* Fix lint, switch to new lmdb-go release
* mod tidy
2020-11-11 09:35:58 +00:00
Alex Sharov
6ede598ed6
less ops on autodupsort feature ( #1335 )
2020-11-02 21:07:58 +00:00
Alex Sharov
399db7ee3b
LMDB v0.9.27, and add all lmdb cli tools ( #1303 )
...
* mdb tools
* mdb tools
* mdb tools
* mdb tools
* mdb tools
* mdb tools
* mdb tools
* mdb tools
* clean
* clean
* clean
* clean
* clean
* rebase master
Co-authored-by: Alexey Akhunov <akhounov@gmail.com>
2020-10-29 13:19:46 +00:00
Alex Sharov
531d36efcb
mdbx support ( #1235 )
2020-10-28 10:18:10 +07:00
ledgerwatch
32278539ac
Use BTree instead of maps for Mutation (batch) ( #1308 )
...
* Try mutation based on B-tree
* Use pointers
* Fix NPE
* Cleanup
2020-10-27 22:30:18 +00:00
ledgerwatch
1e6c29a9ef
Revert "[WIP - Discussion - Perf Testing] Use BTree instead of maps for Mutation (batch) ( #1294 )" ( #1305 )
...
This reverts commit a9ae477d8f
2020-10-27 14:35:25 +00:00
ledgerwatch
a9ae477d8f
[WIP - Discussion - Perf Testing] Use BTree instead of maps for Mutation (batch) ( #1294 )
...
* Try mutation based on B-tree
* Use pointers
* Fix NPE
* Cleanup
2020-10-27 13:37:37 +00:00
Igor Mandrigin
0f1b2f3595
geth-1.9.23: post-rebase fixups
2020-10-26 17:16:00 +01:00
Alex Sharov
331dcd45eb
Store receipts separately - one record per tx ( #1271 )
...
* squash
* add --database flag to integration
* clean
* split to 2 buckets
* split to 2 buckets
* split to 2 buckets
* split to 2 buckets
* split to 2 buckets
* save progress
* save progress
* improve test
* improve test
* save progress
* change app logic
* change app logic
* return err from rawdb package
* don't clean automatically
* don't clean automatically
* clean
* clean
* clean
* don't rely on `make clean`
* improve cbor code
* clean
* clean
* clean
* fix tests
* rebase master
* stop on error: headers stage
* make TxDb walk and multiwalk safe
* Fix panics
Co-authored-by: Alexey Akhunov <akhounov@gmail.com>
2020-10-25 08:38:55 +00:00
Alex Sharov
5e53c79f50
stable version of grpc codegen, drop kv_remote_v1 support ( #1285 )
2020-10-24 07:54:03 +01:00
ledgerwatch
cd706d5081
Download/seed block bodies and block headers via BitTorrent ( #1218 )
...
* save state
* torrent experiments
* torrent experiment passed
* fixes after merge
* snapshot headers processing passed
* save state
* save state
* download headers works after snapshot processing
* save state
* save state
* save state
* save state
* add lazy load tx to snapshots, increase number of trackers
* save state
* speedup getting info
* change logging
* move to turbo package
* save state
* save state
* save state
* cleanup
* save state
* add test test
* save state
* lmdb debugging
* fix readonly mode
* save state
* fix build
* sync works
* save state
* save state
* save state
* allow cmd stages stageSenders use snapshots
* debugging failed hashing
* remove experimental tests
* remove torrent experimental tests
* fix lint
* extract snapshot wrapper
* metainfo checker
* add remote seeder
* add logs
* update gomod
* remove useless code
* fix lint&remove useless code
* extract verify snapshot to separated command
* skip debug test
* fix test
* change type of seedSnapshot flag
* add eth logger to torrent lib
* skip debug test
* add Close method
* review fixes
* fix lint
* tidy mods
* Fix compile
* Fix lint
* Fix rpcdaemon running in the docker
Co-authored-by: b00ris <b00ris@mail.ru>
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2020-10-13 13:56:16 +01:00
