Alex Sharov
fc1a37e6dc
create turbo/services pkg ( #4269 )
2022-05-26 10:31:06 +07:00
battlmonstr
0d259384a0
CI ( #3779 ): pass docker build arguments on Docker Hub ( #4252 )
2022-05-25 08:12:40 +07:00
Alex Sharov
cb70e3315b
use git submodule sync --recursive because submodule url changed ( #4243 )
2022-05-24 10:58:46 +07:00
battlmonstr
54cf932652
Makefile: pass docker build arguments ( #4212 )
...
Dockerfile requires some --build-arg options.
Fix "docker" target to pass them.
Fix GIT_TAG to reflect the most recent tag related to HEAD, instead of an unrelated most recent tag.
Use it as the image VERSION.
Image tags need to be passed explicitly if needed:
DOCKER_FLAGS='-t erigon:latest' make docker
2022-05-21 10:21:35 +01:00
Alex Sharov
3e4fb5dd49
up linter version ( #4108 )
...
* save
* save
* save
2022-05-10 10:14:09 +07:00
battlmonstr
c9a1c93b44
tests: split slow integration tests ( #4048 )
2022-05-04 10:35:59 +07:00
battlmonstr
2e4947bbfb
p2p: improve test TestTable_findnodeByID ( #4047 )
...
* refactor test
* add a fast fixed examples test for the main suite
* split slow test for the integration suite
2022-05-03 08:32:54 +01:00
Alex Sharov
38e8706c91
Docker build: make db-tools to depend on git-submodules ( #4024 )
...
* save
* save
* save
* save
* save
2022-04-29 14:07:39 +07:00
battlmonstr
92db317e06
Observer - P2P network crawler ( #3928 )
...
Observer crawls the Ethereum network and collects information about the nodes.
2022-04-22 12:02:12 +01:00
Alex Sharov
65be763354
min requirement to go 1.18 ( #3934 )
...
* save
* save
2022-04-22 10:56:44 +07:00
battlmonstr
a8f20f01c4
Makefile: refactor build flags and fix 1.17 ( #3930 )
2022-04-22 07:15:23 +07:00
Alex Sharov
667125bc65
go_1.18 on CI and in Docker ( #3843 )
2022-04-21 14:51:30 +07:00
Alex Sharov
9051d95836
Downloader tables, mdbx-based torrent pieces completion store ( #3923 )
...
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
2022-04-21 10:34:31 +07:00
Alex Sharov
1bbe2037f3
linter 1.445 ( #3809 )
2022-04-01 15:20:27 +07:00
Alex Sharov
9c49142e6b
Snapshots: script to commit hashes ( #3746 )
2022-03-21 13:40:35 +07:00
Alex Sharov
586ad297e6
Snapshots: script to auto-commit torrent hashes ( #3745 )
2022-03-21 11:22:37 +07:00
ledgerwatch
d5fb8f7d24
[erigon2] Separate handover timing ( #3736 )
...
* Separate handover timing
* Update
* Corrected handover time calculation
* Not use compression when aggregate
* Update to latest erigon-lib
* Update to erigon-lib main
* Update
* Disable reproducible builds
* Restore github actions
* Restore github actions
* Revert "linter to support go 1.18 (#3739 )"
This reverts commit 1fd434d3d1
2022-03-19 16:15:12 +00:00
Alex Sharov
1fd434d3d1
linter to support go 1.18 ( #3739 )
2022-03-19 10:02:46 +07:00
Alex Sharov
63adf0218a
linter up ( #3672 )
2022-03-10 12:20:20 +07:00
Alex Sharov
16cea91422
add nosqlite tag ( #3652 )
...
* add nosqlite tag
* save
* save
* save
2022-03-07 14:26:13 +00:00
battlmonstr
90b52929c6
Makefile: allow command-specific go.mod files ( #3641 )
...
The command builds were always using the root go.mod.
Adding cmd/mycmd/go.mod produced an "package not found" error.
This changes the build to run in the cmd/mycmd directory:
* If cmd/mycmd/go.mod is present, it is used.
* Otherwise it builds the main package using the root go.mod as before.
2022-03-04 07:47:09 +07:00
battlmonstr
8b820a1cbe
Makefile: refactor cmd targets. ( #3614 )
...
Refactor cmd targets to use a common implicit rule recipe.
Change "make all" to include them all.
2022-02-24 15:10:46 +00:00
battlmonstr
ffdf02bf29
Makefile: silence a few build messages. ( #3578 )
...
Silence non-important comments in the "make erigon" output.
2022-02-22 18:17:50 +00:00
alex.sharov
b5a925d6b6
remove "golangci-lint cache clean" from "make clean"
2022-02-14 11:12:05 +07:00
Alex Sharov
8a4a7d7664
Mdbx: more 4tb fixes ( #3351 )
2022-01-31 16:59:49 +07:00
Alex Sharov
afbf083242
fix makefile deps on submodules ( #3383 )
2022-01-31 12:43:48 +07:00
alex.sharov
bd0052d422
disable mdbx assertions
2022-01-23 15:03:20 +07:00
alex.sharov
b78645429f
don't loose default CGO_CFLAGS
2022-01-23 10:05:31 +07:00
alex.sharov
3f5e6f9783
better comment
2022-01-23 09:28:09 +07:00
Alex Sharov
5ec82034c9
Mdbx 0.11.4 (fixes for 4tb asserts logic) ( #3324 )
...
* mdbx 0.11.4
* mdbx 0.11.4
* configurable debug and asserts
* configurable debug and asserts
2022-01-23 09:08:07 +07:00
Alex Sharov
df2f11771c
DockerHub and git submodules ( #3295 )
...
* save
* save
* save
* save
* save
* save
* save
* save
2022-01-19 07:54:56 +00:00
Igor Mandrigin
f0684f9e44
workaround Docker issues pt 2 ( #3288 )
2022-01-18 13:06:07 +01:00
Igor Mandrigin
c4b6397636
Update Makefile ( #3287 )
2022-01-18 18:41:34 +07:00
Alex Sharov
f3973afee8
Rule guard linter enable ( #3168 )
2021-12-26 10:54:26 +07:00
Alex Sharov
5125c82cd9
add git submodules set to erigon build ( #3154 )
...
* save
* save
2021-12-22 11:18:35 +07:00
Alex Sharov
37f0dcecc1
init recursive git submodules on dockerhub ( #3132 )
...
* init recursive git submodules on dockerhub
* 32 * default
* 32 * default
* save
2021-12-15 16:07:57 +07:00
leonardchinonso
607e958123
Committing changes for devnettest ( #3026 )
2021-11-23 16:44:46 +00:00
ledgerwatch
becb25021b
Revert erroneous merge ( #3022 )
...
* Revert "Making corrections to code formatting"
This reverts commit c154d65cecdc4c001f51
2021-11-22 18:33:37 +00:00
leonardchinonso
dc4c001f51
Implemented devnet test for eth_getBalance
2021-11-22 18:36:33 +01:00
Alex Sharov
5fb1a4ce49
Add db-tools to Dockerfile ( #2950 )
2021-11-15 10:14:19 +07:00
alex.sharov
e95b63d404
add hack to dockerfile
2021-10-31 07:39:47 +07:00
Alex Sharov
da00e949c4
RemoteRPC: coherentCache for kv.Code; LocalRPC: enable small blocksLRU ( #2815 )
2021-10-12 12:04:04 +07:00
Alex Sharov
2e23851434
git describe to search tags across all branches ( #2664 )
2021-09-11 15:12:11 +07:00
Mark Evenson
8dccc442fc
build: parameterize location of go executable ( #2547 )
...
Allow the location of the golang exectuable to be specified by
Makefile variable. This can help building in situations where the
default system golang executable is not of sufficient version to build.
Co-authored-by: Mark Evenson <mevenson@ravenpack.com>
2021-08-18 15:49:53 +07:00
sam bacha
c682dd16d7
minor dockerfile improvements ( #2443 )
2021-07-27 09:39:21 +07:00
Marius
d085bf9a7f
docker-compose with minimal PID namespace and non-root permissions ( #2397 )
...
* Feat: only share the erigon container PID namespace with rpcdaemon instead of the entire host PID namespace.
* Feat: remove host UID:GUID mapping from erigon and rpcdaemon containers in favour of erigon user in Dockerfile. Adapted Makefile to pre-create mounted volumes to avoid permission issues at runtime.
* Feat: docker volume directories should always be owned by erigon user(1000:1000) regardless of the user that invoked the make command.
* Fix: don't chown here which breaks docker volume mounts.
* Fix: remove ERIGON_HOME Makefile variable and simplify recipe.
2021-07-19 20:40:09 +07:00
alex.sharov
508573709c
update lintci domain
2021-07-18 16:41:31 +07:00
Alex Sharov
71a7e54db0
docker readme ( #2394 )
2021-07-18 15:22:35 +07:00
Marius
b69638b58e
Feat: Experimental workaround for dockerized rpcdaemon in Local-Mode. Fix some permissions issues in docker containers. ( #2392 )
2021-07-18 14:42:23 +07:00
alex.sharov
c75a83fa34
fix tag ld
2021-07-15 13:44:30 +07:00
Alex Sharov
6a5f86423c
Remove "numgc" from logs ( #2275 )
2021-07-03 14:44:23 +07:00
ledgerwatch
a05d1be531
Pull grpc bindings into erigon-lib ( #2265 )
...
* Pull grpc bindings into erigon-lib
* Remove mdbx dist
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-07-01 22:31:14 +01:00
Alex Sharov
6b21eab364
pull submodules on make db-tools ( #2241 )
2021-06-27 09:53:49 +07:00
Alex Sharov
605d7a8d59
Sokol v0 ( #2228 )
...
* handle chain flag in integration
* handle chain flag in integration
* handle chain flag in integration
* save
* save
* merge devel
* save
* noopWriter - one is enough
* chain spec parser
* chain spec parser
* embed
* embed
* embed
* embed
* embed
* embed
* embed
* clean
* clean
* correct alloc after reset state
* correct alloc after reset state
* correct alloc after reset state
* integration reset state now does re-apply genesis and chainConfig
* eips summary
* eips summary
* eips summary
2021-06-25 19:13:40 +01:00
Alex Sharov
a535e8f30c
switch to mdbx-go module, and db-tools to libmdbx submodule ( #2199 )
...
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
* move mdbx to submodule
2021-06-19 21:30:12 +01:00
Alex Sharov
e9f510c2b7
erigon as lib ( #2186 )
2021-06-18 10:35:11 +07:00
ledgerwatch
64254f8d1e
Experiment with tests ( #2182 )
...
* Experiment with tests
* Increase test concurrency to 8
* Lower concurrency
* Concurrency back to 2
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-06-16 20:50:40 +01:00
Artem Vorotnikov
cb96a400e5
Increase test timeout to 30m ( #2168 )
2021-06-15 13:41:38 +01:00
Alex Sharov
925d17a238
remove lmdb from hack, integration, state packages. remove lmdb dbtools ( #2146 )
2021-06-11 20:31:37 +07:00
Alex Sharov
e7b56358d3
Mdbx reproducible build ( #2145 )
...
* save
* save
* save
2021-06-11 14:04:12 +01:00
Alex Sharov
eedabfca85
txpool_content ( #2127 )
...
* txpool_content
* txpool_content
* txpool_content
* txpool_content
* Squashed 'interfaces/' content from commit 1e916d013
git-subtree-dir: interfaces
git-subtree-split: 1e916d0137aff7bd9e9356cc203cea5f0ea9c7f1
* add test
* add test
* add test
* merge devel
* save
2021-06-11 09:34:47 +01:00
Alex Sharov
ba56e7a139
extract p2p config out of sentry ( #2126 )
...
* extract p2p config out of sentry
* extract p2p config out of sentry
* extract p2p config out of sentry
* rebase devel
* rebase devel
* add bootnodes to sentry
* add bootnodes to sentry
2021-06-11 09:34:37 +01:00
alex.sharov
f43643edde
more cgo checks on ci
2021-06-07 21:18:16 +07:00
Andrea Lanfranchi
e6e0a5de3d
Add repo tag to build info ( #2108 )
...
* Add repo tag to build info
* Update Dockerfile
2021-06-06 09:05:30 +01:00
Alex Sharov
bebaebb13a
mdbx 0.10.1 ( #2083 )
...
* mdbx 0.10.1
* remove -tags mdbx
* remove -tags mdbx
* remove -tags mdbx
2021-06-04 13:26:15 +01:00
alex.sharov
8bc5cf4281
remove headers binary
2021-06-03 14:36:30 +07:00
alex.sharov
53f8026cd9
remove headers binary
2021-06-03 14:36:11 +07:00
alex.sharov
7b92b98f7a
add config2.h to gitignore
2021-06-03 14:18:48 +07:00
alex.sharov
f1efb0f8e3
add config2.h to gitignore
2021-06-03 14:18:26 +07:00
Alex Sharov
9fe96e8a95
reproducible build ( #2070 )
2021-06-01 16:00:10 +07:00
Alex Sharov
a6dfafd5cd
rename headers to sentry ( #2060 )
2021-05-31 17:20:56 +07:00
Alex Sharov
3016b96e88
1 Sentry per protocol ( #2046 )
2021-05-30 09:53:30 +07:00
ledgerwatch
5a0afc0a72
Remove old tg binary before building erigon binary ( #2023 )
...
* Update Makefile
* Use -f flag
2021-05-27 06:57:25 +01:00
Evgeny Danilenko
74847d77e6
Rename to Erigon ( #2018 )
...
* turbo-geth to erigon
* tg, turbo to erigon
2021-05-26 11:35:39 +01:00
Alex Sharov
0be3044b7e
rename ( #1978 )
...
* rename
* rename "make grpc"
* rename "abi bindings templates"
* rename "abi bindings templates"
2021-05-20 19:25:53 +01:00
Alex Sharov
215623da80
Windows support ( #1944 )
2021-05-20 23:46:12 +07:00
Alex Sharov
781a67a4ee
Auto-Close db in tests by using t.Cleanup ( #1956 )
2021-05-19 10:47:28 +07:00
Alex Sharov
0c91bfbf3e
RPCDaemon: support Pending block ( #1942 )
...
* clean
* save
* pubsub
* pubsub
* pubsub
* pubsub
* pubsub
* pubsub
* save
* tx pub-sub
* tx pub-sub
* clean
* clean
* save
* save
* save
* save
* save
* Squashed 'interfaces/' content from commit c469f3ae0
git-subtree-dir: interfaces
git-subtree-split: c469f3ae073b60c8821b61fed2910191080ef835
* save
* save
* save
* save
* Squashed 'interfaces/' changes from c469f3ae0..958dfc669
958dfc669 save
git-subtree-dir: interfaces
git-subtree-split: 958dfc669f8daeefe686a13aa852fb95f1537886
* save
* save
* up some deps
* up some deps
* clean
* test
* test
* test
* test
* test
* test
* test
* test
* test
* test
* test
* test
2021-05-17 13:15:19 +01:00
Alex Sharov
3d3298cc17
Fix lint ci ( #1945 )
2021-05-17 09:42:24 +07:00
ledgerwatch
56dc23691c
Fix DB performance regression ( #1902 )
...
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-05-08 12:38:32 +01:00
b00ris
565a4250d6
Snapshot sync headers stage ( #1836 )
...
* save state
* snapshot update works
* save state
* snapshot migrator
* tx test
* save state
* migrations stages refactor
* refactor snapshot migrator
* compilation fixed
* integrate snapshot migrator
* goerli sync headers
* debug async snapshotter on goerly
* move verify headers, remove experiments, fix remove old snapshot
* save state
* refactor snapshotsync injection
* fix deadlock
* replace snapshot generation stage logic to migrate method
* change done for body snapshot
* clean
* clean&&change deleted value
* clean
* fix hash len
* fix hash len
* remove one of wrap methods, add remove snapshots on start
* add err check
* fix shadowing
* stages unwind order debug
* matryoshka experiments
* steam test
* fix build
* fix test
* fix lint
* fix test
* fix test datarace
* add get test
* return timeout
* fix mdbx overlap
* fix after merge
* change epoch size
* clean todo
* fix
* return testdata
* added return from sndownloader gorutine
* fix review comments
* Fix
* More info
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-05-08 09:45:40 +01:00
Evgeny Danilenko
871bb912b1
[WIP] FuzzyVM for TG ( #1884 )
...
* restore StateRoot
* empty error should be ommited
* calc state root
* logger json remove code duplication
* fix
2021-05-05 21:55:15 +01:00
Alex Sharov
f3d2af1e33
Rpcdaemon: move tx pool to own grpc service, subscribe to pending txs ( #1863 )
2021-05-04 08:37:17 +07:00
ledgerwatch
75ca6b8c76
Initial work on integration tests ( #1797 )
...
* Initial work on integration tests
* Delete subtree
* Squashed 'interfaces/' content from commit 41a082ba4
git-subtree-dir: interfaces
git-subtree-split: 41a082ba4bde38647325eb0416cb1da1b4ca2b12
* Add consensus interfaces
* More stuff
* comments
* Fix compile
* Squashed 'interfaces/' changes from 41a082ba4..1b13a42a7
1b13a42a7 Add chainspec to consensus interface
git-subtree-dir: interfaces
git-subtree-split: 1b13a42a7803f5464722867a71065c27a7ebe8c3
* Squashed 'interfaces/' changes from 1b13a42a7..93a072c4c
93a072c4c Add missing import
git-subtree-dir: interfaces
git-subtree-split: 93a072c4c099d169322a3a53b95e40203276820b
* New consensus interfaces
* More on clique
* Fix tests
* Squashed 'interfaces/' changes from 93a072c4c..62f4ec4b2
62f4ec4b2 Add test service for consensus engine
git-subtree-dir: interfaces
git-subtree-split: 62f4ec4b263107635ffa3aabd5d634af22e813c6
* Squashed 'interfaces/' changes from 62f4ec4b2..061a63543
061a63543 Fix
git-subtree-dir: interfaces
git-subtree-split: 061a63543babdeb51ab7e3a96dec56b2485d4389
* Configuring clique engine with toml specs - start
* More toml parsing
* Constructed rinkeby genesis
* Simplify VerifyHeaders functions
* Fix lint
* Remove concurrent verification tests
* Fix lint
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-04-29 16:14:10 +01:00
Alex Sharov
e7849498d5
Degbug build support (for delve debugger and for getting C code profiling, traces) ( #1843 )
2021-04-29 21:29:58 +07:00
Alex Sharov
9d82456f17
remove chain indexer and core.setHead func ( #1826 )
2021-04-27 14:48:59 +07:00
ledgerwatch
e3f3dd3c9b
Integration tests 1 ( #1793 )
...
* Initial commit
* Add sentry gRPC interface
* p2psentry directory
* Update README.md
* Update README.md
* Update README.md
* Add go package
* Correct syntax
* add external downloader interface (#2 )
* Add txpool (#3 )
* Add private API (#4 )
* Invert control.proto, add PeerMinBlock, Separare incoming Tx message into a separate stream (#5 )
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Separate upload messages into its own stream (#6 )
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Only send changed accounts to listeners (#7 )
* Txpool interface doc (#9 )
* Add architecture diagram source and picture (#10 )
* Typed hashes (#11 )
* Typed hashes
* Fix PeerId
* 64-bit tx nonce
* Add proper golang packages, max_block into p2p sentry Status (#12 )
* Add proper golang packages, max_block into p2p sentry Status
* Change EtherReply to address
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Add Rust infrastructure (#13 )
* DB stats methods removed by https://github.com/ledgerwatch/turbo-geth/pull/1665
* more p2p methods (#15 )
* add mining methods (#16 )
* First draft of Consensus gRPC interface (#14 )
* Update Rust build
* Fix interfaces in architecture diagram (#17 )
* Fix KV interface provider
* Fix Consensus interface provider
* drop java attributes (#18 )
* tx pool remove unused import (#19 )
* ethbackend: add protocol version and client version (#20 )
* Add missing ethbackend I/F (#21 )
* Add interface versioning mechanism (#23 )
Add versioning in KV interface
Co-authored-by: Artem Vorotnikov <artem@vorotnikov.me>
* spec of tx pool method (#24 )
* spec of tx pool method (#25 )
* Update version.proto
* Refactor interface versioning
* Refactor interface versioning
* Testing interface
* Remove tree
* Fix
* Build testing protos
* Fix
* Fix
* Update to the newer interfaces
* Add ProtocolVersion and ClientVersion stubs
* Hook up ProtocolVersion and ClientVersion
* Remove service
* Add compatibility checks for RPC daemon
* Fix typos
* Properly update DB schema version
* Fix test
* Add test for KV compatibility|
* Info messages about compability for RPC daemon
* DB schema version to be one key
* Update release intructions
Co-authored-by: Artem Vorotnikov <artem@vorotnikov.me>
Co-authored-by: b00ris <b00ris@mail.ru>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: lightclient <14004106+lightclient@users.noreply.github.com>
Co-authored-by: canepat <16927169+canepat@users.noreply.github.com>
Co-authored-by: Alex Sharov <AskAlexSharov@gmail.com>
Co-authored-by: canepat <tullio.canepa@gmail.com>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-04-24 16:46:29 +01:00
Alex Sharov
ac7ece4a4d
Revert txpool grpc ( #1794 )
2021-04-24 10:48:06 +07:00
Alex Sharov
e7a78a2d9f
Mdbx: speedup tests ( #1776 )
2021-04-21 20:03:08 +07:00
Alex Sharov
93a57f46a6
minimal_golang_version_check ( #1752 )
2021-04-19 17:54:56 +07:00
Alex Sharov
7aabdeb829
Remote tx pool generate code ( #1730 )
2021-04-15 17:06:05 +07:00
Alex Sharov
acf1118300
MDBX: enable MADV_RANDOM ( #1712 )
2021-04-12 21:30:19 +07:00
Alex Sharov
91ce78c037
support max git version on ubuntu 18.04 ( #1710 )
2021-04-11 11:23:50 +07:00
alex.sharov
3a2c4913e2
remove old binaries
2021-04-11 08:03:52 +07:00
Alex Sharov
1f5c0e0dc2
drop db tool
2021-04-10 15:38:02 +07:00
Alex Sharov
ad342b27ab
Mdb no db size log ( #1665 )
2021-04-03 10:30:28 +07:00
Alex Sharov
ef77eb3053
tx.RwCursor() to return err (first step of removing lazy cursors) ( #1656 )
2021-04-02 13:36:49 +07:00
alex.sharov
2ba007b17c
increase tests timeout
2021-03-31 10:48:52 +07:00
Alex Sharov
ea7425adea
tests ( #1631 )
2021-03-31 08:26:01 +07:00
Artem Vorotnikov
742e998dd3
Add Docker step to Actions workflow ( #1630 )
2021-03-30 19:16:07 +03:00
Artem Vorotnikov
3da261ba9b
Add Actions workflow ( #1606 )
2021-03-30 02:17:19 +03:00
Artem Vorotnikov
9b8cdc0f22
Fix lints and remove more unused code ( #1621 )
2021-03-29 10:58:45 +07:00
ledgerwatch
21295e475c
Update Makefile ( #1583 )
2021-03-22 08:31:42 +00:00
Artem Vorotnikov
c9bccbb612
Remove autogen from typedcursor ( #1576 )
2021-03-21 15:10:14 +07:00
Alex Sharov
ce868009d6
devel up ( #1574 )
2021-03-21 10:02:15 +07:00
Alex Sharov
0953c11c04
grpc version up ( #1568 )
2021-03-20 16:35:13 +07:00
ledgerwatch
81ea5bab78
More updates to downloader, new p2psentry protocol ( #1559 )
...
* Initial commit
* Add sentry gRPC interface
* p2psentry directory
* Update README.md
* Update README.md
* Update README.md
* Add go package
* Correct syntax
* add external downloader interface (#2 )
* Add txpool (#3 )
* Add private API (#4 )
* Invert control.proto, add PeerMinBlock, Separare incoming Tx message into a separate stream (#5 )
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Separate upload messages into its own stream (#6 )
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Only send changed accounts to listeners (#7 )
* Txpool interface doc (#9 )
* More additions
* More additions
* Fix locking
* Intermediate
* Fix separation of phases
* Intermediate
* Fix test
* More transformations
* New simplified way of downloading headers
* Fix hard-coded header sync
* Fixed syncing near the tip of the chain
* Add architecture diagram source and picture (#10 )
* More fixes
* rename tip to link
* Use preverified hashes instead of preverified headers
* Fix preverified hashes generation
* more parametrisation
* Continue parametrisation
* Fix grpc data limit, interruption of headers stage
* Add ropsten preverified hashes
* Typed hashes (#11 )
* Typed hashes
* Fix PeerId
* 64-bit tx nonce
* Disable penalties
* Add goerli settings, bootstrap nodes
* Try to fix goerly sync
* Remove interfaces
* Add proper golang packages, max_block into p2p sentry Status
* Prepare for proto overhaul
* Squashed 'interfaces/' content from commit ce36053c2
git-subtree-dir: interfaces
git-subtree-split: ce36053c24db2f56e48ac752808de60afa1dfb4b
* Change EtherReply to address
* Adaptations to new types
* Switch to new types
* Fixes
* Fix formatting
* Fix lint
* Lint fixes, reverse order in types
* Fix lint
* Fix lint
* Fix lint
* Fix test
* Not supporting eth/66 yet
* Fix shutdown
* Fix lint
* Fix lint
* Fix lint
* return stopped check
Co-authored-by: Artem Vorotnikov <artem@vorotnikov.me>
Co-authored-by: b00ris <b00ris@mail.ru>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: lightclient <14004106+lightclient@users.noreply.github.com>
Co-authored-by: canepat <16927169+canepat@users.noreply.github.com>
2021-03-19 21:24:49 +00:00
Igor Mandrigin
0a55895b33
Merge branch 'master' into geth-1-10-1
2021-03-17 16:50:20 +01:00
Chase Wright
487dcaa6e6
Fix Typo in Makefile ( #1555 )
...
stats -> state
2021-03-15 17:21:41 +00:00
Alex Sharov
3ffa029497
Add mdbx_drop cli tool ( #1553 )
2021-03-15 09:41:02 +07:00
Alexey Sharp
7fd3417f52
Fix more compile errors
2021-03-14 19:07:19 +00:00
Alex Sharov
6d0d84cda6
log git branch and git commit ( #1523 )
2021-03-01 11:02:06 +07:00
Alex Sharov
f556af6276
Prometheus metrics: more virtual memory visibility, more cross-platform metrics ( #1520 )
2021-02-28 11:11:28 +07:00
Alex Sharov
f1ee8d507e
New Trie db layout - store trie structure info and multiple hashes per record ( #1500 )
...
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* SE
* SE
* SE
* SE
* SE
* SE
* SE
* SE
* SE
* SE
* SE
* SE
* SE
* SE
* SE
2021-02-21 18:41:59 +00:00
ledgerwatch
6e56097056
Bring in refactored p2p sentry interface and adjust downloader for it ( #1497 )
...
* Initial commit
* Add sentry gRPC interface
* p2psentry directory
* Update README.md
* Update README.md
* Update README.md
* Add go package
* Correct syntax
* add external downloader interface (#2 )
* Add txpool (#3 )
* Add private API (#4 )
* Invert control.proto, add PeerMinBlock, Separare incoming Tx message into a separate stream (#5 )
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Use new p2psentry interface
* Remove
* Fix lint
* Fix lint
* Separate upload messages into its own stream (#6 )
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
* Add header upload
* Remove
* Add upload of block headers
* Add block bodies upload
* Fix lint
* Bugfix for blockBodies
* Fix for body upload logging
* Print peerId for GetBlockHeaders
* Invoke block hashes stage to enable block body upload
* Fix test
* Fix stuck bodies download
Co-authored-by: Artem Vorotnikov <artem@vorotnikov.me>
Co-authored-by: b00ris <b00ris@mail.ru>
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2021-02-15 18:54:45 +00:00
Alex Sharov
ad3b330872
lint up ( #1492 )
2021-02-12 19:58:12 +07:00
Alex Sharov
b77dfec055
remove debug-web-ui and restapi ( #1480 )
2021-02-09 19:42:14 +07:00
Alex Sharov
47b4f52db2
mdbx: C11 atomics performance fix and disable MDBX_ENV_CHECKPID ( #1472 )
2021-02-08 11:35:02 +07:00
Alex Sharov
f0bb3a6dfa
Mdbx new beta version with fixed blockers ( #1461 )
2021-02-01 20:57:41 +07:00
Alex Sharov
7fd1f19435
txdb lazy cursors creation, grpc version up ( #1440 )
...
* txdb lazy, grpc version up
* tidy
* fix lint
2021-01-15 09:38:09 +00:00
Alex Sharov
7262fd503b
Mdbx devel 5 ( #1413 )
...
* tx
* fix tests
* fix tests
* fix tests
* sequence
2020-12-16 14:35:14 +00:00
Alex Sharov
4565bd43c1
Mdbx v0.9.2 ( #1373 )
...
* up devel
* up devel
* up devel
* up devel
* up devel
* up devel
* up devel
* up devel
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* squash
* switch to master
* mdbx 0.9.2
* mdbx 0.9.2
* %<<$!%%%%%%<o'{}k.###
* %<<$!%%%%%%<o'{}k.###
* merge
* merge
* merge
* merge
* ad
* ad
* ad
* ad
2020-11-28 14:26:28 +00:00
Igor Mandrigin
393c9965ae
rpcdaemon: subscriptions, newHeads ( #1359 )
...
* fix `make grpc` on new checkouts
* update proto files
* add some stub
* prototype with fake events
* notifying about events
* pass events
* events are being sent
* transfer headers to filters
* create the “filters” struct
* implement new heads
* PoC of New Heads subscription
* fix keep alive
* fixups for the client
* add “type” to the event
* support header event type on client
* better stage refactor
* fixup for the eth backend
* fixups
* fix tests
* fix tests
* fix linters
* address comments
* remove unused log
2020-11-17 19:13:41 +00:00
Alex Sharov
b3f1915d09
ChangeSets dupsort ( #1342 )
...
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* change_set_dup
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* working version
* aa
* aa
* aa
* aa
* aa
* aa
* aa
* aa
* aa
* aa
* aa
* aa
* aa
* aa
* aa
* squash
* squash
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* history_early_stop
* history_early_stop
* vmConfig with ReadOnly false
* auto_increment
* auto_increment
* rebase master
Co-authored-by: Alexey Akhunov <akhounov@gmail.com>
2020-11-16 12:08:28 +00:00
b00ris
6464da7670
Remote snapshot downloader ( #1343 )
...
* save state
* save state
* save state
* refactoring
* fix
* save state
* save state
* fmt
* fix lint
* restore torrents for external downloader
* fix lint
* download
* skip debug test
* debug
* remote debug
* small cli fixes
* skip debug test
* external snapshot predownloader
* get rid of remote downloader
* fix lint
* clean makefile
* fix lint
* fix lint
* cleanup
* fix ci
* fmt
* remove proto from interfaces
* Squashed 'interfaces/' content from commit acd02bb94
git-subtree-dir: interfaces
git-subtree-split: acd02bb94c5a421aa8f8d1fd76cd8aad668e9fcb
2020-11-13 16:16:47 +00:00
Thomas Jay Rush
546b91f47e
Updating RPC tests in Postman ( #1340 )
2020-11-09 09:52:18 +01:00
Alex Sharov
1b4f721a61
fix_db_tools_build_dir ( #1337 )
2020-11-03 14:19:57 +07:00
ledgerwatch
cceb8c2c3a
Sharded state experiment based on call_traces stage run via integration ( #1329 )
...
* Initial work on state shards
* Fix compile errors
* Intermediate
* Implement dispatcher
* Implemented sharded reader
* No cache
* Print comms
* No prepopulation
* Print dispatcher activity
* Print more
* Print errors
* Fix dispatcher
* Remove logging
* Dispatcher to enforce initial barrier
* Don't print that much
* Turn off cache pre-seeting for state sharding
* Artificial latency, fixed number of blocks to execute
* Fix
2020-10-31 11:51:56 +00:00
Igor Mandrigin
1b2bf8bf61
fix git commit when using make docker ( #1323 )
...
* fix git commit when using `make docker`
* avoid warning about LATEST_COMMIT for linters in Docker
2020-10-30 08:43:24 +00:00
Alex Sharov
399db7ee3b
LMDB v0.9.27, and add all lmdb cli tools ( #1303 )
...
* mdb tools
* mdb tools
* mdb tools
* mdb tools
* mdb tools
* mdb tools
* mdb tools
* mdb tools
* clean
* clean
* clean
* clean
* clean
* rebase master
Co-authored-by: Alexey Akhunov <akhounov@gmail.com>
2020-10-29 13:19:46 +00:00
ledgerwatch
ea060815ef
Remove z3 and semantics ( #1314 )
...
* Removed z3 submodule
* Remove semantics and z3 from build
* Fixes to CI
2020-10-28 17:52:00 +00:00
Igor Mandrigin
abf4fa5861
Don't require MDBX if you don't specify it ( #1313 )
...
* fix compilation
* add mdbx flag to the tg binary
* fix makefile
* fixups
* fix makefile
* fix readme
* fix linters
* fix tests
2020-10-28 12:17:18 +00:00
Alex Sharov
531d36efcb
mdbx support ( #1235 )
2020-10-28 10:18:10 +07:00
ledgerwatch
7554428884
POC of header downloader - splitting into 2 processes: sentry + downloader (via gRPC) ( #1291 )
...
* Splitting sentry and downloader - the beginning
* A bit more
* More on sentry
* More gRPC
* Sentry and downloader separated
* Update binding for stable version of grpc
* Better bufferSize flag
* Fix lint
* Send pelanties
* Fix lint
* Remove hard-coded tips on connect
* Tidy the logs a bit
* Deal with hardTips on Recovery
* Print hard tips
* Hide empty anchors
* Request headers after receiving a message
* Better waking up
* Print hard-coded block numbers
* Print outgoing requests
* Debug logging
* In the middle protection
* Sentry not to lose peers when core disconnects
2020-10-25 22:05:37 +00:00
Alex Sharov
9e7ed07fc6
Remove restapi and debug-ui from readme and docker-compose ( #1263 )
...
* rm_restapi_from_readme
* rm_restapi_from_readme
* rm_restapi_from_readme
* rm_restapi_from_readme
2020-10-20 09:20:24 +01:00
Alex Sharov
79815e4298
include_lmdb_stat_tool ( #1206 )
2020-10-08 08:11:36 +01:00
Alex Sharov
61fbe34024
Better cbor support ( #1163 )
2020-10-02 10:56:13 +07:00
Alex Sharov
0e62fa4d59
add return ( #1158 )
2020-09-30 10:28:36 +01:00
Alex Sharov
0559d56dae
Pin protoc version and store it in ./build/bin ( #1154 )
...
* use ./build/bin folder to store protobuf binaries
* use ./build/bin folder to store protobuf binaries
2020-09-29 15:09:50 +01:00
Alex Sharov
5a74fe4884
use ./build/bin folder to store protobuf binaries ( #1153 )
2020-09-29 10:55:41 +01:00
Igor Mandrigin
eca39e12f2
Fix reproducible builds ( #1099 )
2020-09-11 18:42:33 +02:00
Thomas Jay Rush
3f18b9eaa3
1074 web3 client version ( #1094 )
...
* Removed old TODOs
* Adding support for web3_clientVersion and web3_sha3
* Fixing formatting
* Adding new endpoints to README
* Responding to comments by removing date from compile-time values
2020-09-11 14:12:38 +01:00
Alex Sharov
fd9c7c3b2d
kill bolt ( #1085 )
...
* kill bolt
* kill bolt
* fix test
* clean
2020-09-09 11:09:55 +01:00
ledgerwatch
256e4262e1
2nd batch of Headers PoC changes ( #1067 )
...
* PoC utility
* Headers cmd
* headers download command
* Fix lint
* Send handshake
* Receive Status message
* Better error messages
* Messages
* Fix
* Fix lint
* Print block number for NewBlockMsg
* Fix lint
2020-09-07 07:03:12 +01:00
Igor Mandrigin
d14e45d4d0
cmd/geth -> cmd/tg and get rid of geth implementation. (#1061 )
2020-09-06 13:35:32 +02:00
Evgeny Danilenko
e4f495fa44
Get logs ( #1028 )
...
* it compiles
* after recent master
* fix linters warnings
* grpcV7
* go mod tidy
* unmarshall adresses or adress
* fix linters
* after cr
* after cr
* after cr
* after cr
* fix tests
* remove dev version
* it compiles
* mod tidy
* fix bin deps
* use stable version of grpc
* switch back to master constructor
* switch back to master constructor
* add a bit docs
* add a bit docs
Co-authored-by: Alexey Akhunov <akhounov@gmail.com>
Co-authored-by: alex.sharov <AskAlexSharov@gmail.com>
2020-09-03 08:51:19 +01:00
Alex Sharov
aead37a39f
Reproducible versions of binary dependencies ( #1037 )
2020-09-03 13:07:33 +07:00
Alex Sharov
07ca5c643a
eth_syncing ( #991 )
...
* eth_syncing
* linters
* fix readme
* cleanup cli params
* go mod tidy
* remove memsize ui dep
* remove bloomfilter
* implement net_peerCount
* remove legacy flags
2020-08-29 08:24:50 +01:00
Igor Mandrigin
a119a3a35f
Simplify build system ( #955 )
2020-08-21 14:38:11 +02:00
Alex Sharov
f41959f030
drop badger support ( #869 )
...
* drop badger support
* rebase master
2020-08-05 16:33:45 +01:00
