Go to file
2020-08-02 18:24:07 +02:00
.buildkite Nightly tests (#444) 2020-04-12 19:37:15 +01:00
.circleci [wip] Cache z3 build on CI, up golangci-lint to v1.27.0 (#615) 2020-06-04 09:54:17 +01:00
.github geth 1.9.13 (#469) 2020-04-19 18:31:47 +01:00
.golangci Use MOV instead of VMOV in fnvHash16AVX2 to peacify asmdecl (#699) 2020-06-30 11:23:28 +01:00
accounts Jumpdest skip optimisation (#851) 2020-08-01 17:56:57 +01:00
build Fixup for TestSendTransactions65 (#838) 2020-07-31 10:44:42 +02:00
cmd integration_use_storage_mode_from_db (#857) 2020-08-02 12:53:42 +01:00
common DupSort for Plain and Hashed state buckets (behind feature flags) (#854) 2020-08-02 12:53:08 +01:00
consensus Jumpdest skip optimisation (#851) 2020-08-01 17:56:57 +01:00
console post-rebase fixups 2020-06-15 19:38:54 +03:00
contracts/checkpointoracle accounts/abi: move U256Bytes to common/math (#21020) 2020-05-20 15:26:22 +03:00
core DupSort for Plain and Hashed state buckets (behind feature flags) (#854) 2020-08-02 12:53:08 +01:00
crypto post-rebase fixups 2020-06-15 19:38:54 +03:00
debug-web-ui Docker compose (#841) 2020-08-01 09:39:04 +02:00
design auto-format code by prettier (similar to gofmt) (#405) 2020-03-25 12:45:21 +07:00
docs fixup 2020-08-02 14:47:30 +02:00
eth fixup 2020-08-02 14:47:30 +02:00
ethclient Speed up GenerateChain by using intermediate hashes (#736) 2020-07-10 22:37:34 +01:00
ethdb DupSort for Plain and Hashed state buckets (behind feature flags) (#854) 2020-08-02 12:53:08 +01:00
ethstats ethstats: avoid blocking chan when received invalid stats request (#21073) 2020-06-15 19:38:13 +03:00
event event, whisper/whisperv6: use defer where possible (#20940) 2020-05-20 15:26:22 +03:00
graphql internal/ethapi: return revert reason for eth_call (#21083) 2020-06-15 19:38:13 +03:00
internal RpcDeamon eth_call and eth_estimateGas (#817) 2020-07-29 17:21:34 +01:00
log all: fix typos in comments (#21118) 2020-06-15 19:38:13 +03:00
metrics Grpc-based remoteDb (#788) 2020-07-27 19:15:48 +07:00
migrations Stages 6 and 7 for generating history indices (#569) 2020-05-23 10:19:56 +01:00
miner Jumpdest skip optimisation (#851) 2020-08-01 17:56:57 +01:00
node Support XDG_DATA_DIR on Linux (#842) 2020-08-01 10:01:34 +02:00
p2p make lmdb default db (#675) 2020-06-18 19:13:58 +01:00
params Use CalVer for turbo-geth versioning. (#792) 2020-07-27 14:18:26 +02:00
rlp Make cmd/tester initiate staged sync, remove some pools and caches (#746) 2020-07-15 07:15:48 +01:00
rpc post-rebase fixups 2020-06-15 19:38:54 +03:00
semantics EVM semantics - writeup (#450) 2020-04-14 13:49:38 +01:00
signer post-rebase fixups 2020-06-15 19:38:54 +03:00
tests Jumpdest skip optimisation (#851) 2020-08-01 17:56:57 +01:00
trie Remove incarnation inversion (#755) 2020-07-17 15:18:31 +01:00
visual Continue comparison of genesis block with geth, expand long values (#223) 2019-12-06 12:03:12 +00:00
.dockerignore Add support of geth on hostmachine (#437) 2020-04-11 08:22:23 +01:00
.gitattributes .gitattributes: enable solidity highlighting on github (#16425) 2018-04-03 15:21:24 +02:00
.gitignore Docker compose (#841) 2020-08-01 09:39:04 +02:00
.gitmodules Semantics: Integrate Z3 into the build (#370) 2020-03-06 08:54:21 +00:00
.golangci.yml build: upgrade to golangci lint v1.27.0 (#21127) 2020-06-15 19:38:13 +03:00
.mailmap all: update license information (#16089) 2018-02-14 13:49:11 +01:00
.travis.yml eth/downloader: more context in errors (#21067) 2020-06-15 19:38:13 +03:00
appveyor.yml geth 1.9.13 (#469) 2020-04-19 18:31:47 +01:00
AUTHORS build: deduplicate same authors with different casing 2019-07-22 12:31:11 +03:00
circle.yml circleci: enable docker based hive testing 2016-07-15 16:07:34 +03:00
COPYING all: update license information 2015-07-07 14:12:44 +02:00
COPYING.LESSER all: update license information 2015-07-07 14:12:44 +02:00
docker-compose.yml Disable ipc RPC (#853) 2020-08-02 12:49:01 +01:00
Dockerfile Docker compose (#841) 2020-08-01 09:39:04 +02:00
Dockerfile.alltools Docker compose (#841) 2020-08-01 09:39:04 +02:00
fuzzbuzz.yaml eth: rework tx fetcher to use O(1) ops + manage network requests 2020-02-27 17:21:20 +03:00
go.mod remove warning from lmdb compilation (#843) 2020-08-01 09:38:48 +02:00
go.sum remove warning from lmdb compilation (#843) 2020-08-01 09:38:48 +02:00
interfaces.go [GC] uint256 rather than big.Int in Transaction (#614) 2020-06-04 08:43:08 +01:00
Makefile fix make prometheus (#850) 2020-08-01 22:05:48 +07:00
nightly.sh Nightly tests (#444) 2020-04-12 19:37:15 +01:00
README.geth.md New readme.md (#827) 2020-07-30 12:04:46 +01:00
README.md Update README.md 2020-08-02 18:24:07 +02:00
RELEASE_INSTRUCTIONS.md Jumpdest skip optimisation (#851) 2020-08-01 17:56:57 +01:00
SECURITY.md SECURITY.md: create security policy (#19666) 2019-06-06 14:40:52 +02:00
UPGRADE_INFO.md prepare for merging 2020-02-27 17:20:35 +03:00

Turbo-Geth

GoDoc

CircleCI

Disclaimer: this software is currenly a tech preview. We will do our best to keep it stable and make no breaking changes but we don't guarantee anything. Things can and will break.


NB! In-depth links are marked by the microscope sign (🔬)


Turbo-Geth is a fork of Go-Ethereum with focus on performance.

The current version is currently based on Go-Ethereum 1.9.15.

System Requirements

About 830 GB of free disk storage (630 GB state storage, 200GB temp files)

16 or 32 GB of RAM is recommended

🔬 more info on disk storage is here here)

Usage:

> git clone --recurse-submodules -j8 https://github.com/ledgerwatch/turbo-geth.git && cd turbo-geth
> make tg
> ./build/bin/tg

Key features

🔬 See more detailed overview of functionality and current limitations. It is being updated on recurring basis.

More Efficient State Storage

Flat KV storage. Turbo-Geth uses a key-value database and storing accounts and storage in a simple way.

🔬 See our detailed DB walkthrough here.

Preprocessing. For some operations, turbo-geth uses temporary files to preprocess data before inserting it into the main DB. That reduces write amplification and DB inserts sometimes are orders of magnitude quicker.

Plain state.

Single accounts/state trie. Turbo-Geth uses a single Merkle trie for both accounts and the storage.

Faster Initial Sync

Turbo-Geth uses a rearchitected full sync algorithm from Go-Ethereum that is split into "stages".

🔬 See more detailed explanation in the Staged Sync Readme

It uses the same network primitives and is compatible with regular go-ethereum nodes that are using full sync, you do not need any special sync capabilities for turbo-geth to sync.

When reimagining the full sync, we focused on batching data together and minimize DB overwrites. That makes it possible to sync Ethereum mainnet in under 2 days if you have a fast enough network connection and an SSD drive.

Examples of stages are:

  • Downloading headers;

  • Downloading block bodies;

  • Executing blocks;

  • Validating root hashes and building intermediate hashes for the state Merkle trie;

  • And more...

JSON-RPC daemon

In turbo-geth RPC calls are extracted out of the main binary into a separate daemon. This daemon can use both local or remote DBs. That means, that this RPC daemon doesn't have to be running on the same machine as the main turbo-geth binary or it can run from a snapshot of a database for read-only calls.

🔬 See RPC-Daemon docs

For local DB

> make rpcdaemon
> ./build/bin/rpcdaemon --chaindata ~/Library/TurboGeth/tg/chaindata --http.api=eth,debug

For remote DB

Run turbo-geth in one terminal window

> ./build/bin/tg --private.api.addr=localhost:9090

Run RPC daemon

> ./build/bin/rpcdaemon --private.api.addr=localhost:9090

Currently supported JSON-RPC calls (eth, debug):

eth_call
eth_getBlockByHash
eth_getBlock
eth_blockNumber
eth_getBalance
eth_getLogs
eth_estimateGas
debug_storageRangeAt
debug_traceTransaction
debug_accountRange
debug_getModifiedAccountsByNumber
debug_getModifiedAccountsByHash

REST API Daemon

Apart from JSON-RPC daemon, Turbo-Geth also contains REST API daemon. It uses turbo-geth remote DB functionality. Docs

Run turbo-geth in one terminal window

> ./build/bin/tg --private.api.addr=localhost:9090

Run REST daemon

> make restapi
> ./build/bin/restapi --private.api.addr=localhost:9090

This API is very limited at the moment too:

GET /api/v1/accounts/<accountAddress>
GET /api/v1/storage/?prefix=PREFIX

Or run all components by docker-compose

Next command starts: turbo-geth on port 30303, rpcdaemon 8545, restapi 8080, debug-web-ui 3001, prometheus 9090, grafana 3000

docker-compose build
XDG_DATA_HOME=/preferred/data/folder docker-compose up

Getting in touch

Turbo-Geth Discord Server

The main discussions are happening on our Discord server. To get an invite, send an email to tg [at] torquem.ch with your name, occupation, a brief explanation of why you want to join the Discord, and how you heard about Turbo-Geth.

Reporting security issues/concerns

Send an email to security [at] torquem.ch.

Team

Core contributors:

Thanks to:

  • All contributors of Turbo-Geth

  • All contributors of Go-Ethereum

  • Our special respect and graditude is to the core team of Go-Ethereum. Keep up the great job!


Happy testing! 🥤