Commit Graph

47 Commits

Author SHA1 Message Date
Nishant Das
eef35996de Blacklist Keys in Cluster PK Manager (#2536)
* initialize rpc client

* add struct

* gaz

* add keymap

* update proto and add rpc methods

* update proto

* add method

* make changes

* add routine

* gaz

* mockgen

* error fix

* prom metric

* Some improvements

* fixes

* fix and working cluster pk manager

* fix and working cluster pk manager

* fix and working cluster pk manager

* fix and working cluster pk manager

* regen mocks and pb.go

* k8s
2019-05-12 16:38:37 -04:00
Preston Van Loon
9f7f7d6cff
Tracing improvements (#2570)
* some improvements

* fix

* gazelle

* disable lostcancel
2019-05-11 17:43:55 -04:00
Preston Van Loon
78a76e56fb Add alert manager config (#2564) 2019-05-11 09:21:21 -07:00
Preston Van Loon
991ee7e81b "Super sync" and naive p2p reputation (#2550)
* checkpoint on super sync with reputation

* ensure handling only expected peers msg

* exclusive of finalized block

* skip block saved already

* clean up struct

* remove 2 more fields

* _

* everything builds, but doesnt test yet

* lint

* fix p2p tests

* space

* space

* space

* fmt

* fmt
2019-05-09 16:02:24 -05:00
Preston Van Loon
9a4612918c add path for prylabs.net/ssz (#2508) 2019-05-05 21:24:47 -07:00
Preston Van Loon
06a3a0de14 add production config for testnet release (#2493) 2019-05-05 14:04:28 -05:00
Preston Van Loon
a152ba9528 Add CORS for ssz api (#2476)
* first pass ssz server for decoding deposit input data

* fix decoding

* revert viz change on helper

* add image target

* use /api prefix, add deployment for cluster

* fix lint

* needed CORS
2019-05-03 14:46:39 +08:00
Preston Van Loon
9fb5bbd662 SSZ web api for decoding input data (#2473)
* first pass ssz server for decoding deposit input data

* fix decoding

* revert viz change on helper

* add image target

* use /api prefix, add deployment for cluster

* fix lint
2019-05-03 00:11:54 -05:00
Preston Van Loon
f70e648b60 add nginx proxy caching in front of SSR (#2456) 2019-05-01 07:08:18 -07:00
Preston Van Loon
3f742d79c0
Use new port for testnet site, redirect prylabs.net to alpha.prylabs.net for now (#2441) 2019-04-29 18:21:54 -04:00
Preston Van Loon
a9d2003623 Add SSL support for prylabs.net, support opengraph on alpha.prylabs.net (#2419) 2019-04-28 21:09:31 -07:00
Preston Van Loon
5249134704 set cluster manager to deposit 3.2 eth (#2416) 2019-04-28 17:23:03 -05:00
Preston Van Loon
66f3964c1b allow CORS from anywhere (#2375) 2019-04-24 15:57:06 -05:00
Preston Van Loon
376aacdad6 Use infura for http provider as well (#2363) 2019-04-23 16:17:02 -05:00
Raul Jordan
51d4965388 Enable Committee Cache By Default (#2323) 2019-04-22 06:37:42 -07:00
Preston Van Loon
a5da9f2dd6
Add feature flag to toggle gossip sub in p2p (#2322)
* add feature flag to enable gossip sub in p2p

* invert the enable/disable logic

* add the flag in k8s and fix tests

* gazellle

* return empty config if nil
2019-04-21 13:31:23 -04:00
Preston Van Loon
79bc40dcbe Provide contract address via http (#2303)
* Add contract-address webserver

* add comment

* printf
2019-04-19 14:18:35 -05:00
Preston Van Loon
ecebea01c0 Fix recycling of cluster private keys (#2275)
* fix recycling of private keys

* Update cluster-manager.yaml
2019-04-16 21:23:31 -05:00
Preston Van Loon
2148a83b02
Update cluster pk manager to assign multiple keys to validators (#2112)
* checkpoint

* move lock

* checkpoint

* checkpoint

* chkpt

* update readme so i know what im supposed to do

* ckpt

* checkpoint

* checkpoint

* chkpt

* Fix image build

* handle errors

* add port to pod

* lint

* Update beacon-config.config.yaml

* lint
2019-04-14 17:53:34 -04:00
Preston Van Loon
6ebd3a0319
--enable-committees-cache as default for beacon-chain (#2242) 2019-04-13 06:19:24 +10:00
Preston Van Loon
9a6a275d3d
Use /healthz for liveness and readiness probes in beacon chain (#2180)
* lower the p2p peer count minimum for a successful status

* add liveness and health probes

* 5m instead of 2m
2019-04-05 17:05:28 -05:00
Preston Van Loon
d19775dff9
Update rollout strategy for validators to 5% max unavailable with no surging (#2169)
* use better rollout strategy

* fix
2019-04-05 09:51:38 -05:00
Raul Jordan
eb900a8193
Refactor Initial Sync, Enable Catching Up to Chain (#2111)
* refactor initial sync to prevent reorg infinite loops

* lint

* fixed build

* passing tests

* tests passing

* terence suggestion

* new attempt

* clean up and refactor sync service

* complete the new initial sync logic

* revert head

* init sync working

* config for blockchain receive block

* all works

* builds

* fix a few more tests

* init sync tests pass

* revert scripts

* revert accounts changes

* lint

* lint2

* travis lint

* fix build

* fix single use argument

* any peer

* imports spacing

* imports

* ready for a rolling restart

* add todo

* fork choice in blocks when exiting sync

* readd finalized state root to requests

* successful build

* revert blockchain config

* old config reversion

* initial sync tests pass

* initial sync full test works

* lint

* use the new block processing api

* new proto defs

* init sync functions again

* remove sync polling

* tests fixed

* fixed catching up with chain

* tests pass

* spacing

* lint

* goimports

* add changes

* add lock and conditional to prevent multiple goroutines

* make reg sync synchronous

* add

* fixed the parent block issue

* fix errors in chain service

* tests pass

* check nil block

* typo

* fix nil state

* merge & conflicts

* revert synchronus reg sync

* add more spans to state db

* fix lint

* lint
2019-04-03 10:13:19 -05:00
Preston Van Loon
ff1a6f0b62 use infura for now (#2140) 2019-04-01 21:41:31 -05:00
Preston Van Loon
02f9a56513 Update beacon-chain.deploy.yaml (#2119) 2019-03-30 18:11:34 -07:00
Preston Van Loon
7390a4e585
Update beacon-chain.deploy.yaml (#2105) 2019-03-28 20:03:20 -05:00
Preston Van Loon
b477a747fc add slower update to beacon-chain node (#2087) 2019-03-27 09:35:10 -05:00
Preston Van Loon
46a83a83d0
Use DNS resolution and istio for redialing bootnode (#2071)
* Use DNS resolution and istio for redialing bootnode

* use faster peering
2019-03-25 12:56:42 -05:00
Raul Jordan
053038446c
Allow 8 Validator Multinode Cluster to Run Indefinitely (#2050)
* plug forkchoice to blockchain service's block processing

* fixed tests

* more fixes...

* clean ups

* fixed test

* Update beacon-chain/blockchain/block_processing.go

* merged with 2006 and started fixing tests

* remove prints

* fixed tests

* lint

* include ops service

* if there's a skip slot, slot--

* fixed typo

* started working on test

* no fork choice in propose

* bleh, need to fix state generator first

* state gen takes input slot

* feedback

* fixed tests

* preston's feedback

* fmt

* removed extra logging

* add more logs

* fixed validator attest

* builds

* fixed save block

* children fix

* removed verbose logs

* fix fork choice

* right logs

* Add Prometheus Counter for Reorg (#2051)

* fetch every slot (#2052)

* test Fixes

* lint

* only regenerate state if there was a reorg

* better logging

* fixed seed

* better logging

* process skip slots in assignment requests

* fix lint

* disable state root computation

* filter attestations in regular sync

* log important items

* better info logs

* added spans to stategen

* span in stategen

* set validator deadline

* randao stuff

* disable sig verify

* lint

* lint

* save only using historical states

* use new goroutine for handling sync messages

* change default buffer sizes

* better p2p

* rem some useless logs

* lint

* sync tests complete

* complete tests

* tests fixed

* lint

* fix flakey att service

* PR feedback

* undo k8s changes

* Update beacon-chain/blockchain/block_processing.go

* Update beacon-chain/sync/regular_sync.go

* Add feature flag to enable compute state root

* add comment

* gazelle lint fix
2019-03-25 10:21:21 -05:00
terence tsao
7565fbe3b8 Mega Renovate Updates (#2068)
* Update dependency com_github_spf13_cobra to v0.0.3

* Update dependency com_github_allegro_bigcache to v1

* Update dependency com_github_hashicorp_go_multierror to v1

* Update dependency com_github_x_cray_logrus_prefixed_formatter to v0.5.2

* Update dependency com_github_fd_go_nat to v1

* Update dependency com_github_matttproud_golang_protobuf_extensions to v1

* Update dependency com_github_grpc_ecosystem_go_grpc_middleware to v1

* Update com_github_atlassian_bazel_tools commit hash to 986ed8f

* Update dependency bazel_skylib to v0.8.0

* Update dependency com_google_cloud_go to v0.37.1

* Update dependency io_opencensus_go to v0.19.2

* Update libp2p

* Update dependency com_github_go_yaml_yaml to v2

* Update dependency com_github_golang_mock to v1

* Update dependency com_github_google_uuid to v1

* Update dependency com_github_gorilla_websocket to v1

* Update dependency com_github_huin_goupnp to v1

* add thirft
2019-03-25 08:14:43 -05:00
Preston Van Loon
aa4f95d818
Add IP based LB (#2055) 2019-03-23 09:26:57 -05:00
Preston Van Loon
9b4f984cc6
Remove old flag from k8s config (#2037)
* Remove old flag

* Update validator.deploy.yaml
2019-03-20 00:14:25 -04:00
Ivan Martinez
7f3d8a7e7b Add README to beacon-chain k8s (#1966) 2019-03-17 08:49:25 -06:00
Preston Van Loon
612bb38077 Cross p2p spans, more spans, synchronous attestations, minor fixes (#2009)
* Fix assignments bug where validators don't retry for assignments on failure

* synch only please

* trying to fix state issues

* trying random stuff

* do not explode

* use ctx

* working build, failing tests

* broadcast local addrs as well as relay addrs

* fixed p2p tests, more tests to fix still

* another test fixed, log warning instead of throw error

* Fix last tests

* godoc

* add test for broadcast in apply fork choiec

* remove unneeded code

* remove tracer adapter, not needed

* remove extra stuff

* remove any

* revert addr_factory

* revert addr_factory

* Revert "revert addr_factory"

This reverts commit e93fb706494a1070158b8db31e67146d6b0648ad.

* Revert "revert addr_factory"

This reverts commit dedaa405559cc818698870c4e4570953367f1e3c.

* revert removal of this code

* unused param
2019-03-17 10:56:05 +08:00
Preston Van Loon
509c973936 minor fixes (#1949) 2019-03-08 21:12:38 -06:00
Preston Van Loon
2e7b08f97e
p2p fixes / improvements (#1931)
* don't broadcast to yourself

* todo

* Also listen for incoming streams

* send to a specific peer

* add godoc comment

* handle EOF as a normal thing

* gazelle

* add test for subscribing via direct comm
2019-03-07 21:37:15 -05:00
Preston Van Loon
5eb5f6afa9
Faucet enhancements + cluster private key management system (#1679)
* second pass at faucet, no rate limiting yet

* Add authentication support, step 1. This stuff needs to be refactored and tested

* move deposit input to keystore pkg, add proof of possession and withdrawal addr

* checkpoint on progress with cluster private key manager

* checkpoint w/ bootnode config

* checkpoint

* resolve todo

* encrypt the secrets

* add note about querying testnet

* workspace

* checkpoitn

* remove limits

* update

* checkpoint

* checkpoint

* remove jwt stuff

* fix build

* lint

* lint

* remove init

* remove jwt

* update

* checkpoint
2019-03-07 11:14:57 -05:00
Preston Van Loon
81c2e4e94b
First pass on pow faucet for testnet (#1624)
* first pass on pow faucet for testnet

* delete unused thing

* remove unneeded thing

*  remove other thing

* https & remove a log

* don't force redirect on https, its not working?

* some renaming of stuff

* lint

* lint

* some stablity config

* move protos to proto directory, add generated pb file for go users

* add health probe

* add hpa and request cpu

* handle err

* some more config
2019-02-19 12:32:14 -05:00
Raul Jordan
fb9d60c377
Update References to Deposit Contract, Update Flags (#1576)
* update readme

* rename k8 file
2019-02-13 13:08:28 -06:00
Preston Van Loon
7078382b82
k8s goerli config (#1517)
* Added goerli node config

* add validator configuration

* working better with istio

* cleanup

* Update bootnodes and genesis

* prepare goerli

* cleaning up geth stuff

* Working on istio

* Update somethings for istio

* Add back bootnode for internal discovery, add some labels for istio

* support ws

* ssl via lets encrypt

* Remove ingress

* Expose grafana

* allow insecure

* Add consistent loadbalancing

* use pod antiaffinity so that the public nodes are highly available

* Change app name to goerli

* Add unstable graphql

* remove redis

* lint

* gazelle and fix weights

* better affinity
2019-02-08 15:30:38 -05:00
Nishant Das
a57659a43b
Fix Readme (#1406)
* remove refs

* remove ref from yaml
2019-01-28 16:24:53 +08:00
Preston Van Loon
108d05110d Kubernetes 4 of ?? - rotate secrets (#991) 2018-11-29 08:35:17 -06:00
Preston Van Loon
740a9b76a7
Kubernetes - Part 3 of ?? (#981)
* Add nginx ingress for proof-of-work namespace

* connect beacon-chain to pow namespace geth-nodes for websocket connections

* Added relay to beacon-chain

* Route inbound TCP traffic on port 20000 to beacon-relay

* Add bootnode

* Add a basic pk

* checkpoint

* Added flag for p2p port

* Register flag with main

* Set P2P port specifically

* Add beacon chain config

* add deployvrc job

* Add deployvrc service account

* review

* gazelle

* a cluster is needed, i guess
2018-11-28 00:27:21 -05:00
terence tsao
8408315f9c switch ethereum 2.0 to ethereum serenity (#714) 2018-11-01 07:02:01 -04:00
Raul Jordan
4937da5c7d
Update Documentation + Create a Subproject for Important Markdown Docs (#451)
* add docs folder for markdowns

* create scripts project, move readmes

* update all docs

* fix travis
2018-09-01 21:25:06 -05:00
Preston Van Loon
9c764555eb k8s: Kubernetes - Part 2 of ?? (#401) 2018-08-14 11:16:21 -05:00
Preston Van Loon
26fec66da4
Kubernetes - Part 1 of ?? (#348)
* Add basic k8s configuration for geth deployments

* set genesis difficulty to 0x0

* gazelle, comments

* More comments on priority class and adjust priority class for ethstats

* Adjustments to the miner limits

* set minimum gas price to 0
2018-07-30 10:04:47 -04:00