Radosław Kapka
4b14fa4317
Better receiver names in validator and slasher modules ( #8296 )
...
* validator
* slasher
* rename db to s for store
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2021-01-20 14:39:07 +00:00
Radosław Kapka
9d7052796b
Restore database CLI command ( #8061 )
...
* restore beacon node db
* revert image name
* move restore out of the kv folder
* remove files from kv folder
* go mod tidy
* Remove usage of prometheus testutil
* add yes/no to prompt text
* restore slasher db
* organize imports
* go mod tidy
* restore validator db
* close slasher db
* defer close backup db in tests
* simplify function literal
2020-12-07 21:36:43 +01:00
Raul Jordan
14e1f08208
Add Backup Webhooks to All Prysm Services With DBs ( #8025 )
...
* integrate backup webhooks
* pass slasher tests
* fix node
* cmd
* gaz
* read test passes
* radek feedback
* added comment
Co-authored-by: Victor Farazdagi <simple.square@gmail.com>
2020-12-03 22:28:57 +00:00
Raul Jordan
d4c954648c
Prevent Usage of Stdlib File/Dir Writing With Static Analysis ( #7685 )
...
* write file and mkdirall analyzers
* include analyzer in build bazel
* comments to the single entrypoint and fix validator references
* enforce 600 for files, 700 for dirs
* pass validator tests
* add to nogo
* remove references
* beaconfuzz
* docker img
* fix up kv issue
* mkdir if not exists
* radek comments
* final comments
* Try to fix file problem
Co-authored-by: Ivan Martinez <ivanthegreatdev@gmail.com>
2020-11-09 14:27:03 -06:00
Alon Muroch
a04b7c2e4f
Slasher highest source target ( #7604 )
...
* WIP - slasher highest attestation start
* fixed previous
* highest source and target
* highest attestation cache
* cleanup
* persist + fixes
* PR fixes and cleanup
* slashing proto
* highest att. api
* cleanup + tests
* increased highest att. cache to 300K
* removed highest att. api (for a separate PR)
* fixed linting
* bazel build fix
* highest att. kv test
* slasher highest att. test + purge + fix on eviction persist performance
* cleanup + linting
* linting + test fixes
* bazel gazelle run
* PR fixes
* run goimports
* go mod tidy
* ineffectual assignment fix
* run gazelle
* bazel gazelle run
* test fixes
* linter fix
* Apply suggestions from code review
Co-authored-by: Shay Zluf <thezluf@gmail.com>
* goimports run
* cache tests
* A bunch of small fixes
* gazelle fix + gofmt
* merge fixes
* kv ordering fix
* small typos and text fixes
* capital letter fix
Co-authored-by: Shay Zluf <thezluf@gmail.com>
2020-10-26 14:15:42 +02:00
Shay Zluf
7c5ee0a806
prune slasher attestations ( #7335 )
...
* prune slasher attestations
* remove unused code
* gaz
* remove unused methods from interface
* fix banchmark
* fix banchmark
* go.mod tidy
* preston feedback
* add test
* goimports
* fix test
* rm
* working version
* revert changes
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2020-10-20 14:09:01 +03:00
Victor Farazdagi
a005c77b3f
Update error usage patterns to go1.13+ ( #7529 )
...
* rely on errors.Is
* wrap errors
2020-10-14 17:39:52 +00:00
rkapka
e492343ffd
Code quality issues - Remove unused code ( #6864 )
...
* remove unused code
* gofmt
* remove junk file
* bring back metrics-related functions
* bring back keymanager's code
2020-08-05 13:59:46 +02:00
Ivan Martinez
18c00ab25d
Add BoltTimeout to IO config ( #6555 )
...
* Make bolt timeout a config value
* Merge refs/heads/master into best-practices0timeout
* Merge refs/heads/master into best-practices0timeout
* Merge refs/heads/master into best-practices0timeout
2020-07-11 16:43:26 +00:00
Jim McDonald
b00c235586
Add separate permission for directories. ( #6532 )
2020-07-09 22:05:43 +08:00
Ivan Martinez
ddf494f7b7
Use same permissions for all files in Prysm ( #6522 )
...
* Unify all perm prysm wide
* Gaz
* Imports
2020-07-08 12:30:22 -05:00
Shay Zluf
9103ec98cb
QSP-14 consistent file permissions ( #6378 )
...
* QSP-14 consistent file permissions
* Merge refs/heads/master into consistent_permissions
* Merge refs/heads/master into consistent_permissions
* default io file permissions
* Merge branch 'consistent_permissions' of github.com:prysmaticlabs/prysm into consistent_permissions
* fix comments
* Merge refs/heads/master into consistent_permissions
* Merge refs/heads/master into consistent_permissions
* gaz
* Merge branch 'consistent_permissions' of github.com:prysmaticlabs/prysm into consistent_permissions
* Merge refs/heads/master into consistent_permissions
* Rename IoConfig.go to io_config.go
* Update shared/params/BUILD.bazel
* Merge refs/heads/master into consistent_permissions
* raul feedback
* Merge branch 'consistent_permissions' of github.com:prysmaticlabs/prysm into consistent_permissions
* Merge refs/heads/master into consistent_permissions
* Merge refs/heads/master into consistent_permissions
* Merge refs/heads/master into consistent_permissions
* Merge refs/heads/master into consistent_permissions
* Merge refs/heads/master into consistent_permissions
* Merge refs/heads/master into consistent_permissions
* gaz
* Merge branch 'consistent_permissions' of github.com:prysmaticlabs/prysm into consistent_permissions
* Merge refs/heads/master into consistent_permissions
* Merge refs/heads/master into consistent_permissions
* Merge refs/heads/master into consistent_permissions
* Merge refs/heads/master into consistent_permissions
2020-06-25 16:12:59 +00:00
Ivan Martinez
97315c8837
Add flat spans to slasher runtime ( #6287 )
...
* Add flat spans to runtime
* Fix tests
* Remove normal span cache from runtime
* Uncomment
* beyond lookback to db
* Remove heavy span
* better cache handling for disable lookback
* Fix lint
* Fix lint again
* Add cache back for now
* Update slasher/detection/attestations/spanner_test.go
* Fix imports
Co-authored-by: shayzluf <thezluf@gmail.com>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
Co-authored-by: Raul Jordan <raul@prysmaticlabs.com>
2020-06-22 09:55:52 -05:00
Shay Zluf
4c66edf2c2
Add cache for flan spans ( #6199 )
...
* flat span cache
* Plug cache into kv
* Add comments
* Fix
* Add doc.go
* Gaz
Co-authored-by: Ivan Martinez <ivanthegreatdev@gmail.com>
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2020-06-13 22:51:54 -04:00
Shay Zluf
fd19fd10a9
New spanner db structure ( #6061 )
...
* new spanner db structure
* lint fixes
* go mod fix
* fix iface
* remove unused
* remove extra line
* change from db
* exported field
* exported field
* revert to original
* fix
* ivan feedback
* ivan feedback
* ivan feedback
* revert mod changes
* fix db impl
* gaz
* import fix
* Try to fix tests
* ivan feedback
* new epoch store
* added comment
* fix error
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
Co-authored-by: Ivan Martinez <ivanthegreatdev@gmail.com>
2020-06-02 10:41:21 -04:00
Ivan Martinez
f9d847991c
Add RemoveOldestFromCache and save span cache on exit ( #5953 )
...
* Add RemoveOldestFromCache
* Add log
* comment
* gaz
* Merge branch 'master' into prune-spancache-historical
* Merge refs/heads/master into prune-spancache-historical
* Merge refs/heads/master into prune-spancache-historical
* Fix span defer
* Merge branch 'prune-spancache-historical' of github.com:prysmaticlabs/prysm into prune-spancache-historical
* Merge refs/heads/master into prune-spancache-historical
* Update slasher/db/kv/kv.go
2020-05-22 19:44:48 +00:00
Raul Jordan
546196a6fa
Other Package Godocs for Prysm ( #5681 )
...
* e2e docs
* slasher docs
* Merge branch 'other-package-godocs' of github.com:prysmaticlabs/prysm into other-package-godocs
* all validator package comments
* Merge branch 'master' into other-package-godocs
* completed all other packages
* Merge branch 'master' into other-package-godocs
* Merge refs/heads/master into other-package-godocs
2020-04-29 21:32:39 +00:00
Shay Zluf
37b68ba983
Slasher min span remove lookback ( #5591 )
...
* batch db write and read
* fix nil handling
* Merge branch 'master' into batch_min_max_span
* remove commented code
* Merge branch 'master' into batch_min_max_span
* raul feedback
* Merge branch 'batch_min_max_span' of github.com:prysmaticlabs/prysm into batch_min_max_span
* Merge branch 'master' into batch_min_max_span
2020-04-23 19:27:06 +00:00
Shay Zluf
9c012cc0c8
Deprecate span map cache flag ( #5551 )
...
* deprecate span map cache flag
* fix tests
* nishant feedback
* fix startup
* gaz
* nishant feedback
* gaz
* Merge branch 'master' into deprecate_span_cache
* fix img
* Update slasher/usage_test.go
* Merge refs/heads/master into deprecate_span_cache
* Merge refs/heads/master into deprecate_span_cache
* Merge refs/heads/master into deprecate_span_cache
* Merge refs/heads/master into deprecate_span_cache
* Merge refs/heads/master into deprecate_span_cache
* Merge refs/heads/master into deprecate_span_cache
* Merge refs/heads/master into deprecate_span_cache
* Merge refs/heads/master into deprecate_span_cache
* Merge refs/heads/master into deprecate_span_cache
* Merge refs/heads/master into deprecate_span_cache
* Merge refs/heads/master into deprecate_span_cache
* fix up tests
2020-04-22 15:53:09 +00:00
terence tsao
78a865eb0b
Replace boltdb imports with bbolt import ( #5193 )
...
* Replaced. Debugging missing strict dependencies...
* Merge branch 'master' into bbolt-import
* Update import path
* Merge branch 'bbolt-import' of github.com:prysmaticlabs/prysm into bbolt-import
* use forked prombbolt
* Merge branch 'bbolt-import' of github.com:prysmaticlabs/prysm into bbolt-import
* fix
* remove old boltdb reference
* Use correct bolt for pk manager
* Merge branch 'bbolt-import' of github.com:prysmaticlabs/prysm into bbolt-import
* fix for docker build
* gaz, oops
2020-03-24 20:00:54 +00:00
Raul Jordan
8d3fc1ad3e
Add in Slasher Metrics ( #5060 )
...
* added in slasher metrics
* Merge branch 'master' into slasher-metrics
* add in prom bolt metrics for slasher
* Merge branch 'slasher-metrics' of github.com:prysmaticlabs/prysm into slasher-metrics
* imports
* include all metrics
* no dup bolt collector
* Update slasher/detection/attestations/spanner.go
Co-Authored-By: Ivan Martinez <ivanthegreatdev@gmail.com>
* naming best practices for prom, thx Terence
* Merge branch 'slasher-metrics' of github.com:prysmaticlabs/prysm into slasher-metrics
2020-03-10 19:41:55 +00:00
shayzluf
01cb01a8f2
On eviction test fix ( #5046 )
2020-03-09 01:35:39 -04:00
Ivan Martinez
d4cd51f23e
Change slasher cache to LRU cache ( #5037 )
...
* Change cache to LRU cache
* fixes
* REduce db usage
* Fix function name
* Merge issues
* Save on eviction
* Fixes
* Fix
Co-authored-by: terence tsao <terence@prysmaticlabs.com>
2020-03-08 17:11:59 -04:00
Raul Jordan
66991f0efe
Spanner db ( #4997 )
...
* rem slasher proto
* with cache
* delete old code
* moving to bytes.go fix traces
* moving to bytes.go fix traces
* raul feedback
* raul feedback
* add eviction test
* ivan feedback
* ivan feedback
* some comment improvements
* test included for bytes and bool
* import
* cleanup
* tests pass
* fill in all fields in test
* gaz
Co-authored-by: Raul Jordan <raul@prysmaticlabs.com>
2020-03-04 23:35:14 -06:00
Raul Jordan
14b3181e67
Plug-In Attester Slashing Detection Into Slasher Runtime ( #4937 )
...
* more spanner additions
* implement iface
* begin implement
* wrapped up spanner functions
* rem interface
* added in necessary comments
* comments on enums
* begin adding tests
* plug in surround vote detection
* saved indexed db implementation
* finally plugin slashing for historical data
* Small fixes
* add in all gazelle
* save incoming new functions
* resolve todo
* fix broken test channel item
* tests passing when fixing certain arguments and setups
* Add comment and change unimplemented
* find surround
* added in gazelle
* gazz
* feedback from shay
* fixed up naming
* Update
* Add tests for detectSurroundVotes
* Remove logs
* Fix slasher test
* formatting
* Remove unneeded condition
* Test indices better
* fixing broken build
* pass tests
* skip tests
* imports
* Update slasher/detection/attestations/attestations_test.go
* Update slasher/beaconclient/historical_data_retrieval_test.go
* Address comments
* Rename function
* Add comment for future optimization
* Fix comment
Co-authored-by: Ivan Martinez <ivanthegreatdev@gmail.com>
2020-02-27 12:22:39 -05:00
Raul Jordan
d143187b7e
Request All Indexed Attestations Since Genesis in Slasher on Startup ( #4894 )
...
* include fixes
* rev
* logrus
* tests for query sync status and chain head
* begin tests for indexed atts
* test passing for requesting historical atts
* Update slasher/beaconclient/chain_data_test.go
* Update slasher/beaconclient/historical_data_retrieval.go
* lint
* fixed up wanted vs receied
* fix mock
* gazelle
* fix broken build
* tests pass
* dep
* gaz
* add dep
* tests pass
Co-authored-by: prylabs-bulldozer[bot] <58059840+prylabs-bulldozer[bot]@users.noreply.github.com>
2020-02-19 16:26:14 -06:00
Ivan Martinez
c44a30672e
Change slasher DB structure to mirror beacon-chains ( #4848 )
...
* Add interface and move slashing types to /types package
* WIP restructure to match beacon chain DB
* Fix build
* Fix comment
* Fix comments
* fix comments for sure
* Use wrapper function for evict
* Remove unused
* Update slasher/db/kv/kv.go
* Update slasher/db/testing/BUILD.bazel
* Update slasher/db/types/BUILD.bazel
* Update slasher/db/types/types.go
Co-authored-by: Raul Jordan <raul@prysmaticlabs.com>
2020-02-13 10:19:46 -06:00
