mirror/prysm-pulse
1
0
Fork 0
mirror of https://gitlab.com/pulsechaincom/prysm-pulse.git synced 2024-12-25 12:57:18 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
9a0fb5dca1
prysm-pulse/beacon-chain/db/db.go

96 lines
5.5 KiB
Go
Raw Normal View History

Refactor to Create DB Package (#582)
2018-10-05 17:14:50 +00:00
package db
import (
Define New DB Interface (#3163) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method
2019-08-09 19:17:18 +00:00
"context"
Create a testing db method that can be used with the new database interface (#3217) * create a testing db method that can be used with the new database interface * lint * lint * PR feedback * Update setup_db.go
2019-08-15 21:41:51 +00:00
"io"
Implement Attestation Participants Helper Function (#1111)
2018-12-17 18:34:28 +00:00
Add Deposit Contract Methods to DB Refactor (#3264) * new interface methods * support proposer slashings * add in the new buckets * all crud for propoer slashings * attester slashings complete * all slashings crud done * right comment * deposit contract tests pass * delete out of scope methods * conform old beacon DB * comment * deprecations * pass lint * Update deposit_contract.go
2019-08-21 21:11:50 +00:00
"github.com/ethereum/go-ethereum/common"
Define Interface Stubs for New DB Interface (#3164) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method * new kv store initialization * comments * gaz * implement interface * refactor for proper naming conventions * add todos * proper comments * rem unused
2019-08-11 00:50:10 +00:00
"github.com/prysmaticlabs/prysm/beacon-chain/db/filters"
Deprecate the old, and add new DB setup util for tests (#3208)
2019-08-14 18:48:28 +00:00
"github.com/prysmaticlabs/prysm/beacon-chain/db/kv"
Define New DB Interface (#3163) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method
2019-08-09 19:17:18 +00:00
pb "github.com/prysmaticlabs/prysm/proto/beacon/p2p/v1"
ethpb "github.com/prysmaticlabs/prysm/proto/eth/v1alpha1"
Refactor to Create DB Package (#582)
2018-10-05 17:14:50 +00:00
)
Define New DB Interface (#3163) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method
2019-08-09 19:17:18 +00:00
// Database defines the necessary methods for Prysm's eth2 backend which may
// be implemented by any key-value or relational database in practice.
type Database interface {
Create a testing db method that can be used with the new database interface (#3217) * create a testing db method that can be used with the new database interface * lint * lint * PR feedback * Update setup_db.go
2019-08-15 21:41:51 +00:00
io.Closer
DatabasePath() string
Define New DB Interface (#3163) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method
2019-08-09 19:17:18 +00:00
ClearDB() error
Add database API for creating backups (#3694) * Save db backup * Fix DB backup method * Add backup db webhook * gaz * if err != nil * more verbose filename * Don't obliterate everything :)
2019-10-03 09:29:49 +00:00
// Backup and restore methods
Backup(ctx context.Context) error
Block Slashings CRUD Methods DB Refactor (#3261) * new interface methods * support proposer slashings * add in the new buckets * all crud for propoer slashings * attester slashings complete * all slashings crud done * right comment * delete out of scope methods * conform old beacon DB
2019-08-21 20:21:04 +00:00
// Attestation related methods.
Better aggregated attestations pool (#3761) * WIP of aggregated signatures in DB * new lines at end * taking a nap on the plane now * fix tests * remove duplication of attestations. so much for that airplane nap lol * benchmark before flight lands * gaz * manual gaz * fully contained checks * quick improvement before landing * new bitlist with fixes * doesn't need real signatures * it works, mostly * print shard too * some refactoring * Revert "some refactoring" This reverts commit 377ce7fbfb02321c20522da2eb27208a20a67669. * Revert "Revert "some refactoring"" This reverts commit b46a458898acd214da44fc20dfae920d2725b6e8. These changes are ok, just need to update the expected values * fix tests * lint * lint * upstream changes * fix tests * what * resolve TODOs * gofmt * revert unrelated pb * remove debug statement
2019-10-17 06:46:07 +00:00
AttestationsByDataRoot(ctx context.Context, attDataRoot [32]byte) ([]*ethpb.Attestation, error)
Define Interface Stubs for New DB Interface (#3164) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method * new kv store initialization * comments * gaz * implement interface * refactor for proper naming conventions * add todos * proper comments * rem unused
2019-08-11 00:50:10 +00:00
Attestations(ctx context.Context, f *filters.QueryFilter) ([]*ethpb.Attestation, error)
Batch Deletions for Blocks and Attestations (#3496) * batch deletions for blocks and attestations * test for atts delete * test for blocks delete * better naming of args in iface methods * modify a bit * convert to batch * blocks batch delete * batch fixes * suspecting deadlock * blocks batch delete tests pass * more complex test
2019-09-27 16:11:10 +00:00
HasAttestation(ctx context.Context, attDataRoot [32]byte) bool
DeleteAttestation(ctx context.Context, attDataRoot [32]byte) error
DeleteAttestations(ctx context.Context, attDataRoots [][32]byte) error
Define New DB Interface (#3163) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method
2019-08-09 19:17:18 +00:00
SaveAttestation(ctx context.Context, att *ethpb.Attestation) error
SaveAttestations(ctx context.Context, atts []*ethpb.Attestation) error
Block Slashings CRUD Methods DB Refactor (#3261) * new interface methods * support proposer slashings * add in the new buckets * all crud for propoer slashings * attester slashings complete * all slashings crud done * right comment * delete out of scope methods * conform old beacon DB
2019-08-21 20:21:04 +00:00
// Block related methods.
Define New DB Interface (#3163) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method
2019-08-09 19:17:18 +00:00
Block(ctx context.Context, blockRoot [32]byte) (*ethpb.BeaconBlock, error)
Save head block root for new DB refactor (#3182) * Save head block root instead of save head state * Revert state
2019-08-12 16:13:30 +00:00
HeadBlock(ctx context.Context) (*ethpb.BeaconBlock, error)
Define Interface Stubs for New DB Interface (#3164) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method * new kv store initialization * comments * gaz * implement interface * refactor for proper naming conventions * add todos * proper comments * rem unused
2019-08-11 00:50:10 +00:00
Blocks(ctx context.Context, f *filters.QueryFilter) ([]*ethpb.BeaconBlock, error)
Delete DB states older than finalized checkpoint (#3824)
2019-10-23 15:30:21 +00:00
BlockRoots(ctx context.Context, f *filters.QueryFilter) ([][32]byte, error)
Define New DB Interface (#3163) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method
2019-08-09 19:17:18 +00:00
HasBlock(ctx context.Context, blockRoot [32]byte) bool
DeleteBlock(ctx context.Context, blockRoot [32]byte) error
Batch Deletions for Blocks and Attestations (#3496) * batch deletions for blocks and attestations * test for atts delete * test for blocks delete * better naming of args in iface methods * modify a bit * convert to batch * blocks batch delete * batch fixes * suspecting deadlock * blocks batch delete tests pass * more complex test
2019-09-27 16:11:10 +00:00
DeleteBlocks(ctx context.Context, blockRoots [][32]byte) error
Define New DB Interface (#3163) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method
2019-08-09 19:17:18 +00:00
SaveBlock(ctx context.Context, block *ethpb.BeaconBlock) error
SaveBlocks(ctx context.Context, blocks []*ethpb.BeaconBlock) error
Save head block root for new DB refactor (#3182) * Save head block root instead of save head state * Revert state
2019-08-12 16:13:30 +00:00
SaveHeadBlockRoot(ctx context.Context, blockRoot [32]byte) error
Save genesis state in DB (#3359) * Done * Test * Fixed test * emit state initialized
2019-08-29 22:32:35 +00:00
SaveGenesisBlockRoot(ctx context.Context, blockRoot [32]byte) error
Block Slashings CRUD Methods DB Refactor (#3261) * new interface methods * support proposer slashings * add in the new buckets * all crud for propoer slashings * attester slashings complete * all slashings crud done * right comment * delete out of scope methods * conform old beacon DB
2019-08-21 20:21:04 +00:00
// Validator related methods.
Define New DB Interface (#3163) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method
2019-08-09 19:17:18 +00:00
ValidatorLatestVote(ctx context.Context, validatorIdx uint64) (*pb.ValidatorLatestVote, error)
HasValidatorLatestVote(ctx context.Context, validatorIdx uint64) bool
Basic Block/LatestVote Caching in DB Refactor (#3249) * add block caching layer * runlock * lockinggg * latest votes map * validator latest vote deletion method added to interface * seguin cache working * cache size * impl interface * initialize caches at struct layer
2019-08-22 15:04:13 +00:00
DeleteValidatorLatestVote(ctx context.Context, validatorIdx uint64) error
Define Interface Stubs for New DB Interface (#3164) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method * new kv store initialization * comments * gaz * implement interface * refactor for proper naming conventions * add todos * proper comments * rem unused
2019-08-11 00:50:10 +00:00
SaveValidatorLatestVote(ctx context.Context, validatorIdx uint64, vote *pb.ValidatorLatestVote) error
Large Prysm Performance Improvements (#3622) * skip bls verification with a feature flag at runtime * gazelle * more bls mocks * block roots efficiency * db block roots now does not show up on the flame graphs * save validator latest votes batch * batch save att * misc improvements to pprof * import * include validator index cache * error if no filter criteria * resolved comments * build fix * lint * remove delay global * attestation and block test fixes * preston suggestions * fix db tests * fix missing broken tests * tests pass
2019-09-30 20:45:53 +00:00
SaveValidatorLatestVotes(ctx context.Context, validatorIndices []uint64, votes []*pb.ValidatorLatestVote) error
Implement Validator DB Methods (#3172) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method * new kv store initialization * comments * gaz * implement interface * refactor for proper naming conventions * add todos * proper comments * rem unused * add schema * implementation simplicity * has validator latest vote func impl * retrieve validator latest vote * has idx * implement missing validator methods * missing validator methods and test helpers * validator index crud tests * validator tests * all buckets * refactor with ok bool * all tests passing, fmt, imports
2019-08-12 19:33:07 +00:00
ValidatorIndex(ctx context.Context, publicKey [48]byte) (uint64, bool, error)
Define New DB Interface (#3163) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method
2019-08-09 19:17:18 +00:00
HasValidatorIndex(ctx context.Context, publicKey [48]byte) bool
DeleteValidatorIndex(ctx context.Context, publicKey [48]byte) error
SaveValidatorIndex(ctx context.Context, publicKey [48]byte, validatorIdx uint64) error
Block Slashings CRUD Methods DB Refactor (#3261) * new interface methods * support proposer slashings * add in the new buckets * all crud for propoer slashings * attester slashings complete * all slashings crud done * right comment * delete out of scope methods * conform old beacon DB
2019-08-21 20:21:04 +00:00
// State related methods.
State(ctx context.Context, blockRoot [32]byte) (*pb.BeaconState, error)
HeadState(ctx context.Context) (*pb.BeaconState, error)
Save genesis state in DB (#3359) * Done * Test * Fixed test * emit state initialized
2019-08-29 22:32:35 +00:00
GenesisState(ctx context.Context) (*pb.BeaconState, error)
Block Slashings CRUD Methods DB Refactor (#3261) * new interface methods * support proposer slashings * add in the new buckets * all crud for propoer slashings * attester slashings complete * all slashings crud done * right comment * delete out of scope methods * conform old beacon DB
2019-08-21 20:21:04 +00:00
SaveState(ctx context.Context, state *pb.BeaconState, blockRoot [32]byte) error
Add State Batch Delete for DB (#3820)
2019-10-22 18:13:41 +00:00
DeleteState(ctx context.Context, blockRoot [32]byte) error
DeleteStates(ctx context.Context, blockRoots [][32]byte) error
Block Slashings CRUD Methods DB Refactor (#3261) * new interface methods * support proposer slashings * add in the new buckets * all crud for propoer slashings * attester slashings complete * all slashings crud done * right comment * delete out of scope methods * conform old beacon DB
2019-08-21 20:21:04 +00:00
// Slashing operations.
ProposerSlashing(ctx context.Context, slashingRoot [32]byte) (*ethpb.ProposerSlashing, error)
AttesterSlashing(ctx context.Context, slashingRoot [32]byte) (*ethpb.AttesterSlashing, error)
SaveProposerSlashing(ctx context.Context, slashing *ethpb.ProposerSlashing) error
SaveAttesterSlashing(ctx context.Context, slashing *ethpb.AttesterSlashing) error
HasProposerSlashing(ctx context.Context, slashingRoot [32]byte) bool
HasAttesterSlashing(ctx context.Context, slashingRoot [32]byte) bool
DeleteProposerSlashing(ctx context.Context, slashingRoot [32]byte) error
DeleteAttesterSlashing(ctx context.Context, slashingRoot [32]byte) error
Include Voluntary Exits Definitions in DB Refactor (#3266) * new interface methods * support proposer slashings * add in the new buckets * all crud for propoer slashings * attester slashings complete * all slashings crud done * right comment * deposit contract tests pass * delete out of scope methods * conform old beacon DB * comment * include interface implementations * deprecations * pass lint
2019-08-21 21:32:44 +00:00
// Block operations.
VoluntaryExit(ctx context.Context, exitRoot [32]byte) (*ethpb.VoluntaryExit, error)
SaveVoluntaryExit(ctx context.Context, exit *ethpb.VoluntaryExit) error
HasVoluntaryExit(ctx context.Context, exitRoot [32]byte) bool
DeleteVoluntaryExit(ctx context.Context, exitRoot [32]byte) error
Refactor fork choice start up (#3360) * Done * Test * Fixed test * emit state initialized * Fixed existing tests * Lint * Lint
2019-08-30 13:58:02 +00:00
// Checkpoint operations.
JustifiedCheckpoint(ctx context.Context) (*ethpb.Checkpoint, error)
FinalizedCheckpoint(ctx context.Context) (*ethpb.Checkpoint, error)
SaveJustifiedCheckpoint(ctx context.Context, checkpoint *ethpb.Checkpoint) error
SaveFinalizedCheckpoint(ctx context.Context, checkpoint *ethpb.Checkpoint) error
Archived Data Definitions & DB API (#3510) * generate archive proto * archived committee info * archive methods added to iface definition * impl * update iface * proto comments
2019-09-18 17:05:24 +00:00
// Archival data handlers for storing/retrieving historical beacon node information.
ArchivedActiveValidatorChanges(ctx context.Context, epoch uint64) (*ethpb.ArchivedActiveSetChanges, error)
SaveArchivedActiveValidatorChanges(ctx context.Context, epoch uint64, changes *ethpb.ArchivedActiveSetChanges) error
ArchivedCommitteeInfo(ctx context.Context, epoch uint64) (*ethpb.ArchivedCommitteeInfo, error)
SaveArchivedCommitteeInfo(ctx context.Context, epoch uint64, info *ethpb.ArchivedCommitteeInfo) error
ArchivedBalances(ctx context.Context, epoch uint64) ([]uint64, error)
SaveArchivedBalances(ctx context.Context, epoch uint64, balances []uint64) error
ArchivedValidatorParticipation(ctx context.Context, epoch uint64) (*ethpb.ValidatorParticipation, error)
SaveArchivedValidatorParticipation(ctx context.Context, epoch uint64, part *ethpb.ValidatorParticipation) error
Add Deposit Contract Methods to DB Refactor (#3264) * new interface methods * support proposer slashings * add in the new buckets * all crud for propoer slashings * attester slashings complete * all slashings crud done * right comment * deposit contract tests pass * delete out of scope methods * conform old beacon DB * comment * deprecations * pass lint * Update deposit_contract.go
2019-08-21 21:11:50 +00:00
// Deposit contract related handlers.
DepositContractAddress(ctx context.Context) ([]byte, error)
SaveDepositContractAddress(ctx context.Context, addr common.Address) error
Define New DB Interface (#3163) * begin db interface * define the database interface * interface definition simplifications * include latest message proto * modify pbs * rem kv folder * add filter interface * lint * ctx package is great * interface getting better * ctx everywhere...it's everywhere! * block roots method
2019-08-09 19:17:18 +00:00
}
Deprecate the old, and add new DB setup util for tests (#3208)
2019-08-14 18:48:28 +00:00
// NewDB initializes a new DB.
func NewDB(dirPath string) (Database, error) {
return kv.NewKVStore(dirPath)
}
Reference in New Issue Copy Permalink