mirror of
https://github.com/status-im/nimbus-eth2.git
synced 2025-01-09 22:06:21 +00:00
03005f48e1
In the ChainDAG, 3 block pointers are kept: genesis, tail and head. This PR adds one more block pointer: the backfill block which represents the block that has been backfilled so far. When doing a checkpoint sync, a random block is given as starting point - this is the tail block, and we require that the tail block has a corresponding state. When backfilling, we end up with blocks without corresponding states, hence we cannot use `tail` as a backfill pointer - there is no state. Nonetheless, we need to keep track of where we are in the backfill process between restarts, such that we can answer GetBeaconBlocksByRange requests. This PR adds the basic support for backfill handling - it needs to be integrated with backfill sync, and the REST API needs to be adjusted to take advantage of the new backfilled blocks when responding to certain requests. Future work will also enable moving the tail in either direction: * pruning means moving the tail forward in time and removing states * backwards means recreating past states from genesis, such that intermediate states are recreated step by step all the way to the tail - at that point, tail, genesis and backfill will match up. * backfilling is done when backfill != genesis - later, this will be the WSS checkpoint instead
24 KiB
24 KiB
AllTests-mainnet
+ Slashing test: duplicate_pubkey_not_slashable.json OK
+ Slashing test: multiple_interchanges_single_validator_single_message_gap.json OK
+ Slashing test: multiple_interchanges_single_validator_single_message_out_of_order.json OK
+ Slashing test: multiple_validators_multiple_blocks_and_attestations.json OK
+ Slashing test: multiple_validators_same_slot_blocks.json OK
+ Slashing test: single_validator_genesis_attestation.json OK
+ Slashing test: single_validator_import_only.json OK
+ Slashing test: single_validator_multiple_block_attempts.json OK
+ Slashing test: single_validator_multiple_blocks_and_attestations.json OK
+ Slashing test: single_validator_out_of_order_attestations.json OK
+ Slashing test: single_validator_out_of_order_blocks.json OK
+ Slashing test: single_validator_resign_attestation.json OK
+ Slashing test: single_validator_resign_block.json OK
+ Slashing test: single_validator_single_attestation.json OK
+ Slashing test: single_validator_single_block.json OK
+ Slashing test: single_validator_single_block_and_attestation.json OK
+ Slashing test: single_validator_single_block_and_attestation_signing_root.json OK
+ Slashing test: single_validator_slashable_attestations_double_vote.json OK
+ Slashing test: single_validator_slashable_attestations_surrounded_by_existing.json OK
+ Slashing test: single_validator_slashable_attestations_surrounds_existing.json OK
+ Slashing test: single_validator_slashable_blocks.json OK
+ Slashing test: single_validator_slashable_blocks_no_root.json OK
+ Slashing test: single_validator_source_greater_than_target.json OK
+ Slashing test: single_validator_two_blocks_no_signing_root.json OK
+ Slashing test: wrong_genesis_validators_root.json OK
OK: 25/25 Fail: 0/25 Skip: 0/25
Attestation pool processing [Preset: mainnet]
+ Attestations may arrive in any order [Preset: mainnet] OK
+ Attestations may overlap, bigger first [Preset: mainnet] OK
+ Attestations may overlap, smaller first [Preset: mainnet] OK
+ Attestations should be combined [Preset: mainnet] OK
+ Can add and retrieve simple attestations [Preset: mainnet] OK
+ Everyone voting for something different [Preset: mainnet] OK
+ Fork choice returns block with attestation OK
+ Fork choice returns latest block with no attestations OK
+ Trying to add a block twice tags the second as an error OK
+ Trying to add a duplicate block from an old pruned epoch is tagged as an error OK
+ Working with aggregates [Preset: mainnet] OK
OK: 11/11 Fail: 0/11 Skip: 0/11
Backfill
+ backfill to genesis OK
+ reload backfill position OK
OK: 2/2 Fail: 0/2 Skip: 0/2
Beacon chain DB [Preset: mainnet]
+ empty database [Preset: mainnet] OK
+ find ancestors [Preset: mainnet] OK
+ sanity check Altair and cross-fork getState rollback [Preset: mainnet] OK
+ sanity check Altair blocks [Preset: mainnet] OK
+ sanity check Altair states [Preset: mainnet] OK
+ sanity check Altair states, reusing buffers [Preset: mainnet] OK
+ sanity check Merge and cross-fork getState rollback [Preset: mainnet] OK
+ sanity check Merge blocks [Preset: mainnet] OK
+ sanity check Merge states [Preset: mainnet] OK
+ sanity check Merge states, reusing buffers [Preset: mainnet] OK
+ sanity check genesis roundtrip [Preset: mainnet] OK
+ sanity check phase 0 blocks [Preset: mainnet] OK
+ sanity check phase 0 getState rollback [Preset: mainnet] OK
+ sanity check phase 0 states [Preset: mainnet] OK
+ sanity check phase 0 states, reusing buffers [Preset: mainnet] OK
+ sanity check state diff roundtrip [Preset: mainnet] OK
OK: 16/16 Fail: 0/16 Skip: 0/16
Beacon state [Preset: mainnet]
+ Smoke test initialize_beacon_state_from_eth1 [Preset: mainnet] OK
+ get_beacon_proposer_index OK
+ latest_block_root OK
OK: 3/3 Fail: 0/3 Skip: 0/3
Block pool altair processing [Preset: mainnet]
+ Invalid signatures [Preset: mainnet] OK
OK: 1/1 Fail: 0/1 Skip: 0/1
Block pool processing [Preset: mainnet]
+ Simple block add&get [Preset: mainnet] OK
+ getRef returns nil for missing blocks OK
+ loading tail block works [Preset: mainnet] OK
+ updateHead updates head and headState [Preset: mainnet] OK
+ updateStateData sanity [Preset: mainnet] OK
OK: 5/5 Fail: 0/5 Skip: 0/5
Block processor [Preset: mainnet]
+ Reverse order block add & get [Preset: mainnet] OK
OK: 1/1 Fail: 0/1 Skip: 0/1
BlockId and helpers
+ atSlot sanity OK
+ parent sanity OK
OK: 2/2 Fail: 0/2 Skip: 0/2
BlockRef and helpers
+ get_ancestor sanity OK
+ isAncestorOf sanity OK
OK: 2/2 Fail: 0/2 Skip: 0/2
BlockSlot and helpers
+ atSlot sanity OK
+ parent sanity OK
OK: 2/2 Fail: 0/2 Skip: 0/2
ChainDAG helpers
+ epochAncestor sanity [Preset: mainnet] OK
OK: 1/1 Fail: 0/1 Skip: 0/1
Diverging hardforks
+ Non-tail block in common OK
+ Tail block only in common OK
OK: 2/2 Fail: 0/2 Skip: 0/2
Eth1 monitor
+ Rewrite HTTPS Infura URLs OK
OK: 1/1 Fail: 0/1 Skip: 0/1
Eth2 specific discovery tests
+ Invalid attnets field OK
+ Subnet query OK
+ Subnet query after ENR update OK
OK: 3/3 Fail: 0/3 Skip: 0/3
Ethereum Foundation - SSZ generic types
Testing basic_vector inputs - invalid Skip
+ Testing basic_vector inputs - valid OK
+ Testing bitlist inputs - invalid OK
+ Testing bitlist inputs - valid OK
Testing bitvector inputs - invalid Skip
+ Testing bitvector inputs - valid OK
+ Testing boolean inputs - invalid OK
+ Testing boolean inputs - valid OK
+ Testing containers inputs - invalid - skipping BitsStruct OK
+ Testing containers inputs - valid - skipping BitsStruct OK
+ Testing uints inputs - invalid OK
+ Testing uints inputs - valid OK
OK: 10/12 Fail: 0/12 Skip: 2/12
Exit pool testing suite
+ addExitMessage/getAttesterSlashingMessage OK
+ addExitMessage/getProposerSlashingMessage OK
+ addExitMessage/getVoluntaryExitMessage OK
OK: 3/3 Fail: 0/3 Skip: 0/3
Fork Choice + Finality [Preset: mainnet]
+ fork_choice - testing finality #01 OK
+ fork_choice - testing finality #02 OK
+ fork_choice - testing no votes OK
+ fork_choice - testing with votes OK
OK: 4/4 Fail: 0/4 Skip: 0/4
Fork id compatibility test
+ Digest check OK
+ Fork check OK
+ Next fork epoch check OK
OK: 3/3 Fail: 0/3 Skip: 0/3
Forked SSZ readers
+ load altair block OK
+ load altair state OK
+ load merge block OK
+ load merge state OK
+ load phase0 block OK
+ load phase0 state OK
+ should raise on unknown data OK
OK: 7/7 Fail: 0/7 Skip: 0/7
Gossip validation [Preset: mainnet]
+ Any committee index is valid OK
+ validateAttestation OK
OK: 2/2 Fail: 0/2 Skip: 0/2
Gossip validation - Extra
+ validateSyncCommitteeMessage OK
OK: 1/1 Fail: 0/1 Skip: 0/1
Honest validator
+ General pubsub topics OK
+ Mainnet attestation topics OK
+ is_aggregator OK
OK: 3/3 Fail: 0/3 Skip: 0/3
Interop
+ Interop genesis OK
+ Interop signatures OK
+ Mocked start private key OK
OK: 3/3 Fail: 0/3 Skip: 0/3
KeyStorage testing suite
+ Pbkdf2 errors OK
+ [PBKDF2] Keystore decryption OK
+ [PBKDF2] Keystore encryption OK
+ [PBKDF2] Network Keystore decryption OK
+ [PBKDF2] Network Keystore encryption OK
+ [SCRYPT] Keystore decryption OK
+ [SCRYPT] Keystore encryption OK
+ [SCRYPT] Network Keystore decryption OK
+ [SCRYPT] Network Keystore encryption OK
OK: 9/9 Fail: 0/9 Skip: 0/9
Message signatures
+ Aggregate and proof signatures OK
+ Attestation signatures OK
+ Deposit signatures OK
+ Slot signatures OK
+ Sync committee message signatures OK
+ Sync committee selection proof signatures OK
+ Sync committee signed contribution and proof signatures OK
+ Voluntary exit signatures OK
OK: 8/8 Fail: 0/8 Skip: 0/8
Old database versions [Preset: mainnet]
+ pre-1.1.0 OK
OK: 1/1 Fail: 0/1 Skip: 0/1
PeerPool testing suite
+ Access peers by key test OK
+ Acquire from empty pool OK
+ Acquire/Sorting and consistency test OK
+ Delete peer on release text OK
+ Iterators test OK
+ Peer lifetime test OK
+ Safe/Clear test OK
+ Score check test OK
+ Space tests OK
+ addPeer() test OK
+ addPeerNoWait() test OK
+ deletePeer() test OK
OK: 12/12 Fail: 0/12 Skip: 0/12
Slashing Protection DB - Interchange [Preset: mainnet]
+ Smoke test - Complete format - Invalid database is refused [Preset: mainnet] OK
+ Smoke test - Complete format [Preset: mainnet] OK
OK: 2/2 Fail: 0/2 Skip: 0/2
Slashing Protection DB - v1 and v2 migration [Preset: mainnet]
+ Minimal format migration [Preset: mainnet] OK
OK: 1/1 Fail: 0/1 Skip: 0/1
Slashing Protection DB [Preset: mainnet]
+ Attestation ordering #1698 OK
+ Don't prune the very last attestation(s) even by mistake OK
+ Don't prune the very last block even by mistake OK
+ Empty database [Preset: mainnet] OK
+ Pruning attestations works OK
+ Pruning blocks works OK
+ SP for block proposal - backtracking append OK
+ SP for block proposal - linear append OK
+ SP for same epoch attestation target - linear append OK
+ SP for surrounded attestations OK
+ SP for surrounding attestations OK
+ Test valid attestation #1699 OK
OK: 12/12 Fail: 0/12 Skip: 0/12
Spec datatypes
+ Graffiti bytes OK
OK: 1/1 Fail: 0/1 Skip: 0/1
Spec helpers
+ build_proof - BeaconState OK
+ get_branch_indices OK
+ get_helper_indices OK
+ get_path_indices OK
+ integer_squareroot OK
+ is_valid_merkle_branch OK
+ verify_merkle_multiproof OK
OK: 7/7 Fail: 0/7 Skip: 0/7
Specific field types
+ root update OK
+ roundtrip OK
OK: 2/2 Fail: 0/2 Skip: 0/2
Sync committee pool
+ Aggregating votes OK
+ An empty pool is safe to prune OK
+ An empty pool is safe to prune 2 OK
+ An empty pool is safe to use OK
OK: 4/4 Fail: 0/4 Skip: 0/4
SyncManager test suite
+ [SyncQueue#Backward] Async unordered push test OK
+ [SyncQueue#Backward] Async unordered push with rewind test OK
+ [SyncQueue#Backward] Pass through established limits test OK
+ [SyncQueue#Backward] Smoke test OK
+ [SyncQueue#Backward] Start and finish slots equal OK
+ [SyncQueue#Backward] Two full requests success/fail OK
+ [SyncQueue#Backward] getRewindPoint() test OK
+ [SyncQueue#Forward] Async unordered push test OK
+ [SyncQueue#Forward] Async unordered push with rewind test OK
+ [SyncQueue#Forward] Pass through established limits test OK
+ [SyncQueue#Forward] Smoke test OK
+ [SyncQueue#Forward] Start and finish slots equal OK
+ [SyncQueue#Forward] Two full requests success/fail OK
+ [SyncQueue#Forward] getRewindPoint() test OK
+ [SyncQueue] checkResponse() test OK
+ [SyncQueue] contains() test OK
+ [SyncQueue] getLastNonEmptySlot() test OK
+ [SyncQueue] hasEndGap() test OK
OK: 18/18 Fail: 0/18 Skip: 0/18
Zero signature sanity checks
+ SSZ serialization roundtrip of SignedBeaconBlockHeader OK
+ Zero signatures cannot be loaded into a BLS signature object OK
+ default initialization of signatures OK
OK: 3/3 Fail: 0/3 Skip: 0/3
[Unit - Spec - Block processing] Attestations [Preset: mainnet]
+ Valid attestation OK
+ Valid attestation from previous epoch OK
OK: 2/2 Fail: 0/2 Skip: 0/2
[Unit - Spec - Block processing] Deposits [Preset: mainnet]
+ Deposit at MAX_EFFECTIVE_BALANCE balance (32 ETH) OK
+ Deposit over MAX_EFFECTIVE_BALANCE balance (32 ETH) OK
+ Deposit under MAX_EFFECTIVE_BALANCE balance (32 ETH) OK
+ Invalid deposit at MAX_EFFECTIVE_BALANCE balance (32 ETH) OK
+ Validator top-up OK
OK: 5/5 Fail: 0/5 Skip: 0/5
[Unit - Spec - Epoch processing] Justification and Finalization [Preset: mainnet]
+ Rule I - 234 finalization with enough support OK
+ Rule I - 234 finalization without support OK
+ Rule II - 23 finalization with enough support OK
+ Rule II - 23 finalization without support OK
+ Rule III - 123 finalization with enough support OK
+ Rule III - 123 finalization without support OK
+ Rule IV - 12 finalization with enough support OK
+ Rule IV - 12 finalization without support OK
OK: 8/8 Fail: 0/8 Skip: 0/8
chain DAG finalization tests [Preset: mainnet]
+ init with gaps [Preset: mainnet] OK
+ orphaned epoch block [Preset: mainnet] OK
+ prune heads on finalization [Preset: mainnet] OK
OK: 3/3 Fail: 0/3 Skip: 0/3
eth2.0-deposits-cli compatibility
+ restoring mnemonic with password OK
+ restoring mnemonic without password OK
OK: 2/2 Fail: 0/2 Skip: 0/2
state diff tests [Preset: mainnet]
+ random slot differences [Preset: mainnet] OK
OK: 1/1 Fail: 0/1 Skip: 0/1
subnet tracker
+ should register stability subnets on attester duties OK
OK: 1/1 Fail: 0/1 Skip: 0/1
---TOTAL--- OK: 215/217 Fail: 0/217 Skip: 2/217