nimbus-eth2/beacon_chain/consensus_object_pools
Jacek Sieka d839b9d07e
State-only checkpoint state startup (#4251)
Currently, we require genesis and a checkpoint block and state to start
from an arbitrary slot - this PR relaxes this requirement so that we can
start with a state alone.

The current trusted-node-sync algorithm works by first downloading
blocks until we find an epoch aligned non-empty slot, then downloads the
state via slot.

However, current
[proposals](https://github.com/ethereum/beacon-APIs/pull/226) for
checkpointing prefer finalized state as
the main reference - this allows more simple access control and caching
on the server side - in particular, this should help checkpoint-syncing
from sources that have a fast `finalized` state download (like infura
and teku) but are slow when accessing state via slot.

Earlier versions of Nimbus will not be able to read databases created
without a checkpoint block and genesis. In most cases, backfilling makes
the database compatible except where genesis is also missing (custom
networks).

* backfill checkpoint block from libp2p instead of checkpoint source,
when doing trusted node sync
* allow starting the client without genesis / checkpoint block
* perform epoch start slot lookahead when loading tail state, so as to
deal with the case where the epoch start slot does not have a block
* replace `--blockId` with `--state-id` in TNS command line
* when replaying, also look at the parent of the last-known-block (even
if we don't have the parent block data, we can still replay from a
"parent" state) - in particular, this clears the way for implementing
state pruning
* deprecate `--finalized-checkpoint-block` option (no longer needed)
2022-11-02 10:02:38 +00:00
..
vanity_logs compatibility with Nim 1.4+ (#3888) 2022-07-29 10:53:42 +00:00
README.md update consensus spec ref URLs to v1.2.0 (#4164) 2022-09-23 07:56:06 +00:00
attestation_pool.nim avoid packing attestations from other forks (#4273) 2022-11-01 14:23:40 +02:00
block_clearance.nim Allow chain dag without genesis / block (#4230) 2022-10-14 22:40:10 +03:00
block_dag.nim update consensus spec ref URLs to v1.2.0 (#4164) 2022-09-23 07:56:06 +00:00
block_pools_types.nim Allow chain dag without genesis / block (#4230) 2022-10-14 22:40:10 +03:00
block_pools_types_light_client.nim update LC spec references for v1.2.0-rc.2 (#3982) 2022-08-17 19:47:06 +00:00
block_quarantine.nim compatibility with Nim 1.4+ (#3888) 2022-07-29 10:53:42 +00:00
blockchain_dag.nim State-only checkpoint state startup (#4251) 2022-11-02 10:02:38 +00:00
blockchain_dag_light_client.nim switch `withStateAndBlck` usage to `forkyState`; rm unused `tests/mocking/` modules (#4206) 2022-10-03 13:08:50 +00:00
consensus_manager.nim fix false-positive warnings on expected VALID fcU status; adjust log levels (#4242) 2022-10-26 21:14:11 +00:00
exit_pool.nim Harden block proposal against expired slashings/exits (#4013) 2022-08-23 18:30:46 +03:00
light_client_pool.nim update LC spec references for v1.2.0-rc.2 (#3982) 2022-08-17 19:47:06 +00:00
spec_cache.nim remove unused `is_valid_indexed_attestation` (#4248) 2022-10-18 17:02:58 +00:00
sync_committee_msg_pool.nim update consensus spec ref URLs to v1.2.0 (#4164) 2022-09-23 07:56:06 +00:00

README.md

Consensus object pools

This folder holds the various consensus object pools needed for a blockchain client.

Object in those pools have passed the "gossip validation" filter according to specs:

After "gossip validation" the consensus objects can be rebroadcasted as they are optimistically good, however for internal processing further verification is needed. For blocks, this means verifying state transition and all contained cryptographic signatures (instead of just the proposer signature). For other consensus objects, it is possible that gossip validation is a superset of consensus verification (TODO).

The pools presenet in this folder are:

  • block_pools:
    • block_quarantine: for seemingly valid blocks that are on a fork unknown to us.
    • block_clearance: to verify (state_transition + cryptography) candidate blocks.
    • blockchain_dag: an in-memory direct-acyclic graph of fully validated and verified blockchain candidates with the tail being the last finalized epoch. A block in the DAG MUST be in the fork choice and a block in the fork choice MUST be in the DAG (except for orphans following finalization). On finalization non-empty epoch blocks are stored in the beacon_chain_db.
  • attestation_pool: Handles the attestation received from gossip and collect them for fork choice.
  • exit_pool: Handle voluntary exits and forced exits (attester slashings and proposer slashings)