nimbus-eth2/beacon_chain/consensus_object_pools
Jacek Sieka ca1775f725
Fetch by-root request directly from quarantine (#5167)
When the requestmanager is busy fetching blocks, the queue might get
filled with multiple entries of the same root - since there is no
deduplication, requests containing the same root multiple times will be
sent out.

Also, because the items sit in the queue for a long time potentially,
the request might be stale by the time that the manager is ready with
the previous request.

This PR removes the queue and directly fetches the blocks to download
from the quarantine which solves both problems (the quarantine already
de-duplicates and is clean of stale information).

Removing the queue for blobs is left for a future PR.

Co-authored-by: tersec <tersec@users.noreply.github.com>
2023-07-11 18:22:02 +02:00
..
vanity_logs update Deneb ANSI art for readability 🐟 (#4885) 2023-05-03 22:25:01 +02:00
README.md update some consensus spec URLs to v1.4.0-beta.0 (#5150) 2023-06-30 16:12:54 +00:00
attestation_pool.nim automated consensus spec URL updating to v1.4.0-beta.0 (#5121) 2023-06-24 15:43:30 +00:00
blob_quarantine.nim Blob accounting fixes/tweaks (#5044) 2023-06-09 10:52:03 +00:00
block_clearance.nim replace `optimisticRoots` table with field in `BlockRef` (#4969) 2023-05-20 12:18:51 +00:00
block_dag.nim early exit `commonAncestor` when comparing with `finalizedHead` (#5174) 2023-07-10 20:36:25 +00:00
block_pools_types.nim make OnFooBlockAdded callback types generic (#5134) 2023-06-28 13:30:49 +00:00
block_pools_types_light_client.nim remove Nim 1.2-compatible `push raise`s and update copyright notice years (#4528) 2023-01-20 14:14:37 +00:00
block_quarantine.nim Fetch by-root request directly from quarantine (#5167) 2023-07-11 18:22:02 +02:00
blockchain_dag.nim residual cleanup from https://github.com/status-im/nimbus-eth2/pull/5152 (#5181) 2023-07-11 14:36:37 +00:00
blockchain_dag_light_client.nim rename `lcDataForkAtStateFork` > `lcDataForkAtConsensusFork` (#4726) 2023-03-11 20:09:21 +00:00
consensus_manager.nim replace `optimisticRoots` table with field in `BlockRef` (#4969) 2023-05-20 12:18:51 +00:00
exit_pool.nim don't clear validator change subpools after creating each block (#4704) 2023-03-09 18:19:36 +02:00
light_client_pool.nim remove Nim 1.2-compatible `push raise`s and update copyright notice years (#4528) 2023-01-20 14:14:37 +00:00
spec_cache.nim update some consensus-specs ref URLs to v1.4.0-beta.0 (#5163) 2023-07-05 16:02:55 +00:00
sync_committee_msg_pool.nim automated consensus spec URL updating to v1.4.0-beta.0 (#5121) 2023-06-24 15:43:30 +00:00

README.md

Consensus object pools

This folder holds the various consensus object pools needed for a blockchain client.

Object in those pools have passed the "gossip validation" filter according to specs:

After "gossip validation" the consensus objects can be rebroadcasted as they are optimistically good, however for internal processing further verification is needed. For blocks, this means verifying state transition and all contained cryptographic signatures (instead of just the proposer signature). For other consensus objects, it is possible that gossip validation is a superset of consensus verification (TODO).

The pools presenet in this folder are:

  • block_pools:
    • block_quarantine: for seemingly valid blocks that are on a fork unknown to us.
    • block_clearance: to verify (state_transition + cryptography) candidate blocks.
    • blockchain_dag: an in-memory direct-acyclic graph of fully validated and verified blockchain candidates with the tail being the last finalized epoch. A block in the DAG MUST be in the fork choice and a block in the fork choice MUST be in the DAG (except for orphans following finalization). On finalization non-empty epoch blocks are stored in the beacon_chain_db.
  • attestation_pool: Handles the attestation received from gossip and collect them for fork choice.
  • exit_pool: Handle voluntary exits and forced exits (attester slashings and proposer slashings)