status-im
/
nimbus-eth2
mirror of https://github.com/status-im/nimbus-eth2.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
nimbus-eth2/beacon_chain/gossip_processing/README.md

35 lines
2.1 KiB
Markdown
Raw Normal View History

Reorg (5/5) (#2377) * Reorg things left into networking and gossip_processing * time -> beacon_clock * fix builds
2021-03-05 13:12:00 +00:00
# Gossip Processing
update gossip_processing and attestation docs (#2860) The README file explaining gossip_processing, and the attestation_flow docs were no longer accurate, as attestations and aggregates no longer go through a queue (pending batching). This patch updates the docs accordingly. It also improves some grammar and fixes some typos.
2021-09-27 13:11:10 +00:00
This folder holds a collection of modules to:
Reorg (5/5) (#2377) * Reorg things left into networking and gossip_processing * time -> beacon_clock * fix builds
2021-03-05 13:12:00 +00:00
- validate raw gossip data before
update gossip_processing and attestation docs (#2860) The README file explaining gossip_processing, and the attestation_flow docs were no longer accurate, as attestations and aggregates no longer go through a queue (pending batching). This patch updates the docs accordingly. It also improves some grammar and fixes some typos.
2021-09-27 13:11:10 +00:00
- rebroadcasting it (potentially aggregated)
- sending it to one of the consensus object pools
Reorg (5/5) (#2377) * Reorg things left into networking and gossip_processing * time -> beacon_clock * fix builds
2021-03-05 13:12:00 +00:00
## Validation
update gossip_processing and attestation docs (#2860) The README file explaining gossip_processing, and the attestation_flow docs were no longer accurate, as attestations and aggregates no longer go through a queue (pending batching). This patch updates the docs accordingly. It also improves some grammar and fixes some typos.
2021-09-27 13:11:10 +00:00
Gossip validation is different from consensus verification in particular for blocks.
Reorg (5/5) (#2377) * Reorg things left into networking and gossip_processing * time -> beacon_clock * fix builds
2021-03-05 13:12:00 +00:00
spec URL & copyright year update (#3338)
2022-01-29 01:05:39 +00:00
- Blocks: https://github.com/ethereum/consensus-specs/blob/v1.1.9/specs/phase0/p2p-interface.md#beacon_block
- Attestations (aggregated): https://github.com/ethereum/consensus-specs/blob/v1.1.9/specs/phase0/p2p-interface.md#beacon_aggregate_and_proof
- Attestations (unaggregated): https://github.com/ethereum/consensus-specs/blob/v1.1.9/specs/phase0/p2p-interface.md#attestation-subnets
- Voluntary exits: https://github.com/ethereum/consensus-specs/blob/v1.1.9/specs/phase0/p2p-interface.md#voluntary_exit
- Proposer slashings: https://github.com/ethereum/consensus-specs/blob/v1.1.9/specs/phase0/p2p-interface.md#proposer_slashing
- Attester slashing: https://github.com/ethereum/consensus-specs/blob/v1.1.9/specs/phase0/p2p-interface.md#attester_slashing
Reorg (5/5) (#2377) * Reorg things left into networking and gossip_processing * time -> beacon_clock * fix builds
2021-03-05 13:12:00 +00:00
update gossip_processing and attestation docs (#2860) The README file explaining gossip_processing, and the attestation_flow docs were no longer accurate, as attestations and aggregates no longer go through a queue (pending batching). This patch updates the docs accordingly. It also improves some grammar and fixes some typos.
2021-09-27 13:11:10 +00:00
There are multiple consumers of validated consensus objects:
Reorg (5/5) (#2377) * Reorg things left into networking and gossip_processing * time -> beacon_clock * fix builds
2021-03-05 13:12:00 +00:00
- a `ValidationResult.Accept` output triggers rebroadcasting in libp2p
update gossip_processing and attestation docs (#2860) The README file explaining gossip_processing, and the attestation_flow docs were no longer accurate, as attestations and aggregates no longer go through a queue (pending batching). This patch updates the docs accordingly. It also improves some grammar and fixes some typos.
2021-09-27 13:11:10 +00:00
- We jump into method `validate(PubSub, Message)` in libp2p/protocols/pubsub/pubsub.nim
Reorg (5/5) (#2377) * Reorg things left into networking and gossip_processing * time -> beacon_clock * fix builds
2021-03-05 13:12:00 +00:00
- which was called by `rpcHandler(GossipSub, PubSubPeer, RPCMsg)`
move quarantine outside of chaindag (#3124) * move quarantine outside of chaindag The quarantine has been part of the ChainDAG for the longest time, but this design has a few issues: * the function in which blocks are verified and added to the dag becomes reentrant and therefore difficult to reason about - we're currently using a stateful flag to work around it * quarantined blocks bypass the processing queue leading to a processing stampede * the quarantine flow is unsuitable for orphaned attestations - these should also should be quarantined eventually Instead of processing the quarantine inside ChainDAG, this PR moves re-queueing to `block_processor` which already is responsible for dealing with follow-up work when a block is added to the dag This sets the stage for keeping attestations in the quarantine as well. Also: * make `BlockError` `{.pure.}` * avoid use of `ValidationResult` in block clearance (that's for gossip)
2021-12-06 09:49:01 +00:00
- a `blockValidator` message enqueues the validated object to the processing queue in `block_processor`
- `blockQueue: AsyncQueue[BlockEntry]` (shared with request_manager and sync_manager)
update gossip_processing and attestation docs (#2860) The README file explaining gossip_processing, and the attestation_flow docs were no longer accurate, as attestations and aggregates no longer go through a queue (pending batching). This patch updates the docs accordingly. It also improves some grammar and fixes some typos.
2021-09-27 13:11:10 +00:00
- This queue is then regularly processed to be made available to the consensus object pools.
- a `xyzValidator` message adds the validated object to a pool in eth2_processor
- Attestations (unaggregated and aggregated) get collected into batches.
- Once a threshold is exceeded or after a timeout, they get validated together using BatchCrypto.
Reorg (5/5) (#2377) * Reorg things left into networking and gossip_processing * time -> beacon_clock * fix builds
2021-03-05 13:12:00 +00:00
## Security concerns
update gossip_processing and attestation docs (#2860) The README file explaining gossip_processing, and the attestation_flow docs were no longer accurate, as attestations and aggregates no longer go through a queue (pending batching). This patch updates the docs accordingly. It also improves some grammar and fixes some typos.
2021-09-27 13:11:10 +00:00
As the first line of defense in Nimbus, modules must be able to handle bursts of data that may come:
Reorg (5/5) (#2377) * Reorg things left into networking and gossip_processing * time -> beacon_clock * fix builds
2021-03-05 13:12:00 +00:00
- from malicious nodes trying to DOS us
update gossip_processing and attestation docs (#2860) The README file explaining gossip_processing, and the attestation_flow docs were no longer accurate, as attestations and aggregates no longer go through a queue (pending batching). This patch updates the docs accordingly. It also improves some grammar and fixes some typos.
2021-09-27 13:11:10 +00:00
- from long periods of non-finality, creating lots of forks, attestations