nimbus-eth2/beacon_chain/gossip_processing
Etan Kissling fda03548e3
use `ForkedLightClientStore` internally (#4512)
When running `nimbus_light_client`, we persist the latest header from
`LightClientStore.finalized_header` in a database across restarts.
Because the data format is derived from the latest `LightClientStore`,
this could lead to data being persisted in pre-release formats.

To enable us to test later `LightClientStore` versions on devnets,
transition to a `ForkedLightClientStore` internally that is only
migrated to newer forks on-demand (instead of starting at latest).
2023-01-16 16:53:45 +01:00
..
README.md a few consensus spec ref URL updates (#4483) 2023-01-10 16:14:17 +00:00
batch_validation.nim spec: Option -> Opt (#4488) 2023-01-11 12:29:21 +00:00
block_processor.nim Wire up engine_newPayloadV3 (#4482) 2023-01-11 18:21:19 +00:00
eth2_processor.nim make LC data fork aware (#4493) 2023-01-12 18:11:38 +01:00
gossip_validation.nim LC data fork cleanup (#4506) 2023-01-14 22:19:50 +01:00
light_client_processor.nim use `ForkedLightClientStore` internally (#4512) 2023-01-16 16:53:45 +01:00
optimistic_processor.nim rm optimistic candidate block check from LC (#4131) 2022-09-17 00:42:19 +00:00

README.md

Gossip Processing

This folder holds a collection of modules to:

  • validate raw gossip data before
    • rebroadcasting it (potentially aggregated)
    • sending it to one of the consensus object pools

Validation

Gossip validation is different from consensus verification in particular for blocks.

There are multiple consumers of validated consensus objects:

  • a ValidationResult.Accept output triggers rebroadcasting in libp2p
    • We jump into method validate(PubSub, Message) in libp2p/protocols/pubsub/pubsub.nim
    • which was called by rpcHandler(GossipSub, PubSubPeer, RPCMsg)
  • a blockValidator message enqueues the validated object to the processing queue in block_processor
    • blockQueue: AsyncQueue[BlockEntry] (shared with request_manager and sync_manager)
    • This queue is then regularly processed to be made available to the consensus object pools.
  • a xyzValidator message adds the validated object to a pool in eth2_processor
    • Attestations (unaggregated and aggregated) get collected into batches.
    • Once a threshold is exceeded or after a timeout, they get validated together using BatchCrypto.

Security concerns

As the first line of defense in Nimbus, modules must be able to handle bursts of data that may come:

  • from malicious nodes trying to DOS us
  • from long periods of non-finality, creating lots of forks, attestations