2021-08-18 23:11:38 +00:00
# The Merge -- The Beacon Chain
2021-03-11 12:33:36 +00:00
**Notice**: This document is a work-in-progress for researchers and implementers.
## Table of contents
<!-- TOC -->
<!-- START doctoc generated TOC please keep comment here to allow auto update -->
<!-- DON'T EDIT THIS SECTION, INSTEAD RE - RUN doctoc TO UPDATE -->
- [Introduction ](#introduction )
2021-03-29 18:56:43 +00:00
- [Custom types ](#custom-types )
2021-03-11 12:33:36 +00:00
- [Constants ](#constants )
- [Execution ](#execution )
2021-07-30 10:10:33 +00:00
- [Configuration ](#configuration )
2021-08-10 11:15:07 +00:00
- [Genesis testing settings ](#genesis-testing-settings )
2021-09-17 10:54:06 +00:00
- [Transition settings ](#transition-settings )
2021-03-11 12:33:36 +00:00
- [Containers ](#containers )
- [Extended containers ](#extended-containers )
- [`BeaconBlockBody` ](#beaconblockbody )
- [`BeaconState` ](#beaconstate )
- [New containers ](#new-containers )
2021-04-08 08:29:05 +00:00
- [`ExecutionPayload` ](#executionpayload )
- [`ExecutionPayloadHeader` ](#executionpayloadheader )
2021-03-11 12:33:36 +00:00
- [Helper functions ](#helper-functions )
2021-06-18 10:09:30 +00:00
- [Predicates ](#predicates )
- [`is_merge_complete` ](#is_merge_complete )
- [`is_merge_block` ](#is_merge_block )
2021-05-06 00:21:52 +00:00
- [`is_execution_enabled` ](#is_execution_enabled )
2021-06-18 10:09:30 +00:00
- [Misc ](#misc )
- [`compute_timestamp_at_slot` ](#compute_timestamp_at_slot )
- [Beacon chain state transition function ](#beacon-chain-state-transition-function )
- [Execution engine ](#execution-engine )
2021-09-20 14:57:45 +00:00
- [`execute_payload` ](#execute_payload )
- [`consensus_validated` ](#consensus_validated )
2021-03-11 12:33:36 +00:00
- [Block processing ](#block-processing )
2021-06-18 10:09:30 +00:00
- [Execution payload processing ](#execution-payload-processing )
2021-07-26 14:09:57 +00:00
- [`is_valid_gas_limit` ](#is_valid_gas_limit )
2021-06-18 10:09:30 +00:00
- [`process_execution_payload` ](#process_execution_payload )
- [Testing ](#testing )
2021-03-11 12:33:36 +00:00
<!-- END doctoc generated TOC please keep comment here to allow auto update -->
<!-- /TOC -->
## Introduction
2021-06-18 10:09:30 +00:00
This patch adds transaction execution to the beacon chain as part of the Merge fork.
2021-03-11 12:33:36 +00:00
2021-03-26 19:20:23 +00:00
## Custom types
2021-06-18 10:09:30 +00:00
*Note*: The `Transaction` type is a stub which is not final.
2021-03-26 19:20:23 +00:00
| Name | SSZ equivalent | Description |
| - | - | - |
2021-06-18 10:09:30 +00:00
| `OpaqueTransaction` | `ByteList[MAX_BYTES_PER_OPAQUE_TRANSACTION]` | a [typed transaction envelope ](https://eips.ethereum.org/EIPS/eip-2718#opaque-byte-array-rather-than-an-rlp-array ) structured as `TransactionType \|\| TransactionPayload` |
| `Transaction` | `Union[OpaqueTransaction]` | a transaction |
2021-03-26 19:20:23 +00:00
2021-03-11 12:33:36 +00:00
## Constants
### Execution
| Name | Value |
| - | - |
2021-03-26 19:20:23 +00:00
| `MAX_BYTES_PER_OPAQUE_TRANSACTION` | `uint64(2**20)` (= 1,048,576) |
2021-06-18 10:09:30 +00:00
| `MAX_TRANSACTIONS_PER_PAYLOAD` | `uint64(2**14)` (= 16,384) |
2021-03-24 10:30:29 +00:00
| `BYTES_PER_LOGS_BLOOM` | `uint64(2**8)` (= 256) |
2021-07-30 06:43:54 +00:00
| `GAS_LIMIT_DENOMINATOR` | `uint64(2**10)` (= 1,024) |
2021-07-26 13:30:50 +00:00
| `MIN_GAS_LIMIT` | `uint64(5000)` (= 5,000) |
2021-09-17 12:23:21 +00:00
| `MAX_EXTRA_DATA_BYTES` | `2**5` (= 32) |
2021-03-11 12:33:36 +00:00
2021-07-30 10:10:33 +00:00
## Configuration
2021-08-10 11:15:07 +00:00
### Genesis testing settings
2021-07-30 10:10:33 +00:00
*Note*: These configuration settings do not apply to the mainnet and are utilized only by pure Merge testing.
| Name | Value |
| - | - |
| `GENESIS_GAS_LIMIT` | `uint64(30000000)` (= 30,000,000) |
2021-08-16 12:35:11 +00:00
| `GENESIS_BASE_FEE_PER_GAS` | `Bytes32('0x00ca9a3b00000000000000000000000000000000000000000000000000000000')` (= 1,000,000,000) |
2021-07-30 10:10:33 +00:00
2021-09-17 10:20:25 +00:00
### Transition settings
| Name | Value |
| - | - |
2021-09-18 06:39:54 +00:00
| `TERMINAL_TOTAL_DIFFICULTY` | **TBD** |
2021-09-17 10:20:25 +00:00
2021-03-11 12:33:36 +00:00
## Containers
### Extended containers
#### `BeaconBlockBody`
```python
2021-07-22 14:36:41 +00:00
class BeaconBlockBody(Container):
randao_reveal: BLSSignature
eth1_data: Eth1Data # Eth1 data vote
graffiti: Bytes32 # Arbitrary data
# Operations
proposer_slashings: List[ProposerSlashing, MAX_PROPOSER_SLASHINGS]
attester_slashings: List[AttesterSlashing, MAX_ATTESTER_SLASHINGS]
attestations: List[Attestation, MAX_ATTESTATIONS]
deposits: List[Deposit, MAX_DEPOSITS]
voluntary_exits: List[SignedVoluntaryExit, MAX_VOLUNTARY_EXITS]
sync_aggregate: SyncAggregate
2021-06-18 10:09:30 +00:00
# Execution
2021-04-08 08:29:05 +00:00
execution_payload: ExecutionPayload # [New in Merge]
2021-03-11 12:33:36 +00:00
```
#### `BeaconState`
```python
2021-07-22 18:01:50 +00:00
class BeaconState(Container):
2021-07-22 14:36:41 +00:00
# Versioning
genesis_time: uint64
genesis_validators_root: Root
slot: Slot
fork: Fork
# History
latest_block_header: BeaconBlockHeader
block_roots: Vector[Root, SLOTS_PER_HISTORICAL_ROOT]
state_roots: Vector[Root, SLOTS_PER_HISTORICAL_ROOT]
historical_roots: List[Root, HISTORICAL_ROOTS_LIMIT]
# Eth1
eth1_data: Eth1Data
eth1_data_votes: List[Eth1Data, EPOCHS_PER_ETH1_VOTING_PERIOD * SLOTS_PER_EPOCH]
eth1_deposit_index: uint64
# Registry
validators: List[Validator, VALIDATOR_REGISTRY_LIMIT]
balances: List[Gwei, VALIDATOR_REGISTRY_LIMIT]
# Randomness
randao_mixes: Vector[Bytes32, EPOCHS_PER_HISTORICAL_VECTOR]
# Slashings
slashings: Vector[Gwei, EPOCHS_PER_SLASHINGS_VECTOR] # Per-epoch sums of slashed effective balances
# Participation
previous_epoch_participation: List[ParticipationFlags, VALIDATOR_REGISTRY_LIMIT]
current_epoch_participation: List[ParticipationFlags, VALIDATOR_REGISTRY_LIMIT]
# Finality
justification_bits: Bitvector[JUSTIFICATION_BITS_LENGTH] # Bit set for every recent justified epoch
previous_justified_checkpoint: Checkpoint
current_justified_checkpoint: Checkpoint
finalized_checkpoint: Checkpoint
# Inactivity
inactivity_scores: List[uint64, VALIDATOR_REGISTRY_LIMIT]
# Sync
current_sync_committee: SyncCommittee
next_sync_committee: SyncCommittee
2021-06-18 10:09:30 +00:00
# Execution
2021-04-08 08:29:05 +00:00
latest_execution_payload_header: ExecutionPayloadHeader # [New in Merge]
2021-03-11 12:33:36 +00:00
```
### New containers
2021-04-08 08:29:05 +00:00
#### `ExecutionPayload`
2021-03-11 12:33:36 +00:00
2021-08-16 12:35:11 +00:00
*Note*: The `base_fee_per_gas` field is serialized in little-endian.
2021-03-11 12:33:36 +00:00
```python
2021-04-08 08:29:05 +00:00
class ExecutionPayload(Container):
2021-06-18 10:09:30 +00:00
# Execution block header fields
2021-04-08 08:48:03 +00:00
parent_hash: Hash32
2021-06-18 10:09:30 +00:00
coinbase: Bytes20 # 'beneficiary' in the yellow paper
2021-03-11 12:33:36 +00:00
state_root: Bytes32
2021-06-18 10:09:30 +00:00
receipt_root: Bytes32 # 'receipts root' in the yellow paper
2021-06-18 18:28:38 +00:00
logs_bloom: ByteVector[BYTES_PER_LOGS_BLOOM]
random: Bytes32 # 'difficulty' in the yellow paper
2021-06-18 10:09:30 +00:00
block_number: uint64 # 'number' in the yellow paper
2021-03-11 12:33:36 +00:00
gas_limit: uint64
gas_used: uint64
2021-04-13 13:08:47 +00:00
timestamp: uint64
2021-09-17 12:23:21 +00:00
extra_data: ByteList[MAX_EXTRA_DATA_BYTES]
2021-08-16 12:35:11 +00:00
base_fee_per_gas: Bytes32 # base fee introduced in EIP-1559, little-endian serialized
2021-06-18 10:09:30 +00:00
# Extra payload fields
block_hash: Hash32 # Hash of execution block
transactions: List[Transaction, MAX_TRANSACTIONS_PER_PAYLOAD]
2021-03-11 12:33:36 +00:00
```
2021-04-08 08:29:05 +00:00
#### `ExecutionPayloadHeader`
2021-04-02 14:48:02 +00:00
```python
2021-04-08 08:29:05 +00:00
class ExecutionPayloadHeader(Container):
2021-06-18 10:09:30 +00:00
# Execution block header fields
2021-04-08 08:48:03 +00:00
parent_hash: Hash32
2021-04-02 14:48:02 +00:00
coinbase: Bytes20
state_root: Bytes32
receipt_root: Bytes32
logs_bloom: ByteVector[BYTES_PER_LOGS_BLOOM]
2021-06-17 15:20:17 +00:00
random: Bytes32
2021-06-18 10:09:30 +00:00
block_number: uint64
2021-04-02 14:48:02 +00:00
gas_limit: uint64
gas_used: uint64
2021-04-13 13:08:47 +00:00
timestamp: uint64
2021-09-17 12:23:21 +00:00
extra_data: ByteList[MAX_EXTRA_DATA_BYTES]
2021-08-13 08:21:37 +00:00
base_fee_per_gas: Bytes32
2021-06-18 10:09:30 +00:00
# Extra payload fields
block_hash: Hash32 # Hash of execution block
2021-04-06 05:48:33 +00:00
transactions_root: Root
2021-04-02 14:48:02 +00:00
```
2021-06-18 10:09:30 +00:00
## Helper functions
2021-05-10 13:48:37 +00:00
2021-06-18 10:09:30 +00:00
### Predicates
2021-05-10 13:48:37 +00:00
2021-06-18 10:09:30 +00:00
#### `is_merge_complete`
2021-05-10 13:48:37 +00:00
```python
2021-06-18 10:09:30 +00:00
def is_merge_complete(state: BeaconState) -> bool:
return state.latest_execution_payload_header != ExecutionPayloadHeader()
2021-05-10 13:48:37 +00:00
```
2021-06-18 10:09:30 +00:00
#### `is_merge_block`
2021-03-11 12:33:36 +00:00
2021-06-18 10:09:30 +00:00
```python
def is_merge_block(state: BeaconState, body: BeaconBlockBody) -> bool:
return not is_merge_complete(state) and body.execution_payload != ExecutionPayload()
```
2021-03-11 12:33:36 +00:00
2021-05-06 00:21:52 +00:00
#### `is_execution_enabled`
```python
2021-06-18 10:09:30 +00:00
def is_execution_enabled(state: BeaconState, body: BeaconBlockBody) -> bool:
return is_merge_block(state, body) or is_merge_complete(state)
2021-05-06 00:21:52 +00:00
```
2021-06-18 10:09:30 +00:00
### Misc
2021-03-11 12:33:36 +00:00
2021-06-18 10:09:30 +00:00
#### `compute_timestamp_at_slot`
2021-03-11 12:33:36 +00:00
2021-06-18 10:09:30 +00:00
*Note*: This function is unsafe with respect to overflows and underflows.
2021-03-11 12:33:36 +00:00
```python
2021-06-18 10:09:30 +00:00
def compute_timestamp_at_slot(state: BeaconState, slot: Slot) -> uint64:
slots_since_genesis = slot - GENESIS_SLOT
return uint64(state.genesis_time + slots_since_genesis * SECONDS_PER_SLOT)
2021-03-11 12:33:36 +00:00
```
2021-06-18 10:09:30 +00:00
## Beacon chain state transition function
2021-04-08 09:26:32 +00:00
2021-06-18 10:09:30 +00:00
### Execution engine
The implementation-dependent `ExecutionEngine` protocol encapsulates the execution sub-system logic via:
* a state object `self.execution_state` of type `ExecutionState`
2021-09-20 14:57:45 +00:00
* a state transition function `self.execute_payload` which applies changes to the `self.execution_state`
2021-09-22 12:10:57 +00:00
* a function `self.consensus_validated` which signals that the beacon block containing the execution payload
2021-09-20 14:57:45 +00:00
is valid with respect to the consensus rule set
2021-06-18 10:09:30 +00:00
2021-09-22 12:10:57 +00:00
*Note*: `execute_payload` and `consensus_validated` are functions accessed through the `EXECUTION_ENGINE` module which instantiates the `ExecutionEngine` protocol.
The body of each of these functions is implementation dependent.
The Engine API may be used to implement them with an external execution engine.
2021-09-20 14:57:45 +00:00
#### `execute_payload`
2021-04-14 06:53:30 +00:00
2021-04-08 09:26:32 +00:00
```python
2021-09-20 14:57:45 +00:00
def execute_payload(self: ExecutionEngine, execution_payload: ExecutionPayload) -> bool:
2021-06-18 10:09:30 +00:00
"""
Returns ``True`` iff ``execution_payload`` is valid with respect to ``self.execution_state``.
"""
...
2021-04-08 09:26:32 +00:00
```
2021-09-20 14:57:45 +00:00
#### `consensus_validated`
```python
def consensus_validated(self: ExecutionEngine, execution_payload: ExecutionPayload) -> None:
...
```
2021-03-11 12:33:36 +00:00
### Block processing
2021-09-01 14:59:16 +00:00
*Note*: The call to the `process_execution_payload` must happen before the call to the `process_randao` as the former depends on the `randao_mix` computed with the reveal of the previous block.
2021-09-01 12:42:58 +00:00
2021-03-11 12:33:36 +00:00
```python
def process_block(state: BeaconState, block: BeaconBlock) -> None:
process_block_header(state, block)
2021-09-01 12:42:58 +00:00
if is_execution_enabled(state, block.body):
process_execution_payload(state, block.body.execution_payload, EXECUTION_ENGINE) # [New in Merge]
2021-03-11 12:33:36 +00:00
process_randao(state, block.body)
2021-03-20 13:21:11 +00:00
process_eth1_data(state, block.body)
2021-03-11 12:33:36 +00:00
process_operations(state, block.body)
2021-07-22 14:36:41 +00:00
process_sync_aggregate(state, block.body.sync_aggregate)
2021-09-20 14:57:45 +00:00
if is_execution_enabled(state, block.body):
# Notify the block is valid with respect to the consensus state transition function
EXECUTION_ENGINE.consensus_validated(block.body.execution_payload) # [New in Merge]
2021-03-11 12:33:36 +00:00
```
2021-06-18 10:09:30 +00:00
### Execution payload processing
2021-03-11 12:33:36 +00:00
2021-07-26 13:30:50 +00:00
#### `is_valid_gas_limit`
```python
def is_valid_gas_limit(payload: ExecutionPayload, parent: ExecutionPayloadHeader) -> bool:
parent_gas_limit = parent.gas_limit
2021-07-30 06:36:02 +00:00
# Check if the payload used too much gas
2021-07-26 13:30:50 +00:00
if payload.gas_used > payload.gas_limit:
return False
2021-07-30 06:36:02 +00:00
# Check if the payload changed the gas limit too much
2021-07-30 06:43:54 +00:00
if payload.gas_limit >= parent_gas_limit + parent_gas_limit // GAS_LIMIT_DENOMINATOR:
2021-07-26 13:30:50 +00:00
return False
2021-07-30 06:43:54 +00:00
if payload.gas_limit < = parent_gas_limit - parent_gas_limit // GAS_LIMIT_DENOMINATOR:
2021-07-26 13:30:50 +00:00
return False
2021-07-30 06:36:02 +00:00
# Check if the gas limit is at least the minimum gas limit
2021-07-26 13:30:50 +00:00
if payload.gas_limit < MIN_GAS_LIMIT:
return False
return True
```
2021-06-18 10:09:30 +00:00
#### `process_execution_payload`
2021-03-11 12:33:36 +00:00
```python
2021-06-22 08:23:26 +00:00
def process_execution_payload(state: BeaconState, payload: ExecutionPayload, execution_engine: ExecutionEngine) -> None:
2021-09-17 17:00:32 +00:00
# Verify consistency of the parent hash, block number, base fee per gas and gas limit
# with respect to the previous execution payload header
2021-06-18 10:09:30 +00:00
if is_merge_complete(state):
assert payload.parent_hash == state.latest_execution_payload_header.block_hash
assert payload.block_number == state.latest_execution_payload_header.block_number + uint64(1)
2021-07-26 13:30:50 +00:00
assert is_valid_gas_limit(payload, state.latest_execution_payload_header)
2021-09-17 17:00:32 +00:00
# Verify random
assert payload.random == get_randao_mix(state, get_current_epoch(state))
2021-06-18 10:09:30 +00:00
# Verify timestamp
assert payload.timestamp == compute_timestamp_at_slot(state, state.slot)
# Verify the execution payload is valid
2021-09-20 14:57:45 +00:00
assert execution_engine.execute_payload(payload)
2021-07-07 12:44:22 +00:00
# Cache execution payload header
2021-04-08 08:29:05 +00:00
state.latest_execution_payload_header = ExecutionPayloadHeader(
2021-06-18 10:09:30 +00:00
parent_hash=payload.parent_hash,
coinbase=payload.coinbase,
state_root=payload.state_root,
receipt_root=payload.receipt_root,
2021-06-18 18:28:38 +00:00
logs_bloom=payload.logs_bloom,
random=payload.random,
2021-06-18 10:09:30 +00:00
block_number=payload.block_number,
gas_limit=payload.gas_limit,
gas_used=payload.gas_used,
timestamp=payload.timestamp,
2021-09-17 12:23:21 +00:00
extra_data=payload.extra_data,
2021-07-26 13:30:50 +00:00
base_fee_per_gas=payload.base_fee_per_gas,
2021-06-18 10:09:30 +00:00
block_hash=payload.block_hash,
transactions_root=hash_tree_root(payload.transactions),
2021-04-02 14:48:02 +00:00
)
2021-03-11 12:33:36 +00:00
```
2021-06-08 12:44:53 +00:00
2021-06-18 10:09:30 +00:00
## Testing
2021-06-08 12:44:53 +00:00
2021-06-18 10:09:30 +00:00
*Note*: The function `initialize_beacon_state_from_eth1` is modified for pure Merge testing only.
2021-06-08 12:44:53 +00:00
2021-07-22 14:36:41 +00:00
*Note*: The function `initialize_beacon_state_from_eth1` is modified: (1) using `MERGE_FORK_VERSION` as the current fork version, (2) utilizing the Merge `BeaconBlockBody` when constructing the initial `latest_block_header` , and (3) initialize `latest_execution_payload_header` .
2021-06-08 12:44:53 +00:00
```python
def initialize_beacon_state_from_eth1(eth1_block_hash: Bytes32,
eth1_timestamp: uint64,
deposits: Sequence[Deposit]) -> BeaconState:
fork = Fork(
previous_version=GENESIS_FORK_VERSION,
current_version=MERGE_FORK_VERSION, # [Modified in Merge]
epoch=GENESIS_EPOCH,
)
state = BeaconState(
genesis_time=eth1_timestamp + GENESIS_DELAY,
fork=fork,
eth1_data=Eth1Data(block_hash=eth1_block_hash, deposit_count=uint64(len(deposits))),
latest_block_header=BeaconBlockHeader(body_root=hash_tree_root(BeaconBlockBody())),
2021-06-22 08:23:26 +00:00
randao_mixes=[eth1_block_hash] * EPOCHS_PER_HISTORICAL_VECTOR, # Seed RANDAO with Eth1 entropy
2021-06-08 12:44:53 +00:00
)
# Process deposits
leaves = list(map(lambda deposit: deposit.data, deposits))
for index, deposit in enumerate(deposits):
deposit_data_list = List[DepositData, 2**DEPOSIT_CONTRACT_TREE_DEPTH](*leaves[:index + 1])
state.eth1_data.deposit_root = hash_tree_root(deposit_data_list)
process_deposit(state, deposit)
# Process activations
for index, validator in enumerate(state.validators):
balance = state.balances[index]
validator.effective_balance = min(balance - balance % EFFECTIVE_BALANCE_INCREMENT, MAX_EFFECTIVE_BALANCE)
if validator.effective_balance == MAX_EFFECTIVE_BALANCE:
validator.activation_eligibility_epoch = GENESIS_EPOCH
validator.activation_epoch = GENESIS_EPOCH
# Set genesis validators root for domain separation and chain versioning
state.genesis_validators_root = hash_tree_root(state.validators)
2021-07-22 14:36:41 +00:00
# Fill in sync committees
# Note: A duplicate committee is assigned for the current and next committee at genesis
state.current_sync_committee = get_next_sync_committee(state)
state.next_sync_committee = get_next_sync_committee(state)
2021-06-18 10:09:30 +00:00
# [New in Merge] Initialize the execution payload header (with block number set to 0)
state.latest_execution_payload_header.block_hash = eth1_block_hash
state.latest_execution_payload_header.timestamp = eth1_timestamp
2021-06-22 08:23:26 +00:00
state.latest_execution_payload_header.random = eth1_block_hash
2021-07-30 10:10:33 +00:00
state.latest_execution_payload_header.gas_limit = GENESIS_GAS_LIMIT
state.latest_execution_payload_header.base_fee_per_gas = GENESIS_BASE_FEE_PER_GAS
2021-06-08 12:44:53 +00:00
return state
```