status-im
/
nimbus-eth2
mirror of https://github.com/status-im/nimbus-eth2.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
nimbus-eth2/beacon_chain/spec/forks.nim

1077 lines
42 KiB
Nim
Raw Normal View History

use ForkedHashedBeaconState in StateData (#2634) * use ForkedHashedBeaconState in StateData * fix FAR_FUTURE_EPOCH -> slot overflow; almost always use assign() * avoid stack allocation in maybeUpgradeStateToAltair() * create and use dispatch functions for check_attester_slashing(), check_proposer_slashing(), and check_voluntary_exit() * use getStateRoot() instead of various state.data.hbsPhase0.root * remove withStateVars.hashedState(), which doesn't work as a design anymore * introduce spec/datatypes/altair into beacon_chain_db * fix inefficient codegen for getStateField(largeStateField) * state_transition_slots() doesn't either need/use blocks or runtime presets * combine process_slots(HBS)/state_transition_slots(HBS) which differ only in last-slot htr optimization * getStateField(StateData, ...) was replaced by getStateField(ForkedHashedBeaconState, ...) * fix rollback * switch some state_transition(), process_slots, makeTestBlocks(), etc to use ForkedHashedBeaconState * remove state_transition(phase0.HashedBeaconState) * remove process_slots(phase0.HashedBeaconState) * remove state_transition_block(phase0.HashedBeaconState) * remove unused callWithBS(); separate case expression from if statement * switch back from nested-ref-object construction to (ref Foo)(Bar())
2021-06-11 17:51:46 +00:00
# beacon_chain
consensus spec ref URL update v1.3.0-{alpha.2,rc.0}; copyright year update (#4477)
2023-01-09 22:44:44 +00:00
# Copyright (c) 2021-2023 Status Research & Development GmbH
use ForkedHashedBeaconState in StateData (#2634) * use ForkedHashedBeaconState in StateData * fix FAR_FUTURE_EPOCH -> slot overflow; almost always use assign() * avoid stack allocation in maybeUpgradeStateToAltair() * create and use dispatch functions for check_attester_slashing(), check_proposer_slashing(), and check_voluntary_exit() * use getStateRoot() instead of various state.data.hbsPhase0.root * remove withStateVars.hashedState(), which doesn't work as a design anymore * introduce spec/datatypes/altair into beacon_chain_db * fix inefficient codegen for getStateField(largeStateField) * state_transition_slots() doesn't either need/use blocks or runtime presets * combine process_slots(HBS)/state_transition_slots(HBS) which differ only in last-slot htr optimization * getStateField(StateData, ...) was replaced by getStateField(ForkedHashedBeaconState, ...) * fix rollback * switch some state_transition(), process_slots, makeTestBlocks(), etc to use ForkedHashedBeaconState * remove state_transition(phase0.HashedBeaconState) * remove process_slots(phase0.HashedBeaconState) * remove state_transition_block(phase0.HashedBeaconState) * remove unused callWithBS(); separate case expression from if statement * switch back from nested-ref-object construction to (ref Foo)(Bar())
2021-06-11 17:51:46 +00:00
# Licensed and distributed under either of
# * MIT license (license terms in the root directory or at https://opensource.org/licenses/MIT).
# * Apache v2 license (license terms in the root directory or at https://www.apache.org/licenses/LICENSE-2.0).
# at your option. This file may not be copied, modified, or distributed except according to those terms.
remove Nim 1.2-compatible `push raise`s and update copyright notice years (#4528)
2023-01-20 14:14:37 +00:00
{.push raises: [].}
use ForkedHashedBeaconState in StateData (#2634) * use ForkedHashedBeaconState in StateData * fix FAR_FUTURE_EPOCH -> slot overflow; almost always use assign() * avoid stack allocation in maybeUpgradeStateToAltair() * create and use dispatch functions for check_attester_slashing(), check_proposer_slashing(), and check_voluntary_exit() * use getStateRoot() instead of various state.data.hbsPhase0.root * remove withStateVars.hashedState(), which doesn't work as a design anymore * introduce spec/datatypes/altair into beacon_chain_db * fix inefficient codegen for getStateField(largeStateField) * state_transition_slots() doesn't either need/use blocks or runtime presets * combine process_slots(HBS)/state_transition_slots(HBS) which differ only in last-slot htr optimization * getStateField(StateData, ...) was replaced by getStateField(ForkedHashedBeaconState, ...) * fix rollback * switch some state_transition(), process_slots, makeTestBlocks(), etc to use ForkedHashedBeaconState * remove state_transition(phase0.HashedBeaconState) * remove process_slots(phase0.HashedBeaconState) * remove state_transition_block(phase0.HashedBeaconState) * remove unused callWithBS(); separate case expression from if statement * switch back from nested-ref-object construction to (ref Foo)(Bar())
2021-06-11 17:51:46 +00:00
import
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
std/macros,
rename forkDigests.merge to forkDigests.bellatrix (#3245)
2022-01-05 14:24:15 +00:00
stew/assign2,
make message_router.routeSignedBeaconBlock blob-aware (#4537) * make message_router.outeSignedBeaconBlock blob-aware * Update beacon_chain/spec/forks.nim * Update beacon_chain/spec/forks.nim
2023-01-21 06:34:04 +00:00
stew/results,
use ForkedHashedBeaconState in StateData (#2634) * use ForkedHashedBeaconState in StateData * fix FAR_FUTURE_EPOCH -> slot overflow; almost always use assign() * avoid stack allocation in maybeUpgradeStateToAltair() * create and use dispatch functions for check_attester_slashing(), check_proposer_slashing(), and check_voluntary_exit() * use getStateRoot() instead of various state.data.hbsPhase0.root * remove withStateVars.hashedState(), which doesn't work as a design anymore * introduce spec/datatypes/altair into beacon_chain_db * fix inefficient codegen for getStateField(largeStateField) * state_transition_slots() doesn't either need/use blocks or runtime presets * combine process_slots(HBS)/state_transition_slots(HBS) which differ only in last-slot htr optimization * getStateField(StateData, ...) was replaced by getStateField(ForkedHashedBeaconState, ...) * fix rollback * switch some state_transition(), process_slots, makeTestBlocks(), etc to use ForkedHashedBeaconState * remove state_transition(phase0.HashedBeaconState) * remove process_slots(phase0.HashedBeaconState) * remove state_transition_block(phase0.HashedBeaconState) * remove unused callWithBS(); separate case expression from if statement * switch back from nested-ref-object construction to (ref Foo)(Bar())
2021-06-11 17:51:46 +00:00
chronicles,
../extras,
make LC data fork aware (#4493) In a future fork, light client data will be extended with execution info to support more use cases. To anticipate such an upgrade, introduce `Forky` and `Forked` types, and ready the database schema. Because the mapping of sync committee periods to fork versions is not necessarily unique (fork schedule not in sync with period boundaries), an additional column is added to `period` -> `LightClientUpdate` table.
2023-01-12 17:11:38 +00:00
"."/[
block_id, eth2_merkleization, eth2_ssz_serialization,
forks_light_client, presets],
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
./datatypes/[phase0, altair, bellatrix, capella, deneb],
capella builder API support (#4643) * capella builder API support * use capella EPH when appropriate * fill in ExecutionPayload.withdrawals and sanity-check builder API withdrawals root
2023-02-21 13:21:38 +00:00
./mev/bellatrix_mev, ./mev/capella_mev
use ForkedHashedBeaconState in StateData (#2634) * use ForkedHashedBeaconState in StateData * fix FAR_FUTURE_EPOCH -> slot overflow; almost always use assign() * avoid stack allocation in maybeUpgradeStateToAltair() * create and use dispatch functions for check_attester_slashing(), check_proposer_slashing(), and check_voluntary_exit() * use getStateRoot() instead of various state.data.hbsPhase0.root * remove withStateVars.hashedState(), which doesn't work as a design anymore * introduce spec/datatypes/altair into beacon_chain_db * fix inefficient codegen for getStateField(largeStateField) * state_transition_slots() doesn't either need/use blocks or runtime presets * combine process_slots(HBS)/state_transition_slots(HBS) which differ only in last-slot htr optimization * getStateField(StateData, ...) was replaced by getStateField(ForkedHashedBeaconState, ...) * fix rollback * switch some state_transition(), process_slots, makeTestBlocks(), etc to use ForkedHashedBeaconState * remove state_transition(phase0.HashedBeaconState) * remove process_slots(phase0.HashedBeaconState) * remove state_transition_block(phase0.HashedBeaconState) * remove unused callWithBS(); separate case expression from if statement * switch back from nested-ref-object construction to (ref Foo)(Bar())
2021-06-11 17:51:46 +00:00
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
export
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
extras, block_id, phase0, altair, bellatrix, capella, deneb,
LC data fork cleanup (#4506) Distinguish between those code locations that need to be updated on each light client data format change, and those others that should generally be fine, as long as a valid light client object is processed. The former are tagged with static assert for `LightClientDataFork.high`. The latter are changed to `lcDataFork > LightClientDataFork.None` to indicate that they depend only on presence of any valid object. Also bundled a few minor cleanups and fixes. Also add `Forky` type for `LightClientStore` and minor fixes / cleanups.
2023-01-14 21:19:50 +00:00
eth2_merkleization, eth2_ssz_serialization, forks_light_client,
capella builder API support (#4643) * capella builder API support * use capella EPH when appropriate * fill in ExecutionPayload.withdrawals and sanity-check builder API withdrawals root
2023-02-21 13:21:38 +00:00
presets, bellatrix_mev, capella_mev
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
# This file contains helpers for dealing with forks - we have two ways we can
# deal with forks:
# * generics - this means using the static typing and differentiating forks
# at compile time - this is preferred in fork-specific code where the fork
# is known up-front, for example spec functions.
# * variants - this means using a variant object and determining the fork at
# runtime - this carries the obvious risk and complexity of dealing with
# runtime checking, but is of course needed for external data that may be
# of any fork kind.
#
# For generics, we define `Forky*` type classes that cover "similar" objects
# across forks - for variants, they're called `Forked*` instead.
# See withXxx and `init` for convenient ways of moving between these two worlds.
# A clever programmer would use templates, macros and dark magic to create all
# these types and converters :)
rework spec imports (#2779) The spec imports are a mess to work with, so this branch cleans them up a bit to ensure that we avoid generic sandwitches and that importing stuff generally becomes easier. * reexport crypto/digest/presets because these are part of the public symbol set of the rest of the spec types * don't export `merge` types from `base` - this causes circular deps * fix circular deps in `ssz/spec_types` - this is the first step in disentangling ssz from spec * be explicit about phase0 vs altair - longer term, `altair` will become the "natural" type set, then merge and so on, so no point in giving `phase0` special preferential treatment
2021-08-12 13:08:20 +00:00
use ForkedHashedBeaconState in StateData (#2634) * use ForkedHashedBeaconState in StateData * fix FAR_FUTURE_EPOCH -> slot overflow; almost always use assign() * avoid stack allocation in maybeUpgradeStateToAltair() * create and use dispatch functions for check_attester_slashing(), check_proposer_slashing(), and check_voluntary_exit() * use getStateRoot() instead of various state.data.hbsPhase0.root * remove withStateVars.hashedState(), which doesn't work as a design anymore * introduce spec/datatypes/altair into beacon_chain_db * fix inefficient codegen for getStateField(largeStateField) * state_transition_slots() doesn't either need/use blocks or runtime presets * combine process_slots(HBS)/state_transition_slots(HBS) which differ only in last-slot htr optimization * getStateField(StateData, ...) was replaced by getStateField(ForkedHashedBeaconState, ...) * fix rollback * switch some state_transition(), process_slots, makeTestBlocks(), etc to use ForkedHashedBeaconState * remove state_transition(phase0.HashedBeaconState) * remove process_slots(phase0.HashedBeaconState) * remove state_transition_block(phase0.HashedBeaconState) * remove unused callWithBS(); separate case expression from if statement * switch back from nested-ref-object construction to (ref Foo)(Bar())
2021-06-11 17:51:46 +00:00
type
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
ConsensusFork* {.pure.} = enum
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
Phase0,
Altair,
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
Bellatrix,
extent `BeaconStateFork` enum (#4396)
2022-12-07 16:47:23 +00:00
Capella,
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
Deneb
use ForkedHashedBeaconState in StateData (#2634) * use ForkedHashedBeaconState in StateData * fix FAR_FUTURE_EPOCH -> slot overflow; almost always use assign() * avoid stack allocation in maybeUpgradeStateToAltair() * create and use dispatch functions for check_attester_slashing(), check_proposer_slashing(), and check_voluntary_exit() * use getStateRoot() instead of various state.data.hbsPhase0.root * remove withStateVars.hashedState(), which doesn't work as a design anymore * introduce spec/datatypes/altair into beacon_chain_db * fix inefficient codegen for getStateField(largeStateField) * state_transition_slots() doesn't either need/use blocks or runtime presets * combine process_slots(HBS)/state_transition_slots(HBS) which differ only in last-slot htr optimization * getStateField(StateData, ...) was replaced by getStateField(ForkedHashedBeaconState, ...) * fix rollback * switch some state_transition(), process_slots, makeTestBlocks(), etc to use ForkedHashedBeaconState * remove state_transition(phase0.HashedBeaconState) * remove process_slots(phase0.HashedBeaconState) * remove state_transition_block(phase0.HashedBeaconState) * remove unused callWithBS(); separate case expression from if statement * switch back from nested-ref-object construction to (ref Foo)(Bar())
2021-06-11 17:51:46 +00:00
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
ForkyBeaconState* =
phase0.BeaconState |
altair.BeaconState |
capella test vector support (#4261)
2022-10-27 06:29:24 +00:00
bellatrix.BeaconState |
eip4844 operations tests (#4392)
2022-12-06 12:40:13 +00:00
capella.BeaconState |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.BeaconState
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
ForkyHashedBeaconState* =
phase0.HashedBeaconState |
altair.HashedBeaconState |
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
bellatrix.HashedBeaconState |
extent `BeaconStateFork` enum (#4396)
2022-12-07 16:47:23 +00:00
capella.HashedBeaconState |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.HashedBeaconState
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
use ForkedHashedBeaconState in StateData (#2634) * use ForkedHashedBeaconState in StateData * fix FAR_FUTURE_EPOCH -> slot overflow; almost always use assign() * avoid stack allocation in maybeUpgradeStateToAltair() * create and use dispatch functions for check_attester_slashing(), check_proposer_slashing(), and check_voluntary_exit() * use getStateRoot() instead of various state.data.hbsPhase0.root * remove withStateVars.hashedState(), which doesn't work as a design anymore * introduce spec/datatypes/altair into beacon_chain_db * fix inefficient codegen for getStateField(largeStateField) * state_transition_slots() doesn't either need/use blocks or runtime presets * combine process_slots(HBS)/state_transition_slots(HBS) which differ only in last-slot htr optimization * getStateField(StateData, ...) was replaced by getStateField(ForkedHashedBeaconState, ...) * fix rollback * switch some state_transition(), process_slots, makeTestBlocks(), etc to use ForkedHashedBeaconState * remove state_transition(phase0.HashedBeaconState) * remove process_slots(phase0.HashedBeaconState) * remove state_transition_block(phase0.HashedBeaconState) * remove unused callWithBS(); separate case expression from if statement * switch back from nested-ref-object construction to (ref Foo)(Bar())
2021-06-11 17:51:46 +00:00
ForkedHashedBeaconState* = object
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
case kind*: ConsensusFork
of ConsensusFork.Phase0: phase0Data*: phase0.HashedBeaconState
of ConsensusFork.Altair: altairData*: altair.HashedBeaconState
of ConsensusFork.Bellatrix: bellatrixData*: bellatrix.HashedBeaconState
of ConsensusFork.Capella: capellaData*: capella.HashedBeaconState
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
of ConsensusFork.Deneb: denebData*: deneb.HashedBeaconState
Implement the new Altair req/resp protocols (#2676) * Implement the new Altair req/resp protocols Also fixes the altair message-id computation by providing the correct forkdigest prefix in `isAltairTopic`. Co-authored-by: Tanguy Cizain <tanguycizain@gmail.com>
2021-07-07 09:09:47 +00:00
bump `nim-eth`, extend empty block fallback for EIP4844 (#4425) Implements `emptyPayloadToBlockHeader` for EIP-4844. https://github.com/status-im/nim-eth/pull/570
2022-12-20 19:00:56 +00:00
ForkyExecutionPayload* =
bellatrix.ExecutionPayload |
capella.ExecutionPayload |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.ExecutionPayload
bump `nim-eth`, extend empty block fallback for EIP4844 (#4425) Implements `emptyPayloadToBlockHeader` for EIP-4844. https://github.com/status-im/nim-eth/pull/570
2022-12-20 19:00:56 +00:00
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
ForkyExecutionPayloadHeader* =
bellatrix.ExecutionPayloadHeader |
capella.ExecutionPayloadHeader |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.ExecutionPayloadHeader
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
fix missing backfill when restarting node When node is restarted before backfill has started but after some blocks have finalized with forward sync, we would not start the backfill. * also clean up one last `SomeSome`
2022-02-11 15:58:33 +00:00
ForkyBeaconBlockBody* =
phase0.BeaconBlockBody |
altair.BeaconBlockBody |
run capella block sanity tests in CI (#4292)
2022-11-07 18:37:48 +00:00
bellatrix.BeaconBlockBody |
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
capella.BeaconBlockBody |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.BeaconBlockBody
fix missing backfill when restarting node When node is restarted before backfill has started but after some blocks have finalized with forward sync, we would not start the backfill. * also clean up one last `SomeSome`
2022-02-11 15:58:33 +00:00
ForkySigVerifiedBeaconBlockBody* =
phase0.SigVerifiedBeaconBlockBody |
altair.SigVerifiedBeaconBlockBody |
run capella block sanity tests in CI (#4292)
2022-11-07 18:37:48 +00:00
bellatrix.SigVerifiedBeaconBlockBody |
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
capella.SigVerifiedBeaconBlockBody |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.SigVerifiedBeaconBlockBody
fix missing backfill when restarting node When node is restarted before backfill has started but after some blocks have finalized with forward sync, we would not start the backfill. * also clean up one last `SomeSome`
2022-02-11 15:58:33 +00:00
ForkyTrustedBeaconBlockBody* =
phase0.TrustedBeaconBlockBody |
altair.TrustedBeaconBlockBody |
run capella block sanity tests in CI (#4292)
2022-11-07 18:37:48 +00:00
bellatrix.TrustedBeaconBlockBody |
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
capella.TrustedBeaconBlockBody |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.TrustedBeaconBlockBody
fix missing backfill when restarting node When node is restarted before backfill has started but after some blocks have finalized with forward sync, we would not start the backfill. * also clean up one last `SomeSome`
2022-02-11 15:58:33 +00:00
SomeForkyBeaconBlockBody* =
ForkyBeaconBlockBody |
ForkySigVerifiedBeaconBlockBody |
ForkyTrustedBeaconBlockBody
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
ForkyBeaconBlock* =
phase0.BeaconBlock |
altair.BeaconBlock |
capella test vector support (#4261)
2022-10-27 06:29:24 +00:00
bellatrix.BeaconBlock |
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
capella.BeaconBlock |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.BeaconBlock
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
move `state_transition` to `Result` (#3284) * better error messages in api * avoid `BlockData` copies when replaying blocks
2022-01-17 11:19:58 +00:00
ForkySigVerifiedBeaconBlock* =
phase0.SigVerifiedBeaconBlock |
altair.SigVerifiedBeaconBlock |
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
bellatrix.SigVerifiedBeaconBlock |
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
capella.SigVerifiedBeaconBlock |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.SigVerifiedBeaconBlock
move `state_transition` to `Result` (#3284) * better error messages in api * avoid `BlockData` copies when replaying blocks
2022-01-17 11:19:58 +00:00
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
ForkyTrustedBeaconBlock* =
phase0.TrustedBeaconBlock |
altair.TrustedBeaconBlock |
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
bellatrix.TrustedBeaconBlock |
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
capella.TrustedBeaconBlock |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.TrustedBeaconBlock
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
Store finalized block roots in database (3s startup) (#3320) * Store finalized block roots in database (3s startup) When the chain has finalized a checkpoint, the history from that point onwards becomes linear - this is exploited in `.era` files to allow constant-time by-slot lookups. In the database, we can do the same by storing finalized block roots in a simple sparse table indexed by slot, bringing the two representations closer to each other in terms of conceptual layout and performance. Doing so has a number of interesting effects: * mainnet startup time is improved 3-5x (3s on my laptop) * the _first_ startup might take slightly longer as the new index is being built - ~10s on the same laptop * we no longer rely on the beacon block summaries to load the full dag - this is a lot faster because we no longer have to look up each block by parent root * a collateral benefit is that we no longer need to load the full summaries table into memory - we get the RSS benefits of #3164 without the CPU hit. Other random stuff: * simplify forky block generics * fix withManyWrites multiple evaluation * fix validator key cache not being updated properly in chaindag read-only mode * drop pre-altair summaries from `kvstore` * recreate missing summaries from altair+ blocks as well (in case database has lost some to an involuntary restart) * print database startup timings in chaindag load log * avoid allocating superfluos state at startup * use a recursive sql query to load the summaries of the unfinalized blocks
2022-01-30 16:51:04 +00:00
SomeForkyBeaconBlock* =
ForkyBeaconBlock |
ForkySigVerifiedBeaconBlock |
ForkyTrustedBeaconBlock
Support for driving multiple EL nodes from a single Nimbus BN (#4465) * Support for driving multiple EL nodes from a single Nimbus BN Full list of changes: * Eth1Monitor has been renamed to ELManager to match its current responsibilities better. * The ELManager is no longer optional in the code (it won't have a nil value under any circumstances). * The support for subscribing for headers was removed as it only worked with WebSockets and contributed significant complexity while bringing only a very minor advantage. * The `--web3-url` parameter has been deprecated in favor of a new `--el` parameter. The new parameter has a reasonable default value and supports specifying a different JWT for each connection. Each connection can also be configured with a different set of responsibilities (e.g. download deposits, validate blocks and/or produce blocks). On the command-line, these properties can be configured through URL properties stored in the #anchor part of the URL. In TOML files, they come with a very natural syntax (althrough the URL scheme is also supported). * The previously scattered EL-related state and logic is now moved to `eth1_monitor.nim` (this module will be renamed to `el_manager.nim` in a follow-up commit). State is assigned properly either to the `ELManager` or the to individual `ELConnection` objects where appropriate. The ELManager executes all Engine API requests against all attached EL nodes, in parallel. It compares their results and if there is a disagreement regarding the validity of a certain payload, this is detected and the beacon node is protected from publishing a block with a potential execution layer consensus bug in it. The BN provides metrics per EL node for the number of successful or failed requests for each type Engine API requests. If an EL node goes offline and connectivity is resoted later, we report the problem and the remedy in edge-triggered fashion. * More progress towards implementing Deneb block production in the VC and comparing the value of blocks produced by the EL and the builder API. * Adds a Makefile target for the zhejiang testnet
2023-03-05 01:40:21 +00:00
ForkyExecutionPayloadForSigning* =
bellatrix.ExecutionPayloadForSigning |
capella.ExecutionPayloadForSigning |
deneb.ExecutionPayloadForSigning
cleanups and fixes (#2827) * import cleanup * fix json-rpc exception handlers * avoid unnecessary presto client import * introduce ForkedBeaconBlock, some altair logging * url fixes
2021-08-27 09:00:06 +00:00
ForkedBeaconBlock* = object
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
case kind*: ConsensusFork
of ConsensusFork.Phase0: phase0Data*: phase0.BeaconBlock
of ConsensusFork.Altair: altairData*: altair.BeaconBlock
of ConsensusFork.Bellatrix: bellatrixData*: bellatrix.BeaconBlock
of ConsensusFork.Capella: capellaData*: capella.BeaconBlock
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
of ConsensusFork.Deneb: denebData*: deneb.BeaconBlock
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
MEV block proposal (#3883) * MEV validator registration * add nearby canary to detect new beacon chain forks * remove special MEV graffiti * web3signer support * fix trace logging * Nim 1.2 needs raises Defect * use template rather than proc in REST JSON parsing * use --payload-builder-enable and --payload-builder-url * explicitly default MEV to disabled * explicitly empty default value for payload builder URL * revert attestation pool to unstable version
2022-08-01 06:41:47 +00:00
Web3SignerForkedBeaconBlock* = object
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
case kind*: ConsensusFork
of ConsensusFork.Phase0: phase0Data*: phase0.BeaconBlock
of ConsensusFork.Altair: altairData*: altair.BeaconBlock
of ConsensusFork.Bellatrix: bellatrixData*: BeaconBlockHeader
of ConsensusFork.Capella: capellaData*: BeaconBlockHeader
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
of ConsensusFork.Deneb: denebData*: BeaconBlockHeader
Improve the compatibility with various Web3Signer versions and configurations (#3640) * Some Web3Signer versions insist replying with text/plain messages * When reading blocks, the Web3Signer uses upper-case fork identifiers instead of lower-case identifies like the Beacon API.
2022-05-17 16:55:03 +00:00
Support `/eth/v1/validator/blinded_blocks` (#4272) * Support BN endpoints for producing blinded blocks * use correct endpoint version * serve either JSON or SSZ versions of endpoint
2022-10-31 17:39:03 +00:00
ForkedBlindedBeaconBlock* = object
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
case kind*: ConsensusFork
of ConsensusFork.Phase0: phase0Data*: phase0.BeaconBlock
of ConsensusFork.Altair: altairData*: altair.BeaconBlock
capella builder API support (#4643) * capella builder API support * use capella EPH when appropriate * fill in ExecutionPayload.withdrawals and sanity-check builder API withdrawals root
2023-02-21 13:21:38 +00:00
of ConsensusFork.Bellatrix: bellatrixData*: bellatrix_mev.BlindedBeaconBlock
of ConsensusFork.Capella: capellaData*: capella_mev.BlindedBeaconBlock
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
of ConsensusFork.Deneb: denebData*: capella_mev.BlindedBeaconBlock
Support `/eth/v1/validator/blinded_blocks` (#4272) * Support BN endpoints for producing blinded blocks * use correct endpoint version * serve either JSON or SSZ versions of endpoint
2022-10-31 17:39:03 +00:00
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
ForkedTrustedBeaconBlock* = object
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
case kind*: ConsensusFork
of ConsensusFork.Phase0: phase0Data*: phase0.TrustedBeaconBlock
of ConsensusFork.Altair: altairData*: altair.TrustedBeaconBlock
of ConsensusFork.Bellatrix: bellatrixData*: bellatrix.TrustedBeaconBlock
of ConsensusFork.Capella: capellaData*: capella.TrustedBeaconBlock
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
of ConsensusFork.Deneb: denebData*: deneb.TrustedBeaconBlock
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
ForkySignedBeaconBlock* =
phase0.SignedBeaconBlock |
altair.SignedBeaconBlock |
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
bellatrix.SignedBeaconBlock |
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
capella.SignedBeaconBlock |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.SignedBeaconBlock
cleanups and fixes (#2827) * import cleanup * fix json-rpc exception handlers * avoid unnecessary presto client import * introduce ForkedBeaconBlock, some altair logging * url fixes
2021-08-27 09:00:06 +00:00
Implement the new Altair req/resp protocols (#2676) * Implement the new Altair req/resp protocols Also fixes the altair message-id computation by providing the correct forkdigest prefix in `isAltairTopic`. Co-authored-by: Tanguy Cizain <tanguycizain@gmail.com>
2021-07-07 09:09:47 +00:00
ForkedSignedBeaconBlock* = object
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
case kind*: ConsensusFork
of ConsensusFork.Phase0: phase0Data*: phase0.SignedBeaconBlock
of ConsensusFork.Altair: altairData*: altair.SignedBeaconBlock
of ConsensusFork.Bellatrix: bellatrixData*: bellatrix.SignedBeaconBlock
of ConsensusFork.Capella: capellaData*: capella.SignedBeaconBlock
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
of ConsensusFork.Deneb: denebData*: deneb.SignedBeaconBlock
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
VC: blinded block publishing support (#4332) * Add blind REST API declarations and implementations. * shortLog is still not stable. * Fix shortLog issues. * Enable disabled logging statements. * Address review comments. * Avoid templates suffering from double evaluation of their params * Address review comments. * Fix compilation issue. Co-authored-by: Zahary Karadjov <zahary@status.im>
2022-11-24 09:14:05 +00:00
ForkySignedBlindedBeaconBlock* =
phase0.SignedBeaconBlock |
altair.SignedBeaconBlock |
capella builder API support (#4643) * capella builder API support * use capella EPH when appropriate * fill in ExecutionPayload.withdrawals and sanity-check builder API withdrawals root
2023-02-21 13:21:38 +00:00
bellatrix_mev.SignedBlindedBeaconBlock |
capella_mev.SignedBlindedBeaconBlock
VC: blinded block publishing support (#4332) * Add blind REST API declarations and implementations. * shortLog is still not stable. * Fix shortLog issues. * Enable disabled logging statements. * Address review comments. * Avoid templates suffering from double evaluation of their params * Address review comments. * Fix compilation issue. Co-authored-by: Zahary Karadjov <zahary@status.im>
2022-11-24 09:14:05 +00:00
ForkedSignedBlindedBeaconBlock* = object
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
case kind*: ConsensusFork
of ConsensusFork.Phase0: phase0Data*: phase0.SignedBeaconBlock
of ConsensusFork.Altair: altairData*: altair.SignedBeaconBlock
capella builder API support (#4643) * capella builder API support * use capella EPH when appropriate * fill in ExecutionPayload.withdrawals and sanity-check builder API withdrawals root
2023-02-21 13:21:38 +00:00
of ConsensusFork.Bellatrix: bellatrixData*: bellatrix_mev.SignedBlindedBeaconBlock
of ConsensusFork.Capella: capellaData*: capella_mev.SignedBlindedBeaconBlock
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
of ConsensusFork.Deneb: denebData*: capella_mev.SignedBlindedBeaconBlock
VC: blinded block publishing support (#4332) * Add blind REST API declarations and implementations. * shortLog is still not stable. * Fix shortLog issues. * Enable disabled logging statements. * Address review comments. * Avoid templates suffering from double evaluation of their params * Address review comments. * Fix compilation issue. Co-authored-by: Zahary Karadjov <zahary@status.im>
2022-11-24 09:14:05 +00:00
time: spring cleaning (#3262) Time in the beacon chain is expressed relative to the genesis time - this PR creates a `beacon_time` module that collects helpers and utilities for dealing the time units - the new module does not deal with actual wall time (that's remains in `beacon_clock`). Collecting the time related stuff in one place makes it easier to find, avoids some circular imports and allows more easily identifying the code actually needs wall time to operate. * move genesis-time-related functionality into `spec/beacon_time` * avoid using `chronos.Duration` for time differences - it does not support negative values (such as when something happens earlier than it should) * saturate conversions between `FAR_FUTURE_XXX`, so as to avoid overflows * fix delay reporting in validator client so it uses the expected deadline of the slot, not "closest wall slot" * simplify looping over the slots of an epoch * `compute_start_slot_at_epoch` -> `start_slot` * `compute_epoch_at_slot` -> `epoch` A follow-up PR will (likely) introduce saturating arithmetic for the time units - this is merely code moves, renames and fixing of small bugs.
2022-01-11 10:01:54 +00:00
ForkySigVerifiedSignedBeaconBlock* =
phase0.SigVerifiedSignedBeaconBlock |
altair.SigVerifiedSignedBeaconBlock |
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
bellatrix.SigVerifiedSignedBeaconBlock |
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
capella.SigVerifiedSignedBeaconBlock |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.SigVerifiedSignedBeaconBlock
time: spring cleaning (#3262) Time in the beacon chain is expressed relative to the genesis time - this PR creates a `beacon_time` module that collects helpers and utilities for dealing the time units - the new module does not deal with actual wall time (that's remains in `beacon_clock`). Collecting the time related stuff in one place makes it easier to find, avoids some circular imports and allows more easily identifying the code actually needs wall time to operate. * move genesis-time-related functionality into `spec/beacon_time` * avoid using `chronos.Duration` for time differences - it does not support negative values (such as when something happens earlier than it should) * saturate conversions between `FAR_FUTURE_XXX`, so as to avoid overflows * fix delay reporting in validator client so it uses the expected deadline of the slot, not "closest wall slot" * simplify looping over the slots of an epoch * `compute_start_slot_at_epoch` -> `start_slot` * `compute_epoch_at_slot` -> `epoch` A follow-up PR will (likely) introduce saturating arithmetic for the time units - this is merely code moves, renames and fixing of small bugs.
2022-01-11 10:01:54 +00:00
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
ForkyMsgTrustedSignedBeaconBlock* =
phase0.MsgTrustedSignedBeaconBlock |
altair.MsgTrustedSignedBeaconBlock |
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
bellatrix.MsgTrustedSignedBeaconBlock |
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
capella.MsgTrustedSignedBeaconBlock |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.MsgTrustedSignedBeaconBlock
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
ForkyTrustedSignedBeaconBlock* =
phase0.TrustedSignedBeaconBlock |
altair.TrustedSignedBeaconBlock |
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
bellatrix.TrustedSignedBeaconBlock |
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
capella.TrustedSignedBeaconBlock |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.TrustedSignedBeaconBlock
Implement the new Altair req/resp protocols (#2676) * Implement the new Altair req/resp protocols Also fixes the altair message-id computation by providing the correct forkdigest prefix in `isAltairTopic`. Co-authored-by: Tanguy Cizain <tanguycizain@gmail.com>
2021-07-07 09:09:47 +00:00
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
ForkedMsgTrustedSignedBeaconBlock* = object
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
case kind*: ConsensusFork
of ConsensusFork.Phase0: phase0Data*: phase0.MsgTrustedSignedBeaconBlock
of ConsensusFork.Altair: altairData*: altair.MsgTrustedSignedBeaconBlock
of ConsensusFork.Bellatrix: bellatrixData*: bellatrix.MsgTrustedSignedBeaconBlock
of ConsensusFork.Capella: capellaData*: capella.MsgTrustedSignedBeaconBlock
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
of ConsensusFork.Deneb: denebData*: deneb.MsgTrustedSignedBeaconBlock
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
Implement the new Altair req/resp protocols (#2676) * Implement the new Altair req/resp protocols Also fixes the altair message-id computation by providing the correct forkdigest prefix in `isAltairTopic`. Co-authored-by: Tanguy Cizain <tanguycizain@gmail.com>
2021-07-07 09:09:47 +00:00
ForkedTrustedSignedBeaconBlock* = object
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
case kind*: ConsensusFork
of ConsensusFork.Phase0: phase0Data*: phase0.TrustedSignedBeaconBlock
of ConsensusFork.Altair: altairData*: altair.TrustedSignedBeaconBlock
of ConsensusFork.Bellatrix: bellatrixData*: bellatrix.TrustedSignedBeaconBlock
of ConsensusFork.Capella: capellaData*: capella.TrustedSignedBeaconBlock
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
of ConsensusFork.Deneb: denebData*: deneb.TrustedSignedBeaconBlock
Implement the new Altair req/resp protocols (#2676) * Implement the new Altair req/resp protocols Also fixes the altair message-id computation by providing the correct forkdigest prefix in `isAltairTopic`. Co-authored-by: Tanguy Cizain <tanguycizain@gmail.com>
2021-07-07 09:09:47 +00:00
time: spring cleaning (#3262) Time in the beacon chain is expressed relative to the genesis time - this PR creates a `beacon_time` module that collects helpers and utilities for dealing the time units - the new module does not deal with actual wall time (that's remains in `beacon_clock`). Collecting the time related stuff in one place makes it easier to find, avoids some circular imports and allows more easily identifying the code actually needs wall time to operate. * move genesis-time-related functionality into `spec/beacon_time` * avoid using `chronos.Duration` for time differences - it does not support negative values (such as when something happens earlier than it should) * saturate conversions between `FAR_FUTURE_XXX`, so as to avoid overflows * fix delay reporting in validator client so it uses the expected deadline of the slot, not "closest wall slot" * simplify looping over the slots of an epoch * `compute_start_slot_at_epoch` -> `start_slot` * `compute_epoch_at_slot` -> `epoch` A follow-up PR will (likely) introduce saturating arithmetic for the time units - this is merely code moves, renames and fixing of small bugs.
2022-01-11 10:01:54 +00:00
SomeForkySignedBeaconBlock* =
ForkySignedBeaconBlock |
ForkySigVerifiedSignedBeaconBlock |
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
ForkyMsgTrustedSignedBeaconBlock |
time: spring cleaning (#3262) Time in the beacon chain is expressed relative to the genesis time - this PR creates a `beacon_time` module that collects helpers and utilities for dealing the time units - the new module does not deal with actual wall time (that's remains in `beacon_clock`). Collecting the time related stuff in one place makes it easier to find, avoids some circular imports and allows more easily identifying the code actually needs wall time to operate. * move genesis-time-related functionality into `spec/beacon_time` * avoid using `chronos.Duration` for time differences - it does not support negative values (such as when something happens earlier than it should) * saturate conversions between `FAR_FUTURE_XXX`, so as to avoid overflows * fix delay reporting in validator client so it uses the expected deadline of the slot, not "closest wall slot" * simplify looping over the slots of an epoch * `compute_start_slot_at_epoch` -> `start_slot` * `compute_epoch_at_slot` -> `epoch` A follow-up PR will (likely) introduce saturating arithmetic for the time units - this is merely code moves, renames and fixing of small bugs.
2022-01-11 10:01:54 +00:00
ForkyTrustedSignedBeaconBlock
reward accounting for altair+ (#2981) Similar to the existing `RewardInfo`, this PR adds the infrastructure needed to export epoch processing information from altair+. Because accounting is done somewhat differently, the PR uses a fork-specific object to extrct the information in order to make the cost on the spec side low. * RewardInfo -> EpochInfo, ForkedEpochInfo * use array for computing new sync committee * avoid repeated total active balance computations in block processing * simplify proposer index check * simplify epoch transition tests * pre-compute base increment and reuse in epoch processing, and a few other small optimizations This PR introduces the type and does the heavy lifting in terms of refactoring - the tools that use the accounting will need separate PR:s (as well as refinements to the exportred information)
2021-10-13 14:24:36 +00:00
EpochInfoFork* {.pure.} = enum
Phase0
Altair
ForkedEpochInfo* = object
case kind*: EpochInfoFork
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
of EpochInfoFork.Phase0: phase0Data*: phase0.EpochInfo
of EpochInfoFork.Altair: altairData*: altair.EpochInfo
reward accounting for altair+ (#2981) Similar to the existing `RewardInfo`, this PR adds the infrastructure needed to export epoch processing information from altair+. Because accounting is done somewhat differently, the PR uses a fork-specific object to extrct the information in order to make the cost on the spec side low. * RewardInfo -> EpochInfo, ForkedEpochInfo * use array for computing new sync committee * avoid repeated total active balance computations in block processing * simplify proposer index check * simplify epoch transition tests * pre-compute base increment and reuse in epoch processing, and a few other small optimizations This PR introduces the type and does the heavy lifting in terms of refactoring - the tools that use the accounting will need separate PR:s (as well as refinements to the exportred information)
2021-10-13 14:24:36 +00:00
ForkyEpochInfo* = phase0.EpochInfo | altair.EpochInfo
harden sync sub committee selection (#2965) * harden sync sub committee selection also turn it into an iterator * fix test and warning
2021-10-07 13:19:47 +00:00
ForkDigests* = object
rename forkDigests.merge to forkDigests.bellatrix (#3245)
2022-01-05 14:24:15 +00:00
phase0*: ForkDigest
altair*: ForkDigest
bellatrix*: ForkDigest
initial Capella support in RuntimeConfig (#3698)
2022-06-03 14:42:40 +00:00
capella*: ForkDigest
rename `ForkDigests.eip4844` > `ForkDigests.deneb` (#4715)
2023-03-10 17:13:40 +00:00
deneb*: ForkDigest
Implement the new Altair req/resp protocols (#2676) * Implement the new Altair req/resp protocols Also fixes the altair message-id computation by providing the correct forkdigest prefix in `isAltairTopic`. Co-authored-by: Tanguy Cizain <tanguycizain@gmail.com>
2021-07-07 09:09:47 +00:00
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
macro getSymbolFromForkModule(fork: static ConsensusFork,
symbolName: static string): untyped =
let moduleName = case fork
of ConsensusFork.Phase0: "phase0"
of ConsensusFork.Altair: "altair"
of ConsensusFork.Bellatrix: "bellatrix"
of ConsensusFork.Capella: "capella"
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
of ConsensusFork.Deneb: "deneb"
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
newDotExpr(ident moduleName, ident symbolName)
template BeaconStateType*(fork: static ConsensusFork): auto =
getSymbolFromForkModule(fork, "BeaconState")
template BeaconBlockType*(fork: static ConsensusFork): auto =
getSymbolFromForkModule(fork, "BeaconBlock")
template BeaconBlockBodyType*(fork: static ConsensusFork): auto =
getSymbolFromForkModule(fork, "BeaconBlockBody")
LC data fork cleanup (#4506) Distinguish between those code locations that need to be updated on each light client data format change, and those others that should generally be fine, as long as a valid light client object is processed. The former are tagged with static assert for `LightClientDataFork.high`. The latter are changed to `lcDataFork > LightClientDataFork.None` to indicate that they depend only on presence of any valid object. Also bundled a few minor cleanups and fixes. Also add `Forky` type for `LightClientStore` and minor fixes / cleanups.
2023-01-14 21:19:50 +00:00
cleanup gossip message handler setup (#4961) * cleanup gossip message handler setup Reduce duplication and make gossip handler setup easier to read. * explicit returns for async validators
2023-05-16 07:46:41 +00:00
template SignedBeaconBlock*(kind: static ConsensusFork): auto =
when kind == ConsensusFork.Deneb:
typedesc[deneb.SignedBeaconBlock]
elif kind == ConsensusFork.Capella:
typedesc[capella.SignedBeaconBlock]
elif kind == ConsensusFork.Bellatrix:
typedesc[bellatrix.SignedBeaconBlock]
elif kind == ConsensusFork.Altair:
typedesc[altair.SignedBeaconBlock]
elif kind == ConsensusFork.Phase0:
typedesc[phase0.SignedBeaconBlock]
else:
static: raiseAssert "Unreachable"
extend `addTestBlock` with Capella/Deneb support (#4728) * extend `addTestBlock` with Capella/Deneb support * bump copyright years * fix
2023-03-11 20:11:33 +00:00
template ExecutionPayloadForSigning*(kind: static ConsensusFork): auto =
when kind == ConsensusFork.Deneb:
typedesc[deneb.ExecutionPayloadForSigning]
elif kind == ConsensusFork.Capella:
typedesc[capella.ExecutionPayloadForSigning]
elif kind == ConsensusFork.Bellatrix:
typedesc[bellatrix.ExecutionPayloadForSigning]
else:
static: raiseAssert "Unreachable"
rename `(with|at)StateFork` > `(with|at)ConsensusFork` (#4725)
2023-03-11 14:39:29 +00:00
template withConsensusFork*(
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
x: ConsensusFork, body: untyped): untyped =
LC data fork cleanup (#4506) Distinguish between those code locations that need to be updated on each light client data format change, and those others that should generally be fine, as long as a valid light client object is processed. The former are tagged with static assert for `LightClientDataFork.high`. The latter are changed to `lcDataFork > LightClientDataFork.None` to indicate that they depend only on presence of any valid object. Also bundled a few minor cleanups and fixes. Also add `Forky` type for `LightClientStore` and minor fixes / cleanups.
2023-01-14 21:19:50 +00:00
case x
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
of ConsensusFork.Deneb:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Deneb
LC data fork cleanup (#4506) Distinguish between those code locations that need to be updated on each light client data format change, and those others that should generally be fine, as long as a valid light client object is processed. The former are tagged with static assert for `LightClientDataFork.high`. The latter are changed to `lcDataFork > LightClientDataFork.None` to indicate that they depend only on presence of any valid object. Also bundled a few minor cleanups and fixes. Also add `Forky` type for `LightClientStore` and minor fixes / cleanups.
2023-01-14 21:19:50 +00:00
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Capella:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Capella
LC data fork cleanup (#4506) Distinguish between those code locations that need to be updated on each light client data format change, and those others that should generally be fine, as long as a valid light client object is processed. The former are tagged with static assert for `LightClientDataFork.high`. The latter are changed to `lcDataFork > LightClientDataFork.None` to indicate that they depend only on presence of any valid object. Also bundled a few minor cleanups and fixes. Also add `Forky` type for `LightClientStore` and minor fixes / cleanups.
2023-01-14 21:19:50 +00:00
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Bellatrix:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Bellatrix
LC data fork cleanup (#4506) Distinguish between those code locations that need to be updated on each light client data format change, and those others that should generally be fine, as long as a valid light client object is processed. The former are tagged with static assert for `LightClientDataFork.high`. The latter are changed to `lcDataFork > LightClientDataFork.None` to indicate that they depend only on presence of any valid object. Also bundled a few minor cleanups and fixes. Also add `Forky` type for `LightClientStore` and minor fixes / cleanups.
2023-01-14 21:19:50 +00:00
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Altair:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Altair
LC data fork cleanup (#4506) Distinguish between those code locations that need to be updated on each light client data format change, and those others that should generally be fine, as long as a valid light client object is processed. The former are tagged with static assert for `LightClientDataFork.high`. The latter are changed to `lcDataFork > LightClientDataFork.None` to indicate that they depend only on presence of any valid object. Also bundled a few minor cleanups and fixes. Also add `Forky` type for `LightClientStore` and minor fixes / cleanups.
2023-01-14 21:19:50 +00:00
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Phase0:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Phase0
LC data fork cleanup (#4506) Distinguish between those code locations that need to be updated on each light client data format change, and those others that should generally be fine, as long as a valid light client object is processed. The former are tagged with static assert for `LightClientDataFork.high`. The latter are changed to `lcDataFork > LightClientDataFork.None` to indicate that they depend only on presence of any valid object. Also bundled a few minor cleanups and fixes. Also add `Forky` type for `LightClientStore` and minor fixes / cleanups.
2023-01-14 21:19:50 +00:00
body
consolidate slot sanity checks across forks (#4418) * consolidate slot sanity checks across forks * use `new` rather than `init` for constructor of `ref`s
2022-12-13 15:58:59 +00:00
# TODO when https://github.com/nim-lang/Nim/issues/21086 fixed, use return type
# `ref T`
func new*(T: type ForkedHashedBeaconState, data: phase0.BeaconState):
ref ForkedHashedBeaconState =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
(ref T)(kind: ConsensusFork.Phase0, phase0Data: phase0.HashedBeaconState(
consolidate slot sanity checks across forks (#4418) * consolidate slot sanity checks across forks * use `new` rather than `init` for constructor of `ref`s
2022-12-13 15:58:59 +00:00
data: data, root: hash_tree_root(data)))
func new*(T: type ForkedHashedBeaconState, data: altair.BeaconState):
ref ForkedHashedBeaconState =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
(ref T)(kind: ConsensusFork.Altair, altairData: altair.HashedBeaconState(
consolidate slot sanity checks across forks (#4418) * consolidate slot sanity checks across forks * use `new` rather than `init` for constructor of `ref`s
2022-12-13 15:58:59 +00:00
data: data, root: hash_tree_root(data)))
func new*(T: type ForkedHashedBeaconState, data: bellatrix.BeaconState):
ref ForkedHashedBeaconState =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
(ref T)(kind: ConsensusFork.Bellatrix, bellatrixData: bellatrix.HashedBeaconState(
consolidate slot sanity checks across forks (#4418) * consolidate slot sanity checks across forks * use `new` rather than `init` for constructor of `ref`s
2022-12-13 15:58:59 +00:00
data: data, root: hash_tree_root(data)))
func new*(T: type ForkedHashedBeaconState, data: capella.BeaconState):
ref ForkedHashedBeaconState =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
(ref T)(kind: ConsensusFork.Capella, capellaData: capella.HashedBeaconState(
consolidate slot sanity checks across forks (#4418) * consolidate slot sanity checks across forks * use `new` rather than `init` for constructor of `ref`s
2022-12-13 15:58:59 +00:00
data: data, root: hash_tree_root(data)))
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
func new*(T: type ForkedHashedBeaconState, data: deneb.BeaconState):
consolidate slot sanity checks across forks (#4418) * consolidate slot sanity checks across forks * use `new` rather than `init` for constructor of `ref`s
2022-12-13 15:58:59 +00:00
ref ForkedHashedBeaconState =
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
(ref T)(kind: ConsensusFork.Deneb, denebData: deneb.HashedBeaconState(
consolidate slot sanity checks across forks (#4418) * consolidate slot sanity checks across forks * use `new` rather than `init` for constructor of `ref`s
2022-12-13 15:58:59 +00:00
data: data, root: hash_tree_root(data)))
Implement the new Altair req/resp protocols (#2676) * Implement the new Altair req/resp protocols Also fixes the altair message-id computation by providing the correct forkdigest prefix in `isAltairTopic`. Co-authored-by: Tanguy Cizain <tanguycizain@gmail.com>
2021-07-07 09:09:47 +00:00
cleanups and fixes (#2827) * import cleanup * fix json-rpc exception handlers * avoid unnecessary presto client import * introduce ForkedBeaconBlock, some altair logging * url fixes
2021-08-27 09:00:06 +00:00
template init*(T: type ForkedBeaconBlock, blck: phase0.BeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Phase0, phase0Data: blck)
cleanups and fixes (#2827) * import cleanup * fix json-rpc exception handlers * avoid unnecessary presto client import * introduce ForkedBeaconBlock, some altair logging * url fixes
2021-08-27 09:00:06 +00:00
template init*(T: type ForkedBeaconBlock, blck: altair.BeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Altair, altairData: blck)
initial migration from spec/datatypes/{merge => bellatrix} (#3249)
2022-01-06 11:25:35 +00:00
template init*(T: type ForkedBeaconBlock, blck: bellatrix.BeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Bellatrix, bellatrixData: blck)
implement more missing capella functionality (#4344)
2022-11-24 07:53:04 +00:00
template init*(T: type ForkedBeaconBlock, blck: capella.BeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Capella, capellaData: blck)
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
template init*(T: type ForkedBeaconBlock, blck: deneb.BeaconBlock): T =
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
T(kind: ConsensusFork.Deneb, denebData: blck)
cleanups and fixes (#2827) * import cleanup * fix json-rpc exception handlers * avoid unnecessary presto client import * introduce ForkedBeaconBlock, some altair logging * url fixes
2021-08-27 09:00:06 +00:00
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
template init*(T: type ForkedTrustedBeaconBlock, blck: phase0.TrustedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Phase0, phase0Data: blck)
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
template init*(T: type ForkedTrustedBeaconBlock, blck: altair.TrustedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Altair, altairData: blck)
initial migration from spec/datatypes/{merge => bellatrix} (#3249)
2022-01-06 11:25:35 +00:00
template init*(T: type ForkedTrustedBeaconBlock, blck: bellatrix.TrustedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Bellatrix, bellatrixData: blck)
implement more missing capella functionality (#4344)
2022-11-24 07:53:04 +00:00
template init*(T: type ForkedTrustedBeaconBlock, blck: capella.TrustedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Capella, capellaData: blck)
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
template init*(T: type ForkedSignedBeaconBlock, blck: phase0.SignedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Phase0, phase0Data: blck)
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
template init*(T: type ForkedSignedBeaconBlock, blck: altair.SignedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Altair, altairData: blck)
initial migration from spec/datatypes/{merge => bellatrix} (#3249)
2022-01-06 11:25:35 +00:00
template init*(T: type ForkedSignedBeaconBlock, blck: bellatrix.SignedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Bellatrix, bellatrixData: blck)
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
template init*(T: type ForkedSignedBeaconBlock, blck: capella.SignedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Capella, capellaData: blck)
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
template init*(T: type ForkedSignedBeaconBlock, blck: deneb.SignedBeaconBlock): T =
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
T(kind: ConsensusFork.Deneb, denebData: blck)
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
VC: blinded block publishing support (#4332) * Add blind REST API declarations and implementations. * shortLog is still not stable. * Fix shortLog issues. * Enable disabled logging statements. * Address review comments. * Avoid templates suffering from double evaluation of their params * Address review comments. * Fix compilation issue. Co-authored-by: Zahary Karadjov <zahary@status.im>
2022-11-24 09:14:05 +00:00
func init*(T: type ForkedSignedBeaconBlock, forked: ForkedBeaconBlock,
blockRoot: Eth2Digest, signature: ValidatorSig): T =
cleanups and fixes (#2827) * import cleanup * fix json-rpc exception handlers * avoid unnecessary presto client import * introduce ForkedBeaconBlock, some altair logging * url fixes
2021-08-27 09:00:06 +00:00
case forked.kind
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Phase0:
T(kind: ConsensusFork.Phase0,
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
phase0Data: phase0.SignedBeaconBlock(message: forked.phase0Data,
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
root: blockRoot,
signature: signature))
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Altair:
T(kind: ConsensusFork.Altair,
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
altairData: altair.SignedBeaconBlock(message: forked.altairData,
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
root: blockRoot,
signature: signature))
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Bellatrix:
T(kind: ConsensusFork.Bellatrix,
rename mergeData to bellatrixData and mergeFork to bellatrixFork (#3315)
2022-01-24 16:23:13 +00:00
bellatrixData: bellatrix.SignedBeaconBlock(message: forked.bellatrixData,
root: blockRoot,
signature: signature))
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Capella:
T(kind: ConsensusFork.Capella,
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
capellaData: capella.SignedBeaconBlock(message: forked.capellaData,
root: blockRoot,
signature: signature))
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
of ConsensusFork.Deneb:
T(kind: ConsensusFork.Deneb,
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
denebData: deneb.SignedBeaconBlock(message: forked.denebData,
root: blockRoot,
signature: signature))
cleanups and fixes (#2827) * import cleanup * fix json-rpc exception handlers * avoid unnecessary presto client import * introduce ForkedBeaconBlock, some altair logging * url fixes
2021-08-27 09:00:06 +00:00
VC: blinded block publishing support (#4332) * Add blind REST API declarations and implementations. * shortLog is still not stable. * Fix shortLog issues. * Enable disabled logging statements. * Address review comments. * Avoid templates suffering from double evaluation of their params * Address review comments. * Fix compilation issue. Co-authored-by: Zahary Karadjov <zahary@status.im>
2022-11-24 09:14:05 +00:00
func init*(T: type ForkedSignedBlindedBeaconBlock,
forked: ForkedBlindedBeaconBlock, blockRoot: Eth2Digest,
signature: ValidatorSig): T =
case forked.kind
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Phase0:
T(kind: ConsensusFork.Phase0,
VC: blinded block publishing support (#4332) * Add blind REST API declarations and implementations. * shortLog is still not stable. * Fix shortLog issues. * Enable disabled logging statements. * Address review comments. * Avoid templates suffering from double evaluation of their params * Address review comments. * Fix compilation issue. Co-authored-by: Zahary Karadjov <zahary@status.im>
2022-11-24 09:14:05 +00:00
phase0Data: phase0.SignedBeaconBlock(message: forked.phase0Data,
root: blockRoot,
signature: signature))
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Altair:
T(kind: ConsensusFork.Altair,
VC: blinded block publishing support (#4332) * Add blind REST API declarations and implementations. * shortLog is still not stable. * Fix shortLog issues. * Enable disabled logging statements. * Address review comments. * Avoid templates suffering from double evaluation of their params * Address review comments. * Fix compilation issue. Co-authored-by: Zahary Karadjov <zahary@status.im>
2022-11-24 09:14:05 +00:00
altairData: altair.SignedBeaconBlock(message: forked.altairData,
root: blockRoot,
signature: signature))
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Bellatrix:
T(kind: ConsensusFork.Bellatrix,
capella builder API support (#4643) * capella builder API support * use capella EPH when appropriate * fill in ExecutionPayload.withdrawals and sanity-check builder API withdrawals root
2023-02-21 13:21:38 +00:00
bellatrixData: bellatrix_mev.SignedBlindedBeaconBlock(message: forked.bellatrixData,
signature: signature))
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Capella:
T(kind: ConsensusFork.Capella,
capella builder API support (#4643) * capella builder API support * use capella EPH when appropriate * fill in ExecutionPayload.withdrawals and sanity-check builder API withdrawals root
2023-02-21 13:21:38 +00:00
capellaData: capella_mev.SignedBlindedBeaconBlock(message: forked.capellaData,
signature: signature))
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
of ConsensusFork.Deneb:
T(kind: ConsensusFork.Deneb,
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
denebData: capella_mev.SignedBlindedBeaconBlock(message: forked.denebData,
signature: signature))
VC: blinded block publishing support (#4332) * Add blind REST API declarations and implementations. * shortLog is still not stable. * Fix shortLog issues. * Enable disabled logging statements. * Address review comments. * Avoid templates suffering from double evaluation of their params * Address review comments. * Fix compilation issue. Co-authored-by: Zahary Karadjov <zahary@status.im>
2022-11-24 09:14:05 +00:00
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
template init*(T: type ForkedMsgTrustedSignedBeaconBlock, blck: phase0.MsgTrustedSignedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Phase0, phase0Data: blck)
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
template init*(T: type ForkedMsgTrustedSignedBeaconBlock, blck: altair.MsgTrustedSignedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Altair, altairData: blck)
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
template init*(T: type ForkedMsgTrustedSignedBeaconBlock, blck: bellatrix.MsgTrustedSignedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Bellatrix, bellatrixData: blck)
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
template init*(T: type ForkedMsgTrustedSignedBeaconBlock, blck: capella.MsgTrustedSignedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Capella, capellaData: blck)
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
template init*(T: type ForkedMsgTrustedSignedBeaconBlock, blck: deneb.MsgTrustedSignedBeaconBlock): T =
misc local `EIP4844` > `Deneb` bumps (#4717) * misc local `EIP4844` > `Deneb` bumps * fix
2023-03-11 00:28:19 +00:00
T(kind: ConsensusFork.Deneb, denebData: blck)
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
template init*(T: type ForkedTrustedSignedBeaconBlock, blck: phase0.TrustedSignedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Phase0, phase0Data: blck)
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
template init*(T: type ForkedTrustedSignedBeaconBlock, blck: altair.TrustedSignedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Altair, altairData: blck)
initial migration from spec/datatypes/{merge => bellatrix} (#3249)
2022-01-06 11:25:35 +00:00
template init*(T: type ForkedTrustedSignedBeaconBlock, blck: bellatrix.TrustedSignedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Bellatrix, bellatrixData: blck)
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
template init*(T: type ForkedTrustedSignedBeaconBlock, blck: capella.TrustedSignedBeaconBlock): T =
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
T(kind: ConsensusFork.Capella, capellaData: blck)
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
template init*(T: type ForkedTrustedSignedBeaconBlock, blck: deneb.TrustedSignedBeaconBlock): T =
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
T(kind: ConsensusFork.Deneb, denebData: blck)
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
template toString*(kind: ConsensusFork): string =
Add the `execution_optimistic` flag to REST API responses. (#3780) * Initial commit * Make `events` API spec compliant. * Add `Eth-Consensus-Version` in responses. * Bump chronos to get redirect with headers working. * Add `is_optimistic` field and handling to syncing RestSyncInfo.
2022-06-20 05:53:39 +00:00
case kind
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Phase0:
Add the `execution_optimistic` flag to REST API responses. (#3780) * Initial commit * Make `events` API spec compliant. * Add `Eth-Consensus-Version` in responses. * Bump chronos to get redirect with headers working. * Add `is_optimistic` field and handling to syncing RestSyncInfo.
2022-06-20 05:53:39 +00:00
"phase0"
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Altair:
Add the `execution_optimistic` flag to REST API responses. (#3780) * Initial commit * Make `events` API spec compliant. * Add `Eth-Consensus-Version` in responses. * Bump chronos to get redirect with headers working. * Add `is_optimistic` field and handling to syncing RestSyncInfo.
2022-06-20 05:53:39 +00:00
"altair"
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Bellatrix:
Add the `execution_optimistic` flag to REST API responses. (#3780) * Initial commit * Make `events` API spec compliant. * Add `Eth-Consensus-Version` in responses. * Bump chronos to get redirect with headers working. * Add `is_optimistic` field and handling to syncing RestSyncInfo.
2022-06-20 05:53:39 +00:00
"bellatrix"
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Capella:
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
"capella"
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
of ConsensusFork.Deneb:
"deneb"
Add the `execution_optimistic` flag to REST API responses. (#3780) * Initial commit * Make `events` API spec compliant. * Add `Eth-Consensus-Version` in responses. * Bump chronos to get redirect with headers working. * Add `is_optimistic` field and handling to syncing RestSyncInfo.
2022-06-20 05:53:39 +00:00
catch wrong-fork-blocks earlier (#3444) Can't apply a phase0 block to a later phase state and vice versa. Since instantiation has been a topic, pre/post c file size: ``` 424K @mspec@sstate_transition.nim.c 892K @mspec@sstate_transition_block.nim.c ``` ``` 288K @mspec@sstate_transition.nim.c 880K @mspec@sstate_transition_block.nim.c ```
2022-02-28 12:58:34 +00:00
template toFork*[T:
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
phase0.BeaconState |
phase0.HashedBeaconState |
optimistic sync (#3793) * optimistic sync * flag that initially loaded blocks from database might need execution block root filled in * return optimistic status in REST calls * refactor blockslot pruning * ensure beacon_blocks_by_{root,range} do not provide optimistic blocks * handle forkchoice head being pre-merge with block being postmerge * re-enable blocking head updates on validator duties * fix is_optimistic_candidate_block per spec; don't crash with nil future * fix is_optimistic_candidate_block per spec; don't crash with nil future * mark blocks sans execution payloads valid during head update
2022-07-04 20:35:33 +00:00
phase0.BeaconBlock |
catch wrong-fork-blocks earlier (#3444) Can't apply a phase0 block to a later phase state and vice versa. Since instantiation has been a topic, pre/post c file size: ``` 424K @mspec@sstate_transition.nim.c 892K @mspec@sstate_transition_block.nim.c ``` ``` 288K @mspec@sstate_transition.nim.c 880K @mspec@sstate_transition_block.nim.c ```
2022-02-28 12:58:34 +00:00
phase0.SignedBeaconBlock |
optimistic sync (#3793) * optimistic sync * flag that initially loaded blocks from database might need execution block root filled in * return optimistic status in REST calls * refactor blockslot pruning * ensure beacon_blocks_by_{root,range} do not provide optimistic blocks * handle forkchoice head being pre-merge with block being postmerge * re-enable blocking head updates on validator duties * fix is_optimistic_candidate_block per spec; don't crash with nil future * fix is_optimistic_candidate_block per spec; don't crash with nil future * mark blocks sans execution payloads valid during head update
2022-07-04 20:35:33 +00:00
phase0.TrustedBeaconBlock |
`bls_to_execution_changes` check alternative (#4916) Make intent clearer about when to expect `bls_to_execution_changes`, and replace test-time errors with compile-time errors if the field is renamed or goes away in the future.
2023-05-09 17:24:02 +00:00
phase0.BeaconBlockBody |
phase0.SigVerifiedBeaconBlockBody |
phase0.TrustedBeaconBlockBody |
catch wrong-fork-blocks earlier (#3444) Can't apply a phase0 block to a later phase state and vice versa. Since instantiation has been a topic, pre/post c file size: ``` 424K @mspec@sstate_transition.nim.c 892K @mspec@sstate_transition_block.nim.c ``` ``` 288K @mspec@sstate_transition.nim.c 880K @mspec@sstate_transition_block.nim.c ```
2022-02-28 12:58:34 +00:00
phase0.SigVerifiedSignedBeaconBlock |
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
phase0.MsgTrustedSignedBeaconBlock |
catch wrong-fork-blocks earlier (#3444) Can't apply a phase0 block to a later phase state and vice versa. Since instantiation has been a topic, pre/post c file size: ``` 424K @mspec@sstate_transition.nim.c 892K @mspec@sstate_transition_block.nim.c ``` ``` 288K @mspec@sstate_transition.nim.c 880K @mspec@sstate_transition_block.nim.c ```
2022-02-28 12:58:34 +00:00
phase0.TrustedSignedBeaconBlock](
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
t: type T): ConsensusFork =
ConsensusFork.Phase0
extent `BeaconStateFork` enum (#4396)
2022-12-07 16:47:23 +00:00
catch wrong-fork-blocks earlier (#3444) Can't apply a phase0 block to a later phase state and vice versa. Since instantiation has been a topic, pre/post c file size: ``` 424K @mspec@sstate_transition.nim.c 892K @mspec@sstate_transition_block.nim.c ``` ``` 288K @mspec@sstate_transition.nim.c 880K @mspec@sstate_transition_block.nim.c ```
2022-02-28 12:58:34 +00:00
template toFork*[T:
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
altair.BeaconState |
altair.HashedBeaconState |
optimistic sync (#3793) * optimistic sync * flag that initially loaded blocks from database might need execution block root filled in * return optimistic status in REST calls * refactor blockslot pruning * ensure beacon_blocks_by_{root,range} do not provide optimistic blocks * handle forkchoice head being pre-merge with block being postmerge * re-enable blocking head updates on validator duties * fix is_optimistic_candidate_block per spec; don't crash with nil future * fix is_optimistic_candidate_block per spec; don't crash with nil future * mark blocks sans execution payloads valid during head update
2022-07-04 20:35:33 +00:00
altair.BeaconBlock |
catch wrong-fork-blocks earlier (#3444) Can't apply a phase0 block to a later phase state and vice versa. Since instantiation has been a topic, pre/post c file size: ``` 424K @mspec@sstate_transition.nim.c 892K @mspec@sstate_transition_block.nim.c ``` ``` 288K @mspec@sstate_transition.nim.c 880K @mspec@sstate_transition_block.nim.c ```
2022-02-28 12:58:34 +00:00
altair.SignedBeaconBlock |
optimistic sync (#3793) * optimistic sync * flag that initially loaded blocks from database might need execution block root filled in * return optimistic status in REST calls * refactor blockslot pruning * ensure beacon_blocks_by_{root,range} do not provide optimistic blocks * handle forkchoice head being pre-merge with block being postmerge * re-enable blocking head updates on validator duties * fix is_optimistic_candidate_block per spec; don't crash with nil future * fix is_optimistic_candidate_block per spec; don't crash with nil future * mark blocks sans execution payloads valid during head update
2022-07-04 20:35:33 +00:00
altair.TrustedBeaconBlock |
`bls_to_execution_changes` check alternative (#4916) Make intent clearer about when to expect `bls_to_execution_changes`, and replace test-time errors with compile-time errors if the field is renamed or goes away in the future.
2023-05-09 17:24:02 +00:00
altair.BeaconBlockBody |
altair.SigVerifiedBeaconBlockBody |
altair.TrustedBeaconBlockBody |
catch wrong-fork-blocks earlier (#3444) Can't apply a phase0 block to a later phase state and vice versa. Since instantiation has been a topic, pre/post c file size: ``` 424K @mspec@sstate_transition.nim.c 892K @mspec@sstate_transition_block.nim.c ``` ``` 288K @mspec@sstate_transition.nim.c 880K @mspec@sstate_transition_block.nim.c ```
2022-02-28 12:58:34 +00:00
altair.SigVerifiedSignedBeaconBlock |
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
altair.MsgTrustedSignedBeaconBlock |
catch wrong-fork-blocks earlier (#3444) Can't apply a phase0 block to a later phase state and vice versa. Since instantiation has been a topic, pre/post c file size: ``` 424K @mspec@sstate_transition.nim.c 892K @mspec@sstate_transition_block.nim.c ``` ``` 288K @mspec@sstate_transition.nim.c 880K @mspec@sstate_transition_block.nim.c ```
2022-02-28 12:58:34 +00:00
altair.TrustedSignedBeaconBlock](
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
t: type T): ConsensusFork =
ConsensusFork.Altair
extent `BeaconStateFork` enum (#4396)
2022-12-07 16:47:23 +00:00
catch wrong-fork-blocks earlier (#3444) Can't apply a phase0 block to a later phase state and vice versa. Since instantiation has been a topic, pre/post c file size: ``` 424K @mspec@sstate_transition.nim.c 892K @mspec@sstate_transition_block.nim.c ``` ``` 288K @mspec@sstate_transition.nim.c 880K @mspec@sstate_transition_block.nim.c ```
2022-02-28 12:58:34 +00:00
template toFork*[T:
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
bellatrix.BeaconState |
bellatrix.HashedBeaconState |
bump `nim-eth`, extend empty block fallback for EIP4844 (#4425) Implements `emptyPayloadToBlockHeader` for EIP-4844. https://github.com/status-im/nim-eth/pull/570
2022-12-20 19:00:56 +00:00
bellatrix.ExecutionPayload |
Support for driving multiple EL nodes from a single Nimbus BN (#4465) * Support for driving multiple EL nodes from a single Nimbus BN Full list of changes: * Eth1Monitor has been renamed to ELManager to match its current responsibilities better. * The ELManager is no longer optional in the code (it won't have a nil value under any circumstances). * The support for subscribing for headers was removed as it only worked with WebSockets and contributed significant complexity while bringing only a very minor advantage. * The `--web3-url` parameter has been deprecated in favor of a new `--el` parameter. The new parameter has a reasonable default value and supports specifying a different JWT for each connection. Each connection can also be configured with a different set of responsibilities (e.g. download deposits, validate blocks and/or produce blocks). On the command-line, these properties can be configured through URL properties stored in the #anchor part of the URL. In TOML files, they come with a very natural syntax (althrough the URL scheme is also supported). * The previously scattered EL-related state and logic is now moved to `eth1_monitor.nim` (this module will be renamed to `el_manager.nim` in a follow-up commit). State is assigned properly either to the `ELManager` or the to individual `ELConnection` objects where appropriate. The ELManager executes all Engine API requests against all attached EL nodes, in parallel. It compares their results and if there is a disagreement regarding the validity of a certain payload, this is detected and the beacon node is protected from publishing a block with a potential execution layer consensus bug in it. The BN provides metrics per EL node for the number of successful or failed requests for each type Engine API requests. If an EL node goes offline and connectivity is resoted later, we report the problem and the remedy in edge-triggered fashion. * More progress towards implementing Deneb block production in the VC and comparing the value of blocks produced by the EL and the builder API. * Adds a Makefile target for the zhejiang testnet
2023-03-05 01:40:21 +00:00
bellatrix.ExecutionPayloadForSigning |
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
bellatrix.ExecutionPayloadHeader |
optimistic sync (#3793) * optimistic sync * flag that initially loaded blocks from database might need execution block root filled in * return optimistic status in REST calls * refactor blockslot pruning * ensure beacon_blocks_by_{root,range} do not provide optimistic blocks * handle forkchoice head being pre-merge with block being postmerge * re-enable blocking head updates on validator duties * fix is_optimistic_candidate_block per spec; don't crash with nil future * fix is_optimistic_candidate_block per spec; don't crash with nil future * mark blocks sans execution payloads valid during head update
2022-07-04 20:35:33 +00:00
bellatrix.BeaconBlock |
catch wrong-fork-blocks earlier (#3444) Can't apply a phase0 block to a later phase state and vice versa. Since instantiation has been a topic, pre/post c file size: ``` 424K @mspec@sstate_transition.nim.c 892K @mspec@sstate_transition_block.nim.c ``` ``` 288K @mspec@sstate_transition.nim.c 880K @mspec@sstate_transition_block.nim.c ```
2022-02-28 12:58:34 +00:00
bellatrix.SignedBeaconBlock |
optimistic sync (#3793) * optimistic sync * flag that initially loaded blocks from database might need execution block root filled in * return optimistic status in REST calls * refactor blockslot pruning * ensure beacon_blocks_by_{root,range} do not provide optimistic blocks * handle forkchoice head being pre-merge with block being postmerge * re-enable blocking head updates on validator duties * fix is_optimistic_candidate_block per spec; don't crash with nil future * fix is_optimistic_candidate_block per spec; don't crash with nil future * mark blocks sans execution payloads valid during head update
2022-07-04 20:35:33 +00:00
bellatrix.TrustedBeaconBlock |
`bls_to_execution_changes` check alternative (#4916) Make intent clearer about when to expect `bls_to_execution_changes`, and replace test-time errors with compile-time errors if the field is renamed or goes away in the future.
2023-05-09 17:24:02 +00:00
bellatrix.BeaconBlockBody |
bellatrix.SigVerifiedBeaconBlockBody |
bellatrix.TrustedBeaconBlockBody |
catch wrong-fork-blocks earlier (#3444) Can't apply a phase0 block to a later phase state and vice versa. Since instantiation has been a topic, pre/post c file size: ``` 424K @mspec@sstate_transition.nim.c 892K @mspec@sstate_transition_block.nim.c ``` ``` 288K @mspec@sstate_transition.nim.c 880K @mspec@sstate_transition_block.nim.c ```
2022-02-28 12:58:34 +00:00
bellatrix.SigVerifiedSignedBeaconBlock |
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
bellatrix.MsgTrustedSignedBeaconBlock |
catch wrong-fork-blocks earlier (#3444) Can't apply a phase0 block to a later phase state and vice versa. Since instantiation has been a topic, pre/post c file size: ``` 424K @mspec@sstate_transition.nim.c 892K @mspec@sstate_transition_block.nim.c ``` ``` 288K @mspec@sstate_transition.nim.c 880K @mspec@sstate_transition_block.nim.c ```
2022-02-28 12:58:34 +00:00
bellatrix.TrustedSignedBeaconBlock](
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
t: type T): ConsensusFork =
ConsensusFork.Bellatrix
extent `BeaconStateFork` enum (#4396)
2022-12-07 16:47:23 +00:00
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
template toFork*[T:
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
capella.BeaconState |
capella.HashedBeaconState |
bump `nim-eth`, extend empty block fallback for EIP4844 (#4425) Implements `emptyPayloadToBlockHeader` for EIP-4844. https://github.com/status-im/nim-eth/pull/570
2022-12-20 19:00:56 +00:00
capella.ExecutionPayload |
Support for driving multiple EL nodes from a single Nimbus BN (#4465) * Support for driving multiple EL nodes from a single Nimbus BN Full list of changes: * Eth1Monitor has been renamed to ELManager to match its current responsibilities better. * The ELManager is no longer optional in the code (it won't have a nil value under any circumstances). * The support for subscribing for headers was removed as it only worked with WebSockets and contributed significant complexity while bringing only a very minor advantage. * The `--web3-url` parameter has been deprecated in favor of a new `--el` parameter. The new parameter has a reasonable default value and supports specifying a different JWT for each connection. Each connection can also be configured with a different set of responsibilities (e.g. download deposits, validate blocks and/or produce blocks). On the command-line, these properties can be configured through URL properties stored in the #anchor part of the URL. In TOML files, they come with a very natural syntax (althrough the URL scheme is also supported). * The previously scattered EL-related state and logic is now moved to `eth1_monitor.nim` (this module will be renamed to `el_manager.nim` in a follow-up commit). State is assigned properly either to the `ELManager` or the to individual `ELConnection` objects where appropriate. The ELManager executes all Engine API requests against all attached EL nodes, in parallel. It compares their results and if there is a disagreement regarding the validity of a certain payload, this is detected and the beacon node is protected from publishing a block with a potential execution layer consensus bug in it. The BN provides metrics per EL node for the number of successful or failed requests for each type Engine API requests. If an EL node goes offline and connectivity is resoted later, we report the problem and the remedy in edge-triggered fashion. * More progress towards implementing Deneb block production in the VC and comparing the value of blocks produced by the EL and the builder API. * Adds a Makefile target for the zhejiang testnet
2023-03-05 01:40:21 +00:00
capella.ExecutionPayloadForSigning |
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
capella.ExecutionPayloadHeader |
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
capella.BeaconBlock |
capella.SignedBeaconBlock |
capella.TrustedBeaconBlock |
`bls_to_execution_changes` check alternative (#4916) Make intent clearer about when to expect `bls_to_execution_changes`, and replace test-time errors with compile-time errors if the field is renamed or goes away in the future.
2023-05-09 17:24:02 +00:00
capella.BeaconBlockBody |
capella.SigVerifiedBeaconBlockBody |
capella.TrustedBeaconBlockBody |
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
capella.SigVerifiedSignedBeaconBlock |
capella.MsgTrustedSignedBeaconBlock |
capella.TrustedSignedBeaconBlock](
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
t: type T): ConsensusFork =
ConsensusFork.Capella
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
template toFork*[T:
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.BeaconState |
deneb.HashedBeaconState |
deneb.ExecutionPayload |
Support for driving multiple EL nodes from a single Nimbus BN (#4465) * Support for driving multiple EL nodes from a single Nimbus BN Full list of changes: * Eth1Monitor has been renamed to ELManager to match its current responsibilities better. * The ELManager is no longer optional in the code (it won't have a nil value under any circumstances). * The support for subscribing for headers was removed as it only worked with WebSockets and contributed significant complexity while bringing only a very minor advantage. * The `--web3-url` parameter has been deprecated in favor of a new `--el` parameter. The new parameter has a reasonable default value and supports specifying a different JWT for each connection. Each connection can also be configured with a different set of responsibilities (e.g. download deposits, validate blocks and/or produce blocks). On the command-line, these properties can be configured through URL properties stored in the #anchor part of the URL. In TOML files, they come with a very natural syntax (althrough the URL scheme is also supported). * The previously scattered EL-related state and logic is now moved to `eth1_monitor.nim` (this module will be renamed to `el_manager.nim` in a follow-up commit). State is assigned properly either to the `ELManager` or the to individual `ELConnection` objects where appropriate. The ELManager executes all Engine API requests against all attached EL nodes, in parallel. It compares their results and if there is a disagreement regarding the validity of a certain payload, this is detected and the beacon node is protected from publishing a block with a potential execution layer consensus bug in it. The BN provides metrics per EL node for the number of successful or failed requests for each type Engine API requests. If an EL node goes offline and connectivity is resoted later, we report the problem and the remedy in edge-triggered fashion. * More progress towards implementing Deneb block production in the VC and comparing the value of blocks produced by the EL and the builder API. * Adds a Makefile target for the zhejiang testnet
2023-03-05 01:40:21 +00:00
deneb.ExecutionPayloadForSigning |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.ExecutionPayloadHeader |
deneb.BeaconBlock |
deneb.SignedBeaconBlock |
deneb.TrustedBeaconBlock |
`bls_to_execution_changes` check alternative (#4916) Make intent clearer about when to expect `bls_to_execution_changes`, and replace test-time errors with compile-time errors if the field is renamed or goes away in the future.
2023-05-09 17:24:02 +00:00
deneb.BeaconBlockBody |
deneb.SigVerifiedBeaconBlockBody |
deneb.TrustedBeaconBlockBody |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.SigVerifiedSignedBeaconBlock |
deneb.MsgTrustedSignedBeaconBlock |
deneb.TrustedSignedBeaconBlock](
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
t: type T): ConsensusFork =
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
ConsensusFork.Deneb
support Capella LC data format (#4514) Implements the proposed light client data format for Capella: - https://github.com/ethereum/consensus-specs/pull/3151
2023-01-18 14:32:57 +00:00
reward accounting for altair+ (#2981) Similar to the existing `RewardInfo`, this PR adds the infrastructure needed to export epoch processing information from altair+. Because accounting is done somewhat differently, the PR uses a fork-specific object to extrct the information in order to make the cost on the spec side low. * RewardInfo -> EpochInfo, ForkedEpochInfo * use array for computing new sync committee * avoid repeated total active balance computations in block processing * simplify proposer index check * simplify epoch transition tests * pre-compute base increment and reuse in epoch processing, and a few other small optimizations This PR introduces the type and does the heavy lifting in terms of refactoring - the tools that use the accounting will need separate PR:s (as well as refinements to the exportred information)
2021-10-13 14:24:36 +00:00
template init*(T: type ForkedEpochInfo, info: phase0.EpochInfo): T =
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
T(kind: EpochInfoFork.Phase0, phase0Data: info)
reward accounting for altair+ (#2981) Similar to the existing `RewardInfo`, this PR adds the infrastructure needed to export epoch processing information from altair+. Because accounting is done somewhat differently, the PR uses a fork-specific object to extrct the information in order to make the cost on the spec side low. * RewardInfo -> EpochInfo, ForkedEpochInfo * use array for computing new sync committee * avoid repeated total active balance computations in block processing * simplify proposer index check * simplify epoch transition tests * pre-compute base increment and reuse in epoch processing, and a few other small optimizations This PR introduces the type and does the heavy lifting in terms of refactoring - the tools that use the accounting will need separate PR:s (as well as refinements to the exportred information)
2021-10-13 14:24:36 +00:00
template init*(T: type ForkedEpochInfo, info: altair.EpochInfo): T =
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
T(kind: EpochInfoFork.Altair, altairData: info)
reward accounting for altair+ (#2981) Similar to the existing `RewardInfo`, this PR adds the infrastructure needed to export epoch processing information from altair+. Because accounting is done somewhat differently, the PR uses a fork-specific object to extrct the information in order to make the cost on the spec side low. * RewardInfo -> EpochInfo, ForkedEpochInfo * use array for computing new sync committee * avoid repeated total active balance computations in block processing * simplify proposer index check * simplify epoch transition tests * pre-compute base increment and reuse in epoch processing, and a few other small optimizations This PR introduces the type and does the heavy lifting in terms of refactoring - the tools that use the accounting will need separate PR:s (as well as refinements to the exportred information)
2021-10-13 14:24:36 +00:00
simplify state fork access pattern (#2912) * simplify state fork access pattern * fixes * unsafeAddr needs to be dereferenced outside of case for best effect * remove hash_tree_root of ForkedXxx (doesn't make sense) * simplify state transition * fix vc * readd hash_tree_root(forkedbeaconblock) * readd htr(fhbs) as well ...and add some protections to not hash the wrong items elsewhere
2021-09-28 18:08:03 +00:00
template withState*(x: ForkedHashedBeaconState, body: untyped): untyped =
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
case x.kind
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
of ConsensusFork.Deneb:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Deneb
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
template forkyState: untyped {.inject, used.} = x.denebData
extent `BeaconStateFork` enum (#4396)
2022-12-07 16:47:23 +00:00
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Capella:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Capella
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
template forkyState: untyped {.inject, used.} = x.capellaData
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Bellatrix:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Bellatrix
allow accessing withState forky state via `forkyState` (#4026)
2022-08-26 14:14:18 +00:00
template forkyState: untyped {.inject, used.} = x.bellatrixData
simplify state fork access pattern (#2912) * simplify state fork access pattern * fixes * unsafeAddr needs to be dereferenced outside of case for best effect * remove hash_tree_root of ForkedXxx (doesn't make sense) * simplify state transition * fix vc * readd hash_tree_root(forkedbeaconblock) * readd htr(fhbs) as well ...and add some protections to not hash the wrong items elsewhere
2021-09-28 18:08:03 +00:00
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Altair:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Altair
allow accessing withState forky state via `forkyState` (#4026)
2022-08-26 14:14:18 +00:00
template forkyState: untyped {.inject, used.} = x.altairData
simplify state fork access pattern (#2912) * simplify state fork access pattern * fixes * unsafeAddr needs to be dereferenced outside of case for best effect * remove hash_tree_root of ForkedXxx (doesn't make sense) * simplify state transition * fix vc * readd hash_tree_root(forkedbeaconblock) * readd htr(fhbs) as well ...and add some protections to not hash the wrong items elsewhere
2021-09-28 18:08:03 +00:00
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Phase0:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Phase0
allow accessing withState forky state via `forkyState` (#4026)
2022-08-26 14:14:18 +00:00
template forkyState: untyped {.inject, used.} = x.phase0Data
simplify state fork access pattern (#2912) * simplify state fork access pattern * fixes * unsafeAddr needs to be dereferenced outside of case for best effect * remove hash_tree_root of ForkedXxx (doesn't make sense) * simplify state transition * fix vc * readd hash_tree_root(forkedbeaconblock) * readd htr(fhbs) as well ...and add some protections to not hash the wrong items elsewhere
2021-09-28 18:08:03 +00:00
body
use ForkedHashedBeaconState in StateData (#2634) * use ForkedHashedBeaconState in StateData * fix FAR_FUTURE_EPOCH -> slot overflow; almost always use assign() * avoid stack allocation in maybeUpgradeStateToAltair() * create and use dispatch functions for check_attester_slashing(), check_proposer_slashing(), and check_voluntary_exit() * use getStateRoot() instead of various state.data.hbsPhase0.root * remove withStateVars.hashedState(), which doesn't work as a design anymore * introduce spec/datatypes/altair into beacon_chain_db * fix inefficient codegen for getStateField(largeStateField) * state_transition_slots() doesn't either need/use blocks or runtime presets * combine process_slots(HBS)/state_transition_slots(HBS) which differ only in last-slot htr optimization * getStateField(StateData, ...) was replaced by getStateField(ForkedHashedBeaconState, ...) * fix rollback * switch some state_transition(), process_slots, makeTestBlocks(), etc to use ForkedHashedBeaconState * remove state_transition(phase0.HashedBeaconState) * remove process_slots(phase0.HashedBeaconState) * remove state_transition_block(phase0.HashedBeaconState) * remove unused callWithBS(); separate case expression from if statement * switch back from nested-ref-object construction to (ref Foo)(Bar())
2021-06-11 17:51:46 +00:00
handle one of the `ProveField` warnings (#5013) * handle one of the `ProveField` warnings When assigning between `ForkyHashedBeaconState`, suppress `ProveField` warning, as `tgt.kind == src.kind` was already checked, but compiler doesn't understand that (as we only `case tgt.kind`). * Update beacon_chain/spec/forks.nim * Update beacon_chain/spec/forks.nim
2023-06-02 01:25:49 +00:00
template forky(
x: ForkedHashedBeaconState, kind: static ConsensusFork): untyped =
when kind == ConsensusFork.Deneb:
x.denebData
elif kind == ConsensusFork.Capella:
x.capellaData
elif kind == ConsensusFork.Bellatrix:
x.bellatrixData
elif kind == ConsensusFork.Altair:
x.altairData
elif kind == ConsensusFork.Phase0:
x.phase0Data
else:
static: raiseAssert "Unreachable"
reward accounting for altair+ (#2981) Similar to the existing `RewardInfo`, this PR adds the infrastructure needed to export epoch processing information from altair+. Because accounting is done somewhat differently, the PR uses a fork-specific object to extrct the information in order to make the cost on the spec side low. * RewardInfo -> EpochInfo, ForkedEpochInfo * use array for computing new sync committee * avoid repeated total active balance computations in block processing * simplify proposer index check * simplify epoch transition tests * pre-compute base increment and reuse in epoch processing, and a few other small optimizations This PR introduces the type and does the heavy lifting in terms of refactoring - the tools that use the accounting will need separate PR:s (as well as refinements to the exportred information)
2021-10-13 14:24:36 +00:00
template withEpochInfo*(x: ForkedEpochInfo, body: untyped): untyped =
case x.kind
of EpochInfoFork.Phase0:
Precise per-component ETH-denominated rewards tracking This is an alternative take on https://github.com/status-im/nimbus-eth2/pull/3107 that aims for more minimal interventions in the spec modules at the expense of duplicating more of the spec logic in ncli_db.
2021-12-29 02:50:49 +00:00
const infoFork {.inject.} = EpochInfoFork.Phase0
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
template info: untyped {.inject.} = x.phase0Data
reward accounting for altair+ (#2981) Similar to the existing `RewardInfo`, this PR adds the infrastructure needed to export epoch processing information from altair+. Because accounting is done somewhat differently, the PR uses a fork-specific object to extrct the information in order to make the cost on the spec side low. * RewardInfo -> EpochInfo, ForkedEpochInfo * use array for computing new sync committee * avoid repeated total active balance computations in block processing * simplify proposer index check * simplify epoch transition tests * pre-compute base increment and reuse in epoch processing, and a few other small optimizations This PR introduces the type and does the heavy lifting in terms of refactoring - the tools that use the accounting will need separate PR:s (as well as refinements to the exportred information)
2021-10-13 14:24:36 +00:00
body
of EpochInfoFork.Altair:
Precise per-component ETH-denominated rewards tracking This is an alternative take on https://github.com/status-im/nimbus-eth2/pull/3107 that aims for more minimal interventions in the spec modules at the expense of duplicating more of the spec logic in ncli_db.
2021-12-29 02:50:49 +00:00
const infoFork {.inject.} = EpochInfoFork.Altair
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
template info: untyped {.inject.} = x.altairData
reward accounting for altair+ (#2981) Similar to the existing `RewardInfo`, this PR adds the infrastructure needed to export epoch processing information from altair+. Because accounting is done somewhat differently, the PR uses a fork-specific object to extrct the information in order to make the cost on the spec side low. * RewardInfo -> EpochInfo, ForkedEpochInfo * use array for computing new sync committee * avoid repeated total active balance computations in block processing * simplify proposer index check * simplify epoch transition tests * pre-compute base increment and reuse in epoch processing, and a few other small optimizations This PR introduces the type and does the heavy lifting in terms of refactoring - the tools that use the accounting will need separate PR:s (as well as refinements to the exportred information)
2021-10-13 14:24:36 +00:00
body
template withEpochInfo*(
state: phase0.BeaconState, x: var ForkedEpochInfo, body: untyped): untyped =
use safer case object transitions (#4379)
2022-12-01 12:36:44 +00:00
if x.kind != EpochInfoFork.Phase0:
# Rare, should never happen even, so efficiency a non-issue
x = ForkedEpochInfo(kind: EpochInfoFork.Phase0)
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
template info: untyped {.inject.} = x.phase0Data
reward accounting for altair+ (#2981) Similar to the existing `RewardInfo`, this PR adds the infrastructure needed to export epoch processing information from altair+. Because accounting is done somewhat differently, the PR uses a fork-specific object to extrct the information in order to make the cost on the spec side low. * RewardInfo -> EpochInfo, ForkedEpochInfo * use array for computing new sync committee * avoid repeated total active balance computations in block processing * simplify proposer index check * simplify epoch transition tests * pre-compute base increment and reuse in epoch processing, and a few other small optimizations This PR introduces the type and does the heavy lifting in terms of refactoring - the tools that use the accounting will need separate PR:s (as well as refinements to the exportred information)
2021-10-13 14:24:36 +00:00
body
template withEpochInfo*(
extent `BeaconStateFork` enum (#4396)
2022-12-07 16:47:23 +00:00
state: altair.BeaconState | bellatrix.BeaconState | capella.BeaconState |
switch some beacon_chain/spec/ from eip4844.Foo to deneb.Foo (#4642)
2023-02-20 08:45:49 +00:00
deneb.BeaconState,
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
x: var ForkedEpochInfo, body: untyped): untyped =
use safer case object transitions (#4379)
2022-12-01 12:36:44 +00:00
if x.kind != EpochInfoFork.Altair:
# Rare, so efficiency not critical
x = ForkedEpochInfo(kind: EpochInfoFork.Altair)
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
template info: untyped {.inject.} = x.altairData
reward accounting for altair+ (#2981) Similar to the existing `RewardInfo`, this PR adds the infrastructure needed to export epoch processing information from altair+. Because accounting is done somewhat differently, the PR uses a fork-specific object to extrct the information in order to make the cost on the spec side low. * RewardInfo -> EpochInfo, ForkedEpochInfo * use array for computing new sync committee * avoid repeated total active balance computations in block processing * simplify proposer index check * simplify epoch transition tests * pre-compute base increment and reuse in epoch processing, and a few other small optimizations This PR introduces the type and does the heavy lifting in terms of refactoring - the tools that use the accounting will need separate PR:s (as well as refinements to the exportred information)
2021-10-13 14:24:36 +00:00
body
`ProveField` cleanups in `forks` (#5049) * `ProveField` cleanups in `forks` Some more cleanup for `ProveField` warnings in `forks` module. Note that `ProveField` is disabled by default in makefile, but sometimes these pop up when doing a regular `nim c`, and cleaning these may allow enabling the warning in some future. * use syntax that works if passed to multiple args of call
2023-06-12 12:03:59 +00:00
{.push warning[ProveField]:off.}
use ForkedHashedBeaconState in StateData (#2634) * use ForkedHashedBeaconState in StateData * fix FAR_FUTURE_EPOCH -> slot overflow; almost always use assign() * avoid stack allocation in maybeUpgradeStateToAltair() * create and use dispatch functions for check_attester_slashing(), check_proposer_slashing(), and check_voluntary_exit() * use getStateRoot() instead of various state.data.hbsPhase0.root * remove withStateVars.hashedState(), which doesn't work as a design anymore * introduce spec/datatypes/altair into beacon_chain_db * fix inefficient codegen for getStateField(largeStateField) * state_transition_slots() doesn't either need/use blocks or runtime presets * combine process_slots(HBS)/state_transition_slots(HBS) which differ only in last-slot htr optimization * getStateField(StateData, ...) was replaced by getStateField(ForkedHashedBeaconState, ...) * fix rollback * switch some state_transition(), process_slots, makeTestBlocks(), etc to use ForkedHashedBeaconState * remove state_transition(phase0.HashedBeaconState) * remove process_slots(phase0.HashedBeaconState) * remove state_transition_block(phase0.HashedBeaconState) * remove unused callWithBS(); separate case expression from if statement * switch back from nested-ref-object construction to (ref Foo)(Bar())
2021-06-11 17:51:46 +00:00
func assign*(tgt: var ForkedHashedBeaconState, src: ForkedHashedBeaconState) =
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
if tgt.kind == src.kind:
handle one of the `ProveField` warnings (#5013) * handle one of the `ProveField` warnings When assigning between `ForkyHashedBeaconState`, suppress `ProveField` warning, as `tgt.kind == src.kind` was already checked, but compiler doesn't understand that (as we only `case tgt.kind`). * Update beacon_chain/spec/forks.nim * Update beacon_chain/spec/forks.nim
2023-06-02 01:25:49 +00:00
withState(tgt):
`ProveField` cleanups in `forks` (#5049) * `ProveField` cleanups in `forks` Some more cleanup for `ProveField` warnings in `forks` module. Note that `ProveField` is disabled by default in makefile, but sometimes these pop up when doing a regular `nim c`, and cleaning these may allow enabling the warning in some future. * use syntax that works if passed to multiple args of call
2023-06-12 12:03:59 +00:00
template forkyTgt: untyped = forkyState
template forkySrc: untyped = src.forky(consensusFork)
assign(forkyTgt, forkySrc)
use ForkedHashedBeaconState in StateData (#2634) * use ForkedHashedBeaconState in StateData * fix FAR_FUTURE_EPOCH -> slot overflow; almost always use assign() * avoid stack allocation in maybeUpgradeStateToAltair() * create and use dispatch functions for check_attester_slashing(), check_proposer_slashing(), and check_voluntary_exit() * use getStateRoot() instead of various state.data.hbsPhase0.root * remove withStateVars.hashedState(), which doesn't work as a design anymore * introduce spec/datatypes/altair into beacon_chain_db * fix inefficient codegen for getStateField(largeStateField) * state_transition_slots() doesn't either need/use blocks or runtime presets * combine process_slots(HBS)/state_transition_slots(HBS) which differ only in last-slot htr optimization * getStateField(StateData, ...) was replaced by getStateField(ForkedHashedBeaconState, ...) * fix rollback * switch some state_transition(), process_slots, makeTestBlocks(), etc to use ForkedHashedBeaconState * remove state_transition(phase0.HashedBeaconState) * remove process_slots(phase0.HashedBeaconState) * remove state_transition_block(phase0.HashedBeaconState) * remove unused callWithBS(); separate case expression from if statement * switch back from nested-ref-object construction to (ref Foo)(Bar())
2021-06-11 17:51:46 +00:00
else:
# Ensure case object and discriminator get updated simultaneously, even
# with nimOldCaseObjects. This is infrequent.
tgt = src
`ProveField` cleanups in `forks` (#5049) * `ProveField` cleanups in `forks` Some more cleanup for `ProveField` warnings in `forks` module. Note that `ProveField` is disabled by default in makefile, but sometimes these pop up when doing a regular `nim c`, and cleaning these may allow enabling the warning in some future. * use syntax that works if passed to multiple args of call
2023-06-12 12:03:59 +00:00
{.pop.}
use ForkedHashedBeaconState in StateData (#2634) * use ForkedHashedBeaconState in StateData * fix FAR_FUTURE_EPOCH -> slot overflow; almost always use assign() * avoid stack allocation in maybeUpgradeStateToAltair() * create and use dispatch functions for check_attester_slashing(), check_proposer_slashing(), and check_voluntary_exit() * use getStateRoot() instead of various state.data.hbsPhase0.root * remove withStateVars.hashedState(), which doesn't work as a design anymore * introduce spec/datatypes/altair into beacon_chain_db * fix inefficient codegen for getStateField(largeStateField) * state_transition_slots() doesn't either need/use blocks or runtime presets * combine process_slots(HBS)/state_transition_slots(HBS) which differ only in last-slot htr optimization * getStateField(StateData, ...) was replaced by getStateField(ForkedHashedBeaconState, ...) * fix rollback * switch some state_transition(), process_slots, makeTestBlocks(), etc to use ForkedHashedBeaconState * remove state_transition(phase0.HashedBeaconState) * remove process_slots(phase0.HashedBeaconState) * remove state_transition_block(phase0.HashedBeaconState) * remove unused callWithBS(); separate case expression from if statement * switch back from nested-ref-object construction to (ref Foo)(Bar())
2021-06-11 17:51:46 +00:00
simplify state fork access pattern (#2912) * simplify state fork access pattern * fixes * unsafeAddr needs to be dereferenced outside of case for best effect * remove hash_tree_root of ForkedXxx (doesn't make sense) * simplify state transition * fix vc * readd hash_tree_root(forkedbeaconblock) * readd htr(fhbs) as well ...and add some protections to not hash the wrong items elsewhere
2021-09-28 18:08:03 +00:00
template getStateField*(x: ForkedHashedBeaconState, y: untyped): untyped =
improve getStateField compile checks (#2889) The current `getStateField` implementation fails at run-time when called on a post-Altair state. This is improved by replacing the `if` structure with a `case` expression, which is checked for exhaustive coverage at compile time. Care is taken to preserve the `unsafeAddr` optimization.
2021-09-22 20:06:50 +00:00
# The use of `unsafeAddr` avoids excessive copying in certain situations, e.g.,
# ```
Implement all sync committee duties in the validator client (#3583) Other changes: * logtrace can now verify sync committee messages and contributions * Many unnecessary use of pairs() have been removed for consistency * Map 40x BN response codes to BeaconNodeStatus.Incompatible in the VC
2022-05-10 10:03:40 +00:00
# for index, validator in getStateField(stateData.data, validators):
improve getStateField compile checks (#2889) The current `getStateField` implementation fails at run-time when called on a post-Altair state. This is improved by replacing the `if` structure with a `case` expression, which is checked for exhaustive coverage at compile time. Care is taken to preserve the `unsafeAddr` optimization.
2021-09-22 20:06:50 +00:00
# ```
# Without `unsafeAddr`, the `validators` list would be copied to a temporary variable.
`ProveField` cleanups in `forks` (#5049) * `ProveField` cleanups in `forks` Some more cleanup for `ProveField` warnings in `forks` module. Note that `ProveField` is disabled by default in makefile, but sometimes these pop up when doing a regular `nim c`, and cleaning these may allow enabling the warning in some future. * use syntax that works if passed to multiple args of call
2023-06-12 12:03:59 +00:00
(block:
withState(x): unsafeAddr forkyState.data.y)[]
use ForkedHashedBeaconState in StateData (#2634) * use ForkedHashedBeaconState in StateData * fix FAR_FUTURE_EPOCH -> slot overflow; almost always use assign() * avoid stack allocation in maybeUpgradeStateToAltair() * create and use dispatch functions for check_attester_slashing(), check_proposer_slashing(), and check_voluntary_exit() * use getStateRoot() instead of various state.data.hbsPhase0.root * remove withStateVars.hashedState(), which doesn't work as a design anymore * introduce spec/datatypes/altair into beacon_chain_db * fix inefficient codegen for getStateField(largeStateField) * state_transition_slots() doesn't either need/use blocks or runtime presets * combine process_slots(HBS)/state_transition_slots(HBS) which differ only in last-slot htr optimization * getStateField(StateData, ...) was replaced by getStateField(ForkedHashedBeaconState, ...) * fix rollback * switch some state_transition(), process_slots, makeTestBlocks(), etc to use ForkedHashedBeaconState * remove state_transition(phase0.HashedBeaconState) * remove process_slots(phase0.HashedBeaconState) * remove state_transition_block(phase0.HashedBeaconState) * remove unused callWithBS(); separate case expression from if statement * switch back from nested-ref-object construction to (ref Foo)(Bar())
2021-06-11 17:51:46 +00:00
simplify state fork access pattern (#2912) * simplify state fork access pattern * fixes * unsafeAddr needs to be dereferenced outside of case for best effect * remove hash_tree_root of ForkedXxx (doesn't make sense) * simplify state transition * fix vc * readd hash_tree_root(forkedbeaconblock) * readd htr(fhbs) as well ...and add some protections to not hash the wrong items elsewhere
2021-09-28 18:08:03 +00:00
func getStateRoot*(x: ForkedHashedBeaconState): Eth2Digest =
allow accessing withState forky state via `forkyState` (#4026)
2022-08-26 14:14:18 +00:00
withState(x): forkyState.root
implement Altair attestation pool cache init (#2659) * implement Altair attestation pool cache init * remove code duplication around previous/current epoch updates
2021-06-17 17:13:14 +00:00
`ProveField` cleanups in `forks` (#5049) * `ProveField` cleanups in `forks` Some more cleanup for `ProveField` warnings in `forks` module. Note that `ProveField` is disabled by default in makefile, but sometimes these pop up when doing a regular `nim c`, and cleaning these may allow enabling the warning in some future. * use syntax that works if passed to multiple args of call
2023-06-12 12:03:59 +00:00
{.push warning[ProveField]:off.} # https://github.com/nim-lang/Nim/issues/22060
implement Altair attestation pool cache init (#2659) * implement Altair attestation pool cache init * remove code duplication around previous/current epoch updates
2021-06-17 17:13:14 +00:00
func setStateRoot*(x: var ForkedHashedBeaconState, root: Eth2Digest) =
allow accessing withState forky state via `forkyState` (#4026)
2022-08-26 14:14:18 +00:00
withState(x): forkyState.root = root
`ProveField` cleanups in `forks` (#5049) * `ProveField` cleanups in `forks` Some more cleanup for `ProveField` warnings in `forks` module. Note that `ProveField` is disabled by default in makefile, but sometimes these pop up when doing a regular `nim c`, and cleaning these may allow enabling the warning in some future. * use syntax that works if passed to multiple args of call
2023-06-12 12:03:59 +00:00
{.pop.}
cleanups and fixes (#2827) * import cleanup * fix json-rpc exception handlers * avoid unnecessary presto client import * introduce ForkedBeaconBlock, some altair logging * url fixes
2021-08-27 09:00:06 +00:00
rename stateForkAtEpoch to consensusForkAtEpoch (#4627)
2023-02-16 09:32:12 +00:00
func consensusForkAtEpoch*(cfg: RuntimeConfig, epoch: Epoch): ConsensusFork =
abort compile when fork epoch is forgotten (#2939) There are a few locations in the code that compare the current epoch to the various FORK_EPOCH constants and branch off into fork-specific code. When a new fork is introduced, it is sometimes forgotten to update all of those branch locations. This patch introduces a compile-time check that ensures that all branches need to be covered exhaustively. This is done by replacing if-elif structures with case expressions.
2021-10-04 08:31:21 +00:00
## Return the current fork for the given epoch.
static:
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
doAssert high(ConsensusFork) == ConsensusFork.Deneb
doAssert ConsensusFork.Deneb > ConsensusFork.Capella
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
doAssert ConsensusFork.Capella > ConsensusFork.Bellatrix
doAssert ConsensusFork.Bellatrix > ConsensusFork.Altair
doAssert ConsensusFork.Altair > ConsensusFork.Phase0
abort compile when fork epoch is forgotten (#2939) There are a few locations in the code that compare the current epoch to the various FORK_EPOCH constants and branch off into fork-specific code. When a new fork is introduced, it is sometimes forgotten to update all of those branch locations. This patch introduces a compile-time check that ensures that all branches need to be covered exhaustively. This is done by replacing if-elif structures with case expressions.
2021-10-04 08:31:21 +00:00
doAssert GENESIS_EPOCH == 0
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
if epoch >= cfg.DENEB_FORK_EPOCH: ConsensusFork.Deneb
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
elif epoch >= cfg.CAPELLA_FORK_EPOCH: ConsensusFork.Capella
elif epoch >= cfg.BELLATRIX_FORK_EPOCH: ConsensusFork.Bellatrix
elif epoch >= cfg.ALTAIR_FORK_EPOCH: ConsensusFork.Altair
else: ConsensusFork.Phase0
abort compile when fork epoch is forgotten (#2939) There are a few locations in the code that compare the current epoch to the various FORK_EPOCH constants and branch off into fork-specific code. When a new fork is introduced, it is sometimes forgotten to update all of those branch locations. This patch introduces a compile-time check that ensures that all branches need to be covered exhaustively. This is done by replacing if-elif structures with case expressions.
2021-10-04 08:31:21 +00:00
rename `stateForkForDigest` > `consensusForkForDigest` (#4727)
2023-03-11 16:58:48 +00:00
func consensusForkForDigest*(
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
forkDigests: ForkDigests, forkDigest: ForkDigest): Opt[ConsensusFork] =
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
static: doAssert high(ConsensusFork) == ConsensusFork.Deneb
rename `ForkDigests.eip4844` > `ForkDigests.deneb` (#4715)
2023-03-10 17:13:40 +00:00
if forkDigest == forkDigests.deneb:
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
ok ConsensusFork.Deneb
eip4844 fork and epoch transition tests; some eip4844 gossip (#4393)
2022-12-06 16:43:11 +00:00
elif forkDigest == forkDigests.capella:
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
ok ConsensusFork.Capella
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
elif forkDigest == forkDigests.bellatrix:
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
ok ConsensusFork.Bellatrix
update to latest light client libp2p protocol (#3623) Incorporates the latest changes to the light client sync protocol based on Devconnect AMS feedback. Note that this breaks compatibility with the previous prototype, due to changes to data structures and endpoints. See https://github.com/ethereum/consensus-specs/pull/2802
2022-05-23 12:02:54 +00:00
elif forkDigest == forkDigests.altair:
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
ok ConsensusFork.Altair
update to latest light client libp2p protocol (#3623) Incorporates the latest changes to the light client sync protocol based on Devconnect AMS feedback. Note that this breaks compatibility with the previous prototype, due to changes to data structures and endpoints. See https://github.com/ethereum/consensus-specs/pull/2802
2022-05-23 12:02:54 +00:00
elif forkDigest == forkDigests.phase0:
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
ok ConsensusFork.Phase0
update to latest light client libp2p protocol (#3623) Incorporates the latest changes to the light client sync protocol based on Devconnect AMS feedback. Note that this breaks compatibility with the previous prototype, due to changes to data structures and endpoints. See https://github.com/ethereum/consensus-specs/pull/2802
2022-05-23 12:02:54 +00:00
else:
err()
load altair state from database on startup (#2994) * fixes replay from last phase0 block on startup * better forked block loading
2021-10-18 12:32:54 +00:00
rename `(with|at)StateFork` > `(with|at)ConsensusFork` (#4725)
2023-03-11 14:39:29 +00:00
func atConsensusFork*(
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
forkDigests: ForkDigests, consensusFork: ConsensusFork): ForkDigest =
case consensusFork
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
of ConsensusFork.Deneb:
rename `ForkDigests.eip4844` > `ForkDigests.deneb` (#4715)
2023-03-10 17:13:40 +00:00
forkDigests.deneb
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Capella:
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
forkDigests.capella
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Bellatrix:
add light client (standalone) (#3653) Introduces a new library for syncing using libp2p based light client sync protocol, and adds a new `nimbus_light_client` executable that uses this library for syncing. The new executable emits log messages when new beacon block headers are received, and is integrated into testing.
2022-05-31 10:45:37 +00:00
forkDigests.bellatrix
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Altair:
add light client (standalone) (#3653) Introduces a new library for syncing using libp2p based light client sync protocol, and adds a new `nimbus_light_client` executable that uses this library for syncing. The new executable emits log messages when new beacon block headers are received, and is integrated into testing.
2022-05-31 10:45:37 +00:00
forkDigests.altair
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Phase0:
add light client (standalone) (#3653) Introduces a new library for syncing using libp2p based light client sync protocol, and adds a new `nimbus_light_client` executable that uses this library for syncing. The new executable emits log messages when new beacon block headers are received, and is integrated into testing.
2022-05-31 10:45:37 +00:00
forkDigests.phase0
template atEpoch*(
forkDigests: ForkDigests, epoch: Epoch, cfg: RuntimeConfig): ForkDigest =
rename `(with|at)StateFork` > `(with|at)ConsensusFork` (#4725)
2023-03-11 14:39:29 +00:00
forkDigests.atConsensusFork(cfg.consensusForkAtEpoch(epoch))
add light client (standalone) (#3653) Introduces a new library for syncing using libp2p based light client sync protocol, and adds a new `nimbus_light_client` executable that uses this library for syncing. The new executable emits log messages when new beacon block headers are received, and is integrated into testing.
2022-05-31 10:45:37 +00:00
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
template asSigned*(
x: ForkedMsgTrustedSignedBeaconBlock |
reduce LC optsync latency (#4002) The optimistic sync spec was updated since the LC based optsync module was introduced. It is no longer necessary to wait for the justified checkpoint to have execution enabled; instead, any block is okay to be optimistically imported to the EL client, as long as its parent block has execution enabled. Complex syncing logic has been removed, and the LC optsync module will now follow gossip directly, reducing the latency when using this module. Note that because this is now based on gossip instead of using sync manager / request manager, that individual blocks may be missed. However, EL clients should recover from this by fetching missing blocks themselves.
2022-08-25 03:53:59 +00:00
ForkedTrustedSignedBeaconBlock
): ForkedSignedBeaconBlock =
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
isomorphicCast[ForkedSignedBeaconBlock](x)
reduce LC optsync latency (#4002) The optimistic sync spec was updated since the LC based optsync module was introduced. It is no longer necessary to wait for the justified checkpoint to have execution enabled; instead, any block is okay to be optimistically imported to the EL client, as long as its parent block has execution enabled. Complex syncing logic has been removed, and the LC optsync module will now follow gossip directly, reducing the latency when using this module. Note that because this is now based on gossip instead of using sync manager / request manager, that individual blocks may be missed. However, EL clients should recover from this by fetching missing blocks themselves.
2022-08-25 03:53:59 +00:00
template asSigned*(
x: ref ForkedMsgTrustedSignedBeaconBlock |
ref ForkedTrustedSignedBeaconBlock
): ref ForkedSignedBeaconBlock =
isomorphicCast[ref ForkedSignedBeaconBlock](x)
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
template asMsgTrusted*(
x: ForkedSignedBeaconBlock |
reduce LC optsync latency (#4002) The optimistic sync spec was updated since the LC based optsync module was introduced. It is no longer necessary to wait for the justified checkpoint to have execution enabled; instead, any block is okay to be optimistically imported to the EL client, as long as its parent block has execution enabled. Complex syncing logic has been removed, and the LC optsync module will now follow gossip directly, reducing the latency when using this module. Note that because this is now based on gossip instead of using sync manager / request manager, that individual blocks may be missed. However, EL clients should recover from this by fetching missing blocks themselves.
2022-08-25 03:53:59 +00:00
ForkedTrustedSignedBeaconBlock
): ForkedMsgTrustedSignedBeaconBlock =
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
isomorphicCast[ForkedMsgTrustedSignedBeaconBlock](x)
reduce LC optsync latency (#4002) The optimistic sync spec was updated since the LC based optsync module was introduced. It is no longer necessary to wait for the justified checkpoint to have execution enabled; instead, any block is okay to be optimistically imported to the EL client, as long as its parent block has execution enabled. Complex syncing logic has been removed, and the LC optsync module will now follow gossip directly, reducing the latency when using this module. Note that because this is now based on gossip instead of using sync manager / request manager, that individual blocks may be missed. However, EL clients should recover from this by fetching missing blocks themselves.
2022-08-25 03:53:59 +00:00
template asMsgTrusted*(
x: ref ForkedSignedBeaconBlock |
ref ForkedTrustedSignedBeaconBlock
): ref ForkedMsgTrustedSignedBeaconBlock =
isomorphicCast[ref ForkedMsgTrustedSignedBeaconBlock](x)
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
template asTrusted*(
x: ForkedSignedBeaconBlock |
reduce LC optsync latency (#4002) The optimistic sync spec was updated since the LC based optsync module was introduced. It is no longer necessary to wait for the justified checkpoint to have execution enabled; instead, any block is okay to be optimistically imported to the EL client, as long as its parent block has execution enabled. Complex syncing logic has been removed, and the LC optsync module will now follow gossip directly, reducing the latency when using this module. Note that because this is now based on gossip instead of using sync manager / request manager, that individual blocks may be missed. However, EL clients should recover from this by fetching missing blocks themselves.
2022-08-25 03:53:59 +00:00
ForkedMsgTrustedSignedBeaconBlock
): ForkedTrustedSignedBeaconBlock =
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
isomorphicCast[ForkedTrustedSignedBeaconBlock](x)
reduce LC optsync latency (#4002) The optimistic sync spec was updated since the LC based optsync module was introduced. It is no longer necessary to wait for the justified checkpoint to have execution enabled; instead, any block is okay to be optimistically imported to the EL client, as long as its parent block has execution enabled. Complex syncing logic has been removed, and the LC optsync module will now follow gossip directly, reducing the latency when using this module. Note that because this is now based on gossip instead of using sync manager / request manager, that individual blocks may be missed. However, EL clients should recover from this by fetching missing blocks themselves.
2022-08-25 03:53:59 +00:00
template asTrusted*(
x: ref ForkedSignedBeaconBlock |
ref ForkedMsgTrustedSignedBeaconBlock
): ref ForkedTrustedSignedBeaconBlock =
isomorphicCast[ref ForkedTrustedSignedBeaconBlock](x)
allow `withXxx` to access fork-specific fields (#2943) So far, `withState` and `withBlck` templates could only be used to have convenience access to fork-agnostic BeaconState and BeaconBlock fields. This patch: - injects an additional `stateFork` constant that allows to use `when` expressions to also access Altair and Merge-specific fields. - introduces a `withStateAndBlck` template to support operating on both a `BeaconState` and `BeaconBlock` at a time. - makes sync committee related functions Merge aware. - changes a couple if-else trees for forks into case statements so that forgotten future forks are promoted to compile-time errors.
2021-10-06 17:05:06 +00:00
template withBlck*(
Improve the compatibility with various Web3Signer versions and configurations (#3640) * Some Web3Signer versions insist replying with text/plain messages * When reading blocks, the Web3Signer uses upper-case fork identifiers instead of lower-case identifies like the Beacon API.
2022-05-17 16:55:03 +00:00
x: ForkedBeaconBlock | Web3SignerForkedBeaconBlock |
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
ForkedSignedBeaconBlock | ForkedMsgTrustedSignedBeaconBlock |
VC: blinded block publishing support (#4332) * Add blind REST API declarations and implementations. * shortLog is still not stable. * Fix shortLog issues. * Enable disabled logging statements. * Address review comments. * Avoid templates suffering from double evaluation of their params * Address review comments. * Fix compilation issue. Co-authored-by: Zahary Karadjov <zahary@status.im>
2022-11-24 09:14:05 +00:00
ForkedTrustedSignedBeaconBlock | ForkedBlindedBeaconBlock |
ForkedSignedBlindedBeaconBlock,
allow `withXxx` to access fork-specific fields (#2943) So far, `withState` and `withBlck` templates could only be used to have convenience access to fork-agnostic BeaconState and BeaconBlock fields. This patch: - injects an additional `stateFork` constant that allows to use `when` expressions to also access Altair and Merge-specific fields. - introduces a `withStateAndBlck` template to support operating on both a `BeaconState` and `BeaconBlock` at a time. - makes sync committee related functions Merge aware. - changes a couple if-else trees for forks into case statements so that forgotten future forks are promoted to compile-time errors.
2021-10-06 17:05:06 +00:00
body: untyped): untyped =
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
case x.kind
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Phase0:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Phase0
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
template blck: untyped {.inject.} = x.phase0Data
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Altair:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Altair
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
template blck: untyped {.inject.} = x.altairData
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Bellatrix:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Bellatrix
rename mergeData to bellatrixData and mergeFork to bellatrixFork (#3315)
2022-01-24 16:23:13 +00:00
template blck: untyped {.inject.} = x.bellatrixData
implement forked merge state/block support (#2890) * implement forked state/block support * merge support for containsOrphan; import cleanup; 80-column lines * add merge block header operations and slot sanity fixture * add epoch state transition tests; implement is_valid_gas_limit(), is_merge_block(), is_execution_enabled(), and compute_timestamp_at_slot() * implement process_execution_payload() and add merge deposit operations tests * add merge block sanity tests * add merge case to syncCommitteeParticipants * v1.1.0-beta.5 updates * reduce getTestStates-based memory usage; don't try to REST-serialize ExecutionPayload transactions without underlying support * add execution payload tests; switch var to let in tests/official/
2021-09-27 14:22:58 +00:00
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Capella:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Capella
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
template blck: untyped {.inject.} = x.capellaData
body
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
of ConsensusFork.Deneb:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject, used.} = ConsensusFork.Deneb
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
template blck: untyped {.inject.} = x.denebData
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
body
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
simplify state fork access pattern (#2912) * simplify state fork access pattern * fixes * unsafeAddr needs to be dereferenced outside of case for best effect * remove hash_tree_root of ForkedXxx (doesn't make sense) * simplify state transition * fix vc * readd hash_tree_root(forkedbeaconblock) * readd htr(fhbs) as well ...and add some protections to not hash the wrong items elsewhere
2021-09-28 18:08:03 +00:00
func proposer_index*(x: ForkedBeaconBlock): uint64 =
withBlck(x): blck.proposer_index
MEV block proposal (#3883) * MEV validator registration * add nearby canary to detect new beacon chain forks * remove special MEV graffiti * web3signer support * fix trace logging * Nim 1.2 needs raises Defect * use template rather than proc in REST JSON parsing * use --payload-builder-enable and --payload-builder-url * explicitly default MEV to disabled * explicitly empty default value for payload builder URL * revert attestation pool to unstable version
2022-08-01 06:41:47 +00:00
func hash_tree_root*(x: ForkedBeaconBlock | Web3SignerForkedBeaconBlock):
Eth2Digest =
simplify state fork access pattern (#2912) * simplify state fork access pattern * fixes * unsafeAddr needs to be dereferenced outside of case for best effect * remove hash_tree_root of ForkedXxx (doesn't make sense) * simplify state transition * fix vc * readd hash_tree_root(forkedbeaconblock) * readd htr(fhbs) as well ...and add some protections to not hash the wrong items elsewhere
2021-09-28 18:08:03 +00:00
withBlck(x): hash_tree_root(blck)
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
template getForkedBlockField*(
x: ForkedSignedBeaconBlock |
ForkedMsgTrustedSignedBeaconBlock |
ForkedTrustedSignedBeaconBlock,
y: untyped): untyped =
simplify state fork access pattern (#2912) * simplify state fork access pattern * fixes * unsafeAddr needs to be dereferenced outside of case for best effect * remove hash_tree_root of ForkedXxx (doesn't make sense) * simplify state transition * fix vc * readd hash_tree_root(forkedbeaconblock) * readd htr(fhbs) as well ...and add some protections to not hash the wrong items elsewhere
2021-09-28 18:08:03 +00:00
# unsafeAddr avoids a copy of the field in some cases
(case x.kind
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Phase0: unsafeAddr x.phase0Data.message.y
of ConsensusFork.Altair: unsafeAddr x.altairData.message.y
of ConsensusFork.Bellatrix: unsafeAddr x.bellatrixData.message.y
of ConsensusFork.Capella: unsafeAddr x.capellaData.message.y
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
of ConsensusFork.Deneb: unsafeAddr x.denebData.message.y)[]
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
template signature*(x: ForkedSignedBeaconBlock |
VC: blinded block publishing support (#4332) * Add blind REST API declarations and implementations. * shortLog is still not stable. * Fix shortLog issues. * Enable disabled logging statements. * Address review comments. * Avoid templates suffering from double evaluation of their params * Address review comments. * Fix compilation issue. Co-authored-by: Zahary Karadjov <zahary@status.im>
2022-11-24 09:14:05 +00:00
ForkedMsgTrustedSignedBeaconBlock |
ForkedSignedBlindedBeaconBlock): ValidatorSig =
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
withBlck(x): blck.signature
template signature*(x: ForkedTrustedSignedBeaconBlock): TrustedSig =
withBlck(x): blck.signature
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
template root*(x: ForkedSignedBeaconBlock |
ForkedMsgTrustedSignedBeaconBlock |
ForkedTrustedSignedBeaconBlock): Eth2Digest =
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
withBlck(x): blck.root
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
template slot*(x: ForkedSignedBeaconBlock |
ForkedMsgTrustedSignedBeaconBlock |
ForkedTrustedSignedBeaconBlock): Slot =
simplify state fork access pattern (#2912) * simplify state fork access pattern * fixes * unsafeAddr needs to be dereferenced outside of case for best effect * remove hash_tree_root of ForkedXxx (doesn't make sense) * simplify state transition * fix vc * readd hash_tree_root(forkedbeaconblock) * readd htr(fhbs) as well ...and add some protections to not hash the wrong items elsewhere
2021-09-28 18:08:03 +00:00
withBlck(x): blck.message.slot
Implement the new Altair req/resp protocols (#2676) * Implement the new Altair req/resp protocols Also fixes the altair message-id computation by providing the correct forkdigest prefix in `isAltairTopic`. Co-authored-by: Tanguy Cizain <tanguycizain@gmail.com>
2021-07-07 09:09:47 +00:00
VC: blinded block publishing support (#4332) * Add blind REST API declarations and implementations. * shortLog is still not stable. * Fix shortLog issues. * Enable disabled logging statements. * Address review comments. * Avoid templates suffering from double evaluation of their params * Address review comments. * Fix compilation issue. Co-authored-by: Zahary Karadjov <zahary@status.im>
2022-11-24 09:14:05 +00:00
template shortLog*(x: ForkedBeaconBlock | ForkedBlindedBeaconBlock): auto =
cleanups and fixes (#2827) * import cleanup * fix json-rpc exception handlers * avoid unnecessary presto client import * introduce ForkedBeaconBlock, some altair logging * url fixes
2021-08-27 09:00:06 +00:00
withBlck(x): shortLog(blck)
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
template shortLog*(x: ForkedSignedBeaconBlock |
ForkedMsgTrustedSignedBeaconBlock |
VC: blinded block publishing support (#4332) * Add blind REST API declarations and implementations. * shortLog is still not stable. * Fix shortLog issues. * Enable disabled logging statements. * Address review comments. * Avoid templates suffering from double evaluation of their params * Address review comments. * Fix compilation issue. Co-authored-by: Zahary Karadjov <zahary@status.im>
2022-11-24 09:14:05 +00:00
ForkedTrustedSignedBeaconBlock |
ForkedSignedBlindedBeaconBlock): auto =
cleanups and fixes (#2827) * import cleanup * fix json-rpc exception handlers * avoid unnecessary presto client import * introduce ForkedBeaconBlock, some altair logging * url fixes
2021-08-27 09:00:06 +00:00
withBlck(x): shortLog(blck)
Implement the new Altair req/resp protocols (#2676) * Implement the new Altair req/resp protocols Also fixes the altair message-id computation by providing the correct forkdigest prefix in `isAltairTopic`. Co-authored-by: Tanguy Cizain <tanguycizain@gmail.com>
2021-07-07 09:09:47 +00:00
cleanups and fixes (#2827) * import cleanup * fix json-rpc exception handlers * avoid unnecessary presto client import * introduce ForkedBeaconBlock, some altair logging * url fixes
2021-08-27 09:00:06 +00:00
chronicles.formatIt ForkedBeaconBlock: it.shortLog
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
chronicles.formatIt ForkedSignedBeaconBlock: it.shortLog
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
chronicles.formatIt ForkedMsgTrustedSignedBeaconBlock: it.shortLog
use ForkedTrustedSignedBeaconBlock (#2720) * use ForkedTrustedSignedBeaconBlock * remove --subscribe-all-subnets * https://ethereum.github.io/eth2.0-APIs/#/Beacon/getBlock implementation was passing through forked beaconblocks
2021-07-14 12:18:52 +00:00
chronicles.formatIt ForkedTrustedSignedBeaconBlock: it.shortLog
altair topic switching (#2767) * altair topic switching * remove validate{Committee,Validator}IndexOr unused within branch
2021-08-09 12:54:45 +00:00
allow `withXxx` to access fork-specific fields (#2943) So far, `withState` and `withBlck` templates could only be used to have convenience access to fork-agnostic BeaconState and BeaconBlock fields. This patch: - injects an additional `stateFork` constant that allows to use `when` expressions to also access Altair and Merge-specific fields. - introduces a `withStateAndBlck` template to support operating on both a `BeaconState` and `BeaconBlock` at a time. - makes sync committee related functions Merge aware. - changes a couple if-else trees for forks into case statements so that forgotten future forks are promoted to compile-time errors.
2021-10-06 17:05:06 +00:00
template withStateAndBlck*(
s: ForkedHashedBeaconState,
b: ForkedBeaconBlock | ForkedSignedBeaconBlock |
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
ForkedMsgTrustedSignedBeaconBlock |
allow `withXxx` to access fork-specific fields (#2943) So far, `withState` and `withBlck` templates could only be used to have convenience access to fork-agnostic BeaconState and BeaconBlock fields. This patch: - injects an additional `stateFork` constant that allows to use `when` expressions to also access Altair and Merge-specific fields. - introduces a `withStateAndBlck` template to support operating on both a `BeaconState` and `BeaconBlock` at a time. - makes sync committee related functions Merge aware. - changes a couple if-else trees for forks into case statements so that forgotten future forks are promoted to compile-time errors.
2021-10-06 17:05:06 +00:00
ForkedTrustedSignedBeaconBlock,
body: untyped): untyped =
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
case s.kind
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
of ConsensusFork.Deneb:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject.} = ConsensusFork.Deneb
rename most eip4844Data to denebData (#4693)
2023-03-04 22:23:52 +00:00
template forkyState: untyped {.inject.} = s.denebData
template blck: untyped {.inject.} = b.denebData
extent `BeaconStateFork` enum (#4396)
2022-12-07 16:47:23 +00:00
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Capella:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject.} = ConsensusFork.Capella
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
template forkyState: untyped {.inject.} = s.capellaData
template blck: untyped {.inject.} = b.capellaData
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Bellatrix:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject.} = ConsensusFork.Bellatrix
re-enable randao checks (#4187) * re-enable randao checks * use `asSigVerified` consistently * fix spelling * document why state_transition.makeBeaconBlock trusting signatures is safe
2022-09-28 01:15:10 +00:00
template forkyState: untyped {.inject.} = s.bellatrixData
rename mergeData to bellatrixData and mergeFork to bellatrixFork (#3315)
2022-01-24 16:23:13 +00:00
template blck: untyped {.inject.} = b.bellatrixData
allow `withXxx` to access fork-specific fields (#2943) So far, `withState` and `withBlck` templates could only be used to have convenience access to fork-agnostic BeaconState and BeaconBlock fields. This patch: - injects an additional `stateFork` constant that allows to use `when` expressions to also access Altair and Merge-specific fields. - introduces a `withStateAndBlck` template to support operating on both a `BeaconState` and `BeaconBlock` at a time. - makes sync committee related functions Merge aware. - changes a couple if-else trees for forks into case statements so that forgotten future forks are promoted to compile-time errors.
2021-10-06 17:05:06 +00:00
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Altair:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject.} = ConsensusFork.Altair
re-enable randao checks (#4187) * re-enable randao checks * use `asSigVerified` consistently * fix spelling * document why state_transition.makeBeaconBlock trusting signatures is safe
2022-09-28 01:15:10 +00:00
template forkyState: untyped {.inject.} = s.altairData
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
template blck: untyped {.inject.} = b.altairData
allow `withXxx` to access fork-specific fields (#2943) So far, `withState` and `withBlck` templates could only be used to have convenience access to fork-agnostic BeaconState and BeaconBlock fields. This patch: - injects an additional `stateFork` constant that allows to use `when` expressions to also access Altair and Merge-specific fields. - introduces a `withStateAndBlck` template to support operating on both a `BeaconState` and `BeaconBlock` at a time. - makes sync committee related functions Merge aware. - changes a couple if-else trees for forks into case statements so that forgotten future forks are promoted to compile-time errors.
2021-10-06 17:05:06 +00:00
body
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Phase0:
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
const consensusFork {.inject.} = ConsensusFork.Phase0
re-enable randao checks (#4187) * re-enable randao checks * use `asSigVerified` consistently * fix spelling * document why state_transition.makeBeaconBlock trusting signatures is safe
2022-09-28 01:15:10 +00:00
template forkyState: untyped {.inject.} = s.phase0Data
clean up fork enum and field names * single naming strategy * simplify some fork code * simplify forked block production
2021-10-18 16:37:27 +00:00
template blck: untyped {.inject.} = b.phase0Data
allow `withXxx` to access fork-specific fields (#2943) So far, `withState` and `withBlck` templates could only be used to have convenience access to fork-agnostic BeaconState and BeaconBlock fields. This patch: - injects an additional `stateFork` constant that allows to use `when` expressions to also access Altair and Merge-specific fields. - introduces a `withStateAndBlck` template to support operating on both a `BeaconState` and `BeaconBlock` at a time. - makes sync committee related functions Merge aware. - changes a couple if-else trees for forks into case statements so that forgotten future forks are promoted to compile-time errors.
2021-10-06 17:05:06 +00:00
body
add `toBeaconBlockHeader` overload (#3468) Overloads `toBeaconBlockHeader` for `ForkedTrustedSignedBeaconBlock`.
2022-03-07 13:56:43 +00:00
func toBeaconBlockHeader*(
capella builder API support (#4643) * capella builder API support * use capella EPH when appropriate * fill in ExecutionPayload.withdrawals and sanity-check builder API withdrawals root
2023-02-21 13:21:38 +00:00
blck: SomeForkyBeaconBlock | bellatrix_mev.BlindedBeaconBlock |
capella_mev.BlindedBeaconBlock): BeaconBlockHeader =
add `toBeaconBlockHeader` overload (#3468) Overloads `toBeaconBlockHeader` for `ForkedTrustedSignedBeaconBlock`.
2022-03-07 13:56:43 +00:00
## Reduce a given `BeaconBlock` to its `BeaconBlockHeader`.
BeaconBlockHeader(
slot: blck.slot,
proposer_index: blck.proposer_index,
parent_root: blck.parent_root,
state_root: blck.state_root,
body_root: blck.body.hash_tree_root())
template toBeaconBlockHeader*(
blck: SomeForkySignedBeaconBlock): BeaconBlockHeader =
## Reduce a given `SignedBeaconBlock` to its `BeaconBlockHeader`.
blck.message.toBeaconBlockHeader
template toBeaconBlockHeader*(
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
blckParam: ForkedMsgTrustedSignedBeaconBlock |
ForkedTrustedSignedBeaconBlock): BeaconBlockHeader =
## Reduce a given signed beacon block to its `BeaconBlockHeader`.
withBlck(blckParam): blck.toBeaconBlockHeader()
add `toBeaconBlockHeader` overload (#3468) Overloads `toBeaconBlockHeader` for `ForkedTrustedSignedBeaconBlock`.
2022-03-07 13:56:43 +00:00
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
func genesisFork*(cfg: RuntimeConfig): Fork =
Fork(
previous_version: cfg.GENESIS_FORK_VERSION,
current_version: cfg.GENESIS_FORK_VERSION,
epoch: GENESIS_EPOCH)
func altairFork*(cfg: RuntimeConfig): Fork =
Fork(
previous_version: cfg.GENESIS_FORK_VERSION,
current_version: cfg.ALTAIR_FORK_VERSION,
epoch: cfg.ALTAIR_FORK_EPOCH)
rename mergeData to bellatrixData and mergeFork to bellatrixFork (#3315)
2022-01-24 16:23:13 +00:00
func bellatrixFork*(cfg: RuntimeConfig): Fork =
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
Fork(
previous_version: cfg.ALTAIR_FORK_VERSION,
rename MERGE_FORK_VERSION to BELLATRIX_FORK_VERSION
2022-01-20 08:30:33 +00:00
current_version: cfg.BELLATRIX_FORK_VERSION,
rename MERGE_FORK_EPOCH to BELLATRIX_FORK_EPOCH (#3350) * rename MERGE_FORK_EPOCH to BELLATRIX_FORK_EPOCH * fix REST test rules
2022-02-02 13:06:55 +00:00
epoch: cfg.BELLATRIX_FORK_EPOCH)
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
add Capella support to Forked* (#4276) * add Capella support to Forked* * remove cruft * add `OnForkyBlockAdded`
2022-11-02 16:23:30 +00:00
func capellaFork*(cfg: RuntimeConfig): Fork =
Fork(
previous_version: cfg.BELLATRIX_FORK_VERSION,
current_version: cfg.CAPELLA_FORK_VERSION,
epoch: cfg.CAPELLA_FORK_EPOCH)
Capella metadata for Sepolia (#4615) Other changes: Renamed the `EIP_4844_FORK_*` config constants to `DENEB_FORK_*` as this matches the latest spec and it's already used in the official Sepolia config.
2023-02-15 14:44:09 +00:00
func denebFork*(cfg: RuntimeConfig): Fork =
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
Fork(
previous_version: cfg.CAPELLA_FORK_VERSION,
Capella metadata for Sepolia (#4615) Other changes: Renamed the `EIP_4844_FORK_*` config constants to `DENEB_FORK_*` as this matches the latest spec and it's already used in the official Sepolia config.
2023-02-15 14:44:09 +00:00
current_version: cfg.DENEB_FORK_VERSION,
epoch: cfg.DENEB_FORK_EPOCH)
Types and scaffolding for EIP-4844 (#4365) * Types and scaffolding for EIP-4844 This commit adds the EIP-4844 spec types, and fills in scaffolding/boilerplate for the use of these types across the repo. None of the actual EIP-4844 logic is introduced yet. This follows the pattern used by @tersec when introducing Capella (#4276). * use eth2-networks fork * review feedback: add static check EIP4844_FORK_EPOCH == FAR_FUTURE_EPOCH * review feedback: remove EIP4844 from /eth/v1/config/spec response * Cleanup / review feedback * Fix REST test
2022-12-05 16:29:09 +00:00
proc -> func, mainly in spec/state transition and adjecent modules (#3405)
2022-02-17 11:53:55 +00:00
func forkAtEpoch*(cfg: RuntimeConfig, epoch: Epoch): Fork =
rename stateForkAtEpoch to consensusForkAtEpoch (#4627)
2023-02-16 09:32:12 +00:00
case cfg.consensusForkAtEpoch(epoch)
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
of ConsensusFork.Deneb: cfg.denebFork
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Capella: cfg.capellaFork
of ConsensusFork.Bellatrix: cfg.bellatrixFork
of ConsensusFork.Altair: cfg.altairFork
of ConsensusFork.Phase0: cfg.genesisFork
altair topic switching (#2767) * altair topic switching * remove validate{Committee,Validator}IndexOr unused within branch
2021-08-09 12:54:45 +00:00
proc -> func, mainly in spec/state transition and adjecent modules (#3405)
2022-02-17 11:53:55 +00:00
func forkVersionAtEpoch*(cfg: RuntimeConfig, epoch: Epoch): Version =
rename stateForkAtEpoch to consensusForkAtEpoch (#4627)
2023-02-16 09:32:12 +00:00
case cfg.consensusForkAtEpoch(epoch)
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
of ConsensusFork.Deneb: cfg.DENEB_FORK_VERSION
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Capella: cfg.CAPELLA_FORK_VERSION
of ConsensusFork.Bellatrix: cfg.BELLATRIX_FORK_VERSION
of ConsensusFork.Altair: cfg.ALTAIR_FORK_VERSION
of ConsensusFork.Phase0: cfg.GENESIS_FORK_VERSION
altair topic switching (#2767) * altair topic switching * remove validate{Committee,Validator}IndexOr unused within branch
2021-08-09 12:54:45 +00:00
proc -> func, mainly in spec/state transition and adjecent modules (#3405)
2022-02-17 11:53:55 +00:00
func nextForkEpochAtEpoch*(cfg: RuntimeConfig, epoch: Epoch): Epoch =
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
static: doAssert high(ConsensusFork) == ConsensusFork.Deneb
rename stateForkAtEpoch to consensusForkAtEpoch (#4627)
2023-02-16 09:32:12 +00:00
case cfg.consensusForkAtEpoch(epoch)
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
of ConsensusFork.Deneb: FAR_FUTURE_EPOCH
Capella metadata for Sepolia (#4615) Other changes: Renamed the `EIP_4844_FORK_*` config constants to `DENEB_FORK_*` as this matches the latest spec and it's already used in the official Sepolia config.
2023-02-15 14:44:09 +00:00
of ConsensusFork.Capella: cfg.DENEB_FORK_EPOCH
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
of ConsensusFork.Bellatrix: cfg.CAPELLA_FORK_EPOCH
of ConsensusFork.Altair: cfg.BELLATRIX_FORK_EPOCH
of ConsensusFork.Phase0: cfg.ALTAIR_FORK_EPOCH
func forkVersion*(cfg: RuntimeConfig, consensusFork: ConsensusFork): Version =
case consensusFork
of ConsensusFork.Phase0: cfg.GENESIS_FORK_VERSION
of ConsensusFork.Altair: cfg.ALTAIR_FORK_VERSION
of ConsensusFork.Bellatrix: cfg.BELLATRIX_FORK_VERSION
of ConsensusFork.Capella: cfg.CAPELLA_FORK_VERSION
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
of ConsensusFork.Deneb: cfg.DENEB_FORK_VERSION
`BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` (#4560) * `BeaconStateFork/BeaconBlockFork` -> `ConsensusFork` * revert unrelated change * revert unrelated changes * update test summaries
2023-01-28 19:53:41 +00:00
rename `lcDataForkAtStateFork` > `lcDataForkAtConsensusFork` (#4726)
2023-03-11 20:09:21 +00:00
func lcDataForkAtConsensusFork*(
consensusFork: ConsensusFork): LightClientDataFork =
rename `EIP4844` > `Deneb` for light client (#4713) * rename `EIP4844` > `Deneb` for light client * regenerate test logs
2023-03-10 17:16:26 +00:00
static: doAssert LightClientDataFork.high == LightClientDataFork.Deneb
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
if consensusFork >= ConsensusFork.Deneb:
rename `EIP4844` > `Deneb` for light client (#4713) * rename `EIP4844` > `Deneb` for light client * regenerate test logs
2023-03-10 17:16:26 +00:00
LightClientDataFork.Deneb
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
elif consensusFork >= ConsensusFork.Capella:
support Capella LC data format (#4514) Implements the proposed light client data format for Capella: - https://github.com/ethereum/consensus-specs/pull/3151
2023-01-18 14:32:57 +00:00
LightClientDataFork.Capella
rename `stateFork` > `consensusFork` (#4718) Just the variable, not yet `lcDataForkAtStateFork` / `atStateFork`. - Shorten comment in `light_client.nim` to keep line width - Do not rename `stateFork` mention in `runProposalForkchoiceUpdated`. - Do not rename `stateFork` in `getStateField(dag.headState, fork)` Rest is just a mechanical mass replace
2023-03-11 00:35:52 +00:00
elif consensusFork >= ConsensusFork.Altair:
LC data fork cleanup (#4506) Distinguish between those code locations that need to be updated on each light client data format change, and those others that should generally be fine, as long as a valid light client object is processed. The former are tagged with static assert for `LightClientDataFork.high`. The latter are changed to `lcDataFork > LightClientDataFork.None` to indicate that they depend only on presence of any valid object. Also bundled a few minor cleanups and fixes. Also add `Forky` type for `LightClientStore` and minor fixes / cleanups.
2023-01-14 21:19:50 +00:00
LightClientDataFork.Altair
else:
LightClientDataFork.None
eip4844 light client tests; avoid case object out-of-bound array reads (#4404)
2022-12-08 16:21:53 +00:00
func getForkSchedule*(cfg: RuntimeConfig): array[5, Fork] =
Number of REST fixes for Altair. (#2790) * Fix getForkSchedule call. Create cache of all configuration endpoints at node startup. Add prepareJsonResponse() call to create cached responses. Mark all procedures with `raises`. * Add getForkSchedule to VC. Fix getForkSchedule return type for API. More `raises` annotations. Fix VC fork_service.nim. * Use `push raises` instead of inline `raises`. * Improvements for REST API aggregated attestations and attestations processing. * Rename eth2_network.sendXXX procedures to eth2_network.broadcastXXX. Add broadcastBeaconBlock() and broadcastAggregateAndProof(). Fix links to specification in REST API declarations. Add implementation for v2 getStateV2(). Add validator_duties.sendXXX procedures which not only broadcast data, but also validate it. Fix JSON-RPC/REST to use new validator_duties.sendXXX procedures instead of own implementations. * Fix validator_client online nodes count incorrect value. Fix aggregate and proof attestation could be sent too late. * Adding timeout for block wait in attestations processing. Fix compilation errors. * Attempt to debug aggregate and proofs. * Fix Beacon AIP to use `sendAttestation`. Add link comment to produceBlockV2. * Add debug logs before publish operation for blocks, attestations and aggregated attestations. Fix attestations publishing issue. * logging fixes `indexInCommnittee` already logged in attestation Co-authored-by: Jacek Sieka <jacek@status.im>
2021-08-23 10:41:48 +00:00
## This procedure returns list of known and/or scheduled forks.
##
## This procedure is used by HTTP REST framework and validator client.
##
## NOTE: Update this procedure when new fork will be scheduled.
eip4844 light client tests; avoid case object out-of-bound array reads (#4404)
2022-12-08 16:21:53 +00:00
[cfg.genesisFork(), cfg.altairFork(), cfg.bellatrixFork(), cfg.capellaFork(),
Capella metadata for Sepolia (#4615) Other changes: Renamed the `EIP_4844_FORK_*` config constants to `DENEB_FORK_*` as this matches the latest spec and it's already used in the official Sepolia config.
2023-02-15 14:44:09 +00:00
cfg.denebFork()]
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
Support starting from altair (#3054) * Support starting from altair * hide `finalized-checkpoint-` - they are incomplete and usage may cause crashes * remove genesis detection code (broken, obsolete) * enable starting ChainDAG from altair checkpoints - this is a prerequisite for checkpoint sync (TODO: backfill) * tighten checkpoint state conditions * show error when starting from checkpoint with existing database (not supported) * print rest-compatible JSON in ncli/state_sim * altair/merge support in ncli * more altair/merge support in ncli_db * pre-load header to speed up loading * fix forked block decoding
2021-11-10 11:39:08 +00:00
type
# The first few fields of a state, shared across all forks
BeaconStateHeader = object
genesis_time: uint64
genesis_validators_root: Eth2Digest
time: spring cleaning (#3262) Time in the beacon chain is expressed relative to the genesis time - this PR creates a `beacon_time` module that collects helpers and utilities for dealing the time units - the new module does not deal with actual wall time (that's remains in `beacon_clock`). Collecting the time related stuff in one place makes it easier to find, avoids some circular imports and allows more easily identifying the code actually needs wall time to operate. * move genesis-time-related functionality into `spec/beacon_time` * avoid using `chronos.Duration` for time differences - it does not support negative values (such as when something happens earlier than it should) * saturate conversions between `FAR_FUTURE_XXX`, so as to avoid overflows * fix delay reporting in validator client so it uses the expected deadline of the slot, not "closest wall slot" * simplify looping over the slots of an epoch * `compute_start_slot_at_epoch` -> `start_slot` * `compute_epoch_at_slot` -> `epoch` A follow-up PR will (likely) introduce saturating arithmetic for the time units - this is merely code moves, renames and fixing of small bugs.
2022-01-11 10:01:54 +00:00
slot: Slot
Support starting from altair (#3054) * Support starting from altair * hide `finalized-checkpoint-` - they are incomplete and usage may cause crashes * remove genesis detection code (broken, obsolete) * enable starting ChainDAG from altair checkpoints - this is a prerequisite for checkpoint sync (TODO: backfill) * tighten checkpoint state conditions * show error when starting from checkpoint with existing database (not supported) * print rest-compatible JSON in ncli/state_sim * altair/merge support in ncli * more altair/merge support in ncli_db * pre-load header to speed up loading * fix forked block decoding
2021-11-10 11:39:08 +00:00
Allow reindexing to start from an arbitrary state (#4437) When not backfilling all the way to genesis (#4421), it becomes more useful to start rebuilding the historical indices from an arbitrary starting point. To rebuild the index from non-genesis, a state and an unbroken block history is needed - here, we allow loading the state from an era file and recreating the history from there onwards. * speed up partial era state loading
2023-01-03 19:37:09 +00:00
func readSszForkedHashedBeaconState*(
split file loading from parsing in helpers (#5054) * split file loading from parsing in helpers In `readSszForkedHashedBeaconState` and `readRuntimeConfig`, split the part that loads the file from the part that parses the file. The parsing portion can be reused with that, e.g., when loading from the network. * add missing export marker
2023-06-14 19:48:50 +00:00
consensusFork: ConsensusFork, data: openArray[byte]):
Allow reindexing to start from an arbitrary state (#4437) When not backfilling all the way to genesis (#4421), it becomes more useful to start rebuilding the historical indices from an arbitrary starting point. To rebuild the index from non-genesis, a state and an unbroken block history is needed - here, we allow loading the state from an era file and recreating the history from there onwards. * speed up partial era state loading
2023-01-03 19:37:09 +00:00
ForkedHashedBeaconState {.raises: [Defect, SszError].} =
# TODO https://github.com/nim-lang/Nim/issues/19357
split file loading from parsing in helpers (#5054) * split file loading from parsing in helpers In `readSszForkedHashedBeaconState` and `readRuntimeConfig`, split the part that loads the file from the part that parses the file. The parsing portion can be reused with that, e.g., when loading from the network. * add missing export marker
2023-06-14 19:48:50 +00:00
result = ForkedHashedBeaconState(kind: consensusFork)
Allow reindexing to start from an arbitrary state (#4437) When not backfilling all the way to genesis (#4421), it becomes more useful to start rebuilding the historical indices from an arbitrary starting point. To rebuild the index from non-genesis, a state and an unbroken block history is needed - here, we allow loading the state from an era file and recreating the history from there onwards. * speed up partial era state loading
2023-01-03 19:37:09 +00:00
withState(result):
readSszBytes(data, forkyState.data)
forkyState.root = hash_tree_root(forkyState.data)
split file loading from parsing in helpers (#5054) * split file loading from parsing in helpers In `readSszForkedHashedBeaconState` and `readRuntimeConfig`, split the part that loads the file from the part that parses the file. The parsing portion can be reused with that, e.g., when loading from the network. * add missing export marker
2023-06-14 19:48:50 +00:00
template readSszForkedHashedBeaconState*(
cfg: RuntimeConfig, slot: Slot, data: openArray[byte]):
ForkedHashedBeaconState =
cfg.consensusForkAtEpoch(slot.epoch()).readSszForkedHashedBeaconState(data)
Support starting from altair (#3054) * Support starting from altair * hide `finalized-checkpoint-` - they are incomplete and usage may cause crashes * remove genesis detection code (broken, obsolete) * enable starting ChainDAG from altair checkpoints - this is a prerequisite for checkpoint sync (TODO: backfill) * tighten checkpoint state conditions * show error when starting from checkpoint with existing database (not supported) * print rest-compatible JSON in ncli/state_sim * altair/merge support in ncli * more altair/merge support in ncli_db * pre-load header to speed up loading * fix forked block decoding
2021-11-10 11:39:08 +00:00
func readSszForkedHashedBeaconState*(cfg: RuntimeConfig, data: openArray[byte]):
broaden `SszError` catches to `SerializationError` (#5081) `nim-serialization` is tagged with `{.raises:[SerializationError].}` so it is no longer sufficient to catch `SszError` in some situations. `SszError` inherits from `SerializationError`, so broadening the caught exception types can be done now, to enable bumping `nim-serialization`. https://github.com/status-im/nimbus-eth2/pull/5043#issuecomment-1584227993 #5061 is also needed to bump `nim-serialization`.
2023-06-15 16:29:13 +00:00
ForkedHashedBeaconState {.raises: [SerializationError].} =
Allow reindexing to start from an arbitrary state (#4437) When not backfilling all the way to genesis (#4421), it becomes more useful to start rebuilding the historical indices from an arbitrary starting point. To rebuild the index from non-genesis, a state and an unbroken block history is needed - here, we allow loading the state from an era file and recreating the history from there onwards. * speed up partial era state loading
2023-01-03 19:37:09 +00:00
## Read a state picking the right fork by first reading the slot from the byte
## source
Support starting from altair (#3054) * Support starting from altair * hide `finalized-checkpoint-` - they are incomplete and usage may cause crashes * remove genesis detection code (broken, obsolete) * enable starting ChainDAG from altair checkpoints - this is a prerequisite for checkpoint sync (TODO: backfill) * tighten checkpoint state conditions * show error when starting from checkpoint with existing database (not supported) * print rest-compatible JSON in ncli/state_sim * altair/merge support in ncli * more altair/merge support in ncli_db * pre-load header to speed up loading * fix forked block decoding
2021-11-10 11:39:08 +00:00
if data.len() < sizeof(BeaconStateHeader):
raise (ref MalformedSszError)(msg: "Not enough data for BeaconState header")
let header = SSZ.decode(
data.toOpenArray(0, sizeof(BeaconStateHeader) - 1),
BeaconStateHeader)
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
clean up / document init (#3387) * clean up / document init * drop `immutable_validators` data (pre-altair) * document versions where data is first added * avoid needlessly loading genesis block data on startup * add a few more internal database consistency checks * remove duplicate state root lookup on state load * comment
2022-02-16 15:44:04 +00:00
# TODO https://github.com/nim-lang/Nim/issues/19357
Allow reindexing to start from an arbitrary state (#4437) When not backfilling all the way to genesis (#4421), it becomes more useful to start rebuilding the historical indices from an arbitrary starting point. To rebuild the index from non-genesis, a state and an unbroken block history is needed - here, we allow loading the state from an era file and recreating the history from there onwards. * speed up partial era state loading
2023-01-03 19:37:09 +00:00
result = readSszForkedHashedBeaconState(cfg, header.slot, data)
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
Support starting from altair (#3054) * Support starting from altair * hide `finalized-checkpoint-` - they are incomplete and usage may cause crashes * remove genesis detection code (broken, obsolete) * enable starting ChainDAG from altair checkpoints - this is a prerequisite for checkpoint sync (TODO: backfill) * tighten checkpoint state conditions * show error when starting from checkpoint with existing database (not supported) * print rest-compatible JSON in ncli/state_sim * altair/merge support in ncli * more altair/merge support in ncli_db * pre-load header to speed up loading * fix forked block decoding
2021-11-10 11:39:08 +00:00
type
ForkedBeaconBlockHeader = object
message*: uint32 # message offset
signature*: ValidatorSig
slot: Slot # start of BeaconBlock
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
REST JSON support improvements (#3232) * support downloading blocks / states via JSON in addition to SSZ - slow, but needed for infura support - SSZ is still used when server supports it * use common forked block/state reader in REST API * fix stack overflows in REST JSON decoder * fix invalid serialization of `justification_bits` in `/eth/v1/debug/beacon/states` and `/eth/v2/debug/beacon/states` * fix REST client to use `/eth/...` instead of `/api/eth/...`, update "default" urls to expose REST api via `/eth` as well as this is what the standard says - `/api` was added early on based on an example "base url" in the spec that has been removed since * expose Nimbus REST extensions via `/nimbus` in addition to `/api/nimbus` to stay consistent with `/eth` * fix invalid state root when reading states via REST * fix recursive imports in `spec/ssz_codec` * remove usages of `serialization.useCustomSerialization` - fickle
2022-01-06 07:38:40 +00:00
func readSszForkedSignedBeaconBlock*(
Support starting from altair (#3054) * Support starting from altair * hide `finalized-checkpoint-` - they are incomplete and usage may cause crashes * remove genesis detection code (broken, obsolete) * enable starting ChainDAG from altair checkpoints - this is a prerequisite for checkpoint sync (TODO: backfill) * tighten checkpoint state conditions * show error when starting from checkpoint with existing database (not supported) * print rest-compatible JSON in ncli/state_sim * altair/merge support in ncli * more altair/merge support in ncli_db * pre-load header to speed up loading * fix forked block decoding
2021-11-10 11:39:08 +00:00
cfg: RuntimeConfig, data: openArray[byte]):
broaden `SszError` catches to `SerializationError` (#5081) `nim-serialization` is tagged with `{.raises:[SerializationError].}` so it is no longer sufficient to catch `SszError` in some situations. `SszError` inherits from `SerializationError`, so broadening the caught exception types can be done now, to enable bumping `nim-serialization`. https://github.com/status-im/nimbus-eth2/pull/5043#issuecomment-1584227993 #5061 is also needed to bump `nim-serialization`.
2023-06-15 16:29:13 +00:00
ForkedSignedBeaconBlock {.raises: [SerializationError].} =
Support starting from altair (#3054) * Support starting from altair * hide `finalized-checkpoint-` - they are incomplete and usage may cause crashes * remove genesis detection code (broken, obsolete) * enable starting ChainDAG from altair checkpoints - this is a prerequisite for checkpoint sync (TODO: backfill) * tighten checkpoint state conditions * show error when starting from checkpoint with existing database (not supported) * print rest-compatible JSON in ncli/state_sim * altair/merge support in ncli * more altair/merge support in ncli_db * pre-load header to speed up loading * fix forked block decoding
2021-11-10 11:39:08 +00:00
## Helper to read a header from bytes when it's not certain what kind of block
## it is
improve consistency of checkpoint read function (#3178) Makes `readSszForkedTrustedSignedBeaconBlock` consistent with `readSszForkedHashedBeaconState`, adjusting the length check to verify the same type that is used for length computation, and using the same formatting.
2021-12-10 02:41:57 +00:00
if data.len() < sizeof(ForkedBeaconBlockHeader):
Support starting from altair (#3054) * Support starting from altair * hide `finalized-checkpoint-` - they are incomplete and usage may cause crashes * remove genesis detection code (broken, obsolete) * enable starting ChainDAG from altair checkpoints - this is a prerequisite for checkpoint sync (TODO: backfill) * tighten checkpoint state conditions * show error when starting from checkpoint with existing database (not supported) * print rest-compatible JSON in ncli/state_sim * altair/merge support in ncli * more altair/merge support in ncli_db * pre-load header to speed up loading * fix forked block decoding
2021-11-10 11:39:08 +00:00
raise (ref MalformedSszError)(msg: "Not enough data for SignedBeaconBlock header")
let header = SSZ.decode(
data.toOpenArray(0, sizeof(ForkedBeaconBlockHeader) - 1),
ForkedBeaconBlockHeader)
improve consistency of checkpoint read function (#3178) Makes `readSszForkedTrustedSignedBeaconBlock` consistent with `readSszForkedHashedBeaconState`, adjusting the length check to verify the same type that is used for length computation, and using the same formatting.
2021-12-10 02:41:57 +00:00
clean up / document init (#3387) * clean up / document init * drop `immutable_validators` data (pre-altair) * document versions where data is first added * avoid needlessly loading genesis block data on startup * add a few more internal database consistency checks * remove duplicate state root lookup on state load * comment
2022-02-16 15:44:04 +00:00
# TODO https://github.com/nim-lang/Nim/issues/19357
REST JSON support improvements (#3232) * support downloading blocks / states via JSON in addition to SSZ - slow, but needed for infura support - SSZ is still used when server supports it * use common forked block/state reader in REST API * fix stack overflows in REST JSON decoder * fix invalid serialization of `justification_bits` in `/eth/v1/debug/beacon/states` and `/eth/v2/debug/beacon/states` * fix REST client to use `/eth/...` instead of `/api/eth/...`, update "default" urls to expose REST api via `/eth` as well as this is what the standard says - `/api` was added early on based on an example "base url" in the spec that has been removed since * expose Nimbus REST extensions via `/nimbus` in addition to `/api/nimbus` to stay consistent with `/eth` * fix invalid state root when reading states via REST * fix recursive imports in `spec/ssz_codec` * remove usages of `serialization.useCustomSerialization` - fickle
2022-01-06 07:38:40 +00:00
result = ForkedSignedBeaconBlock(
rm blockForkAtEpoch and switch callers to consensusForkAtEpoch (#4634)
2023-02-16 20:16:54 +00:00
kind: cfg.consensusForkAtEpoch(header.slot.epoch()))
Support starting from altair (#3054) * Support starting from altair * hide `finalized-checkpoint-` - they are incomplete and usage may cause crashes * remove genesis detection code (broken, obsolete) * enable starting ChainDAG from altair checkpoints - this is a prerequisite for checkpoint sync (TODO: backfill) * tighten checkpoint state conditions * show error when starting from checkpoint with existing database (not supported) * print rest-compatible JSON in ncli/state_sim * altair/merge support in ncli * more altair/merge support in ncli_db * pre-load header to speed up loading * fix forked block decoding
2021-11-10 11:39:08 +00:00
withBlck(result):
readSszBytes(data, blck)
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
automated v1.4.0-alpha.2 to v1.4.0-alpha.3 consensus spec URL updates (#5065)
2023-06-13 14:03:49 +00:00
# https://github.com/ethereum/consensus-specs/blob/v1.4.0-alpha.3/specs/phase0/beacon-chain.md#compute_fork_data_root
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
func compute_fork_data_root*(current_version: Version,
genesis_validators_root: Eth2Digest): Eth2Digest =
## Return the 32-byte fork data root for the ``current_version`` and
## ``genesis_validators_root``.
## This is used primarily in signature domains to avoid collisions across
## forks/chains.
hash_tree_root(ForkData(
current_version: current_version,
genesis_validators_root: genesis_validators_root
))
automated v1.4.0-alpha.2 to v1.4.0-alpha.3 consensus spec URL updates (#5065)
2023-06-13 14:03:49 +00:00
# https://github.com/ethereum/consensus-specs/blob/v1.4.0-alpha.3/specs/phase0/beacon-chain.md#compute_fork_digest
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
func compute_fork_digest*(current_version: Version,
genesis_validators_root: Eth2Digest): ForkDigest =
## Return the 4-byte fork digest for the ``current_version`` and
## ``genesis_validators_root``.
## This is a digest primarily used for domain separation on the p2p layer.
## 4-bytes suffices for practical separation of forks/chains.
array[4, byte](result)[0..3] =
compute_fork_data_root(
current_version, genesis_validators_root).data.toOpenArray(0, 3)
func init*(T: type ForkDigests,
cfg: RuntimeConfig,
enable `styleCheck:usages` (#3573) Some upstream repos still need fixes, but this gets us close enough that style hints can be enabled by default. In general, "canonical" spellings are preferred even if they violate nep-1 - this applies in particular to spec-related stuff like `genesis_validators_root` which appears throughout the codebase.
2022-04-08 16:22:49 +00:00
genesis_validators_root: Eth2Digest): T =
rename ConsensusFork.EIP4844 to ConsensusFork.Deneb (#4692)
2023-03-04 13:35:39 +00:00
static: doAssert high(ConsensusFork) == ConsensusFork.Deneb
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
T(
phase0:
enable `styleCheck:usages` (#3573) Some upstream repos still need fixes, but this gets us close enough that style hints can be enabled by default. In general, "canonical" spellings are preferred even if they violate nep-1 - this applies in particular to spec-related stuff like `genesis_validators_root` which appears throughout the codebase.
2022-04-08 16:22:49 +00:00
compute_fork_digest(cfg.GENESIS_FORK_VERSION, genesis_validators_root),
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
altair:
enable `styleCheck:usages` (#3573) Some upstream repos still need fixes, but this gets us close enough that style hints can be enabled by default. In general, "canonical" spellings are preferred even if they violate nep-1 - this applies in particular to spec-related stuff like `genesis_validators_root` which appears throughout the codebase.
2022-04-08 16:22:49 +00:00
compute_fork_digest(cfg.ALTAIR_FORK_VERSION, genesis_validators_root),
rename forkDigests.merge to forkDigests.bellatrix (#3245)
2022-01-05 14:24:15 +00:00
bellatrix:
enable `styleCheck:usages` (#3573) Some upstream repos still need fixes, but this gets us close enough that style hints can be enabled by default. In general, "canonical" spellings are preferred even if they violate nep-1 - this applies in particular to spec-related stuff like `genesis_validators_root` which appears throughout the codebase.
2022-04-08 16:22:49 +00:00
compute_fork_digest(cfg.BELLATRIX_FORK_VERSION, genesis_validators_root),
initial Capella support in RuntimeConfig (#3698)
2022-06-03 14:42:40 +00:00
capella:
eip4844 light client tests; avoid case object out-of-bound array reads (#4404)
2022-12-08 16:21:53 +00:00
compute_fork_digest(cfg.CAPELLA_FORK_VERSION, genesis_validators_root),
rename `ForkDigests.eip4844` > `ForkDigests.deneb` (#4715)
2023-03-10 17:13:40 +00:00
deneb:
Capella metadata for Sepolia (#4615) Other changes: Renamed the `EIP_4844_FORK_*` config constants to `DENEB_FORK_*` as this matches the latest spec and it's already used in the official Sepolia config.
2023-02-15 14:44:09 +00:00
compute_fork_digest(cfg.DENEB_FORK_VERSION, genesis_validators_root)
altair fork handling cleanups (#3050) * fix stack overflow crash in REST/debug/getStateV2 * introduce `ForkyXxx` for generic type matching of `Xxx` across branches (SomeHashedBeaconState -> ForkyHashedBeaconState et al) - `Some` is already used for other types of type classes * consolidate function naming in BeaconChainDB, use some generics * import `forks.nim` from other spec modules and move `Forked*` helpers around to resolve circular imports * remove `ForkedBeaconState`, use `ForkedHashedBeaconState` throughout (less data shuffling between the types) * fix several cases of states being stored on stack in tests, causing random failures on some platforms * remove reading json support from ncli - this should be ported to the rest json reading instead (doesn't currently work because stack sizes)
2021-11-05 07:34:34 +00:00
)
move `BlockId` to `spec` (#3511) The spec implicitly talks about the slot of a block in several places, and keeping it readily available is useful in a number of context - might as well put this implicitly refereneced helper in the spec code directly
2022-03-16 15:00:18 +00:00
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
func toBlockId*(header: BeaconBlockHeader): BlockId =
BlockId(root: header.hash_tree_root(), slot: header.slot)
move `BlockId` to `spec` (#3511) The spec implicitly talks about the slot of a block in several places, and keeping it readily available is useful in a number of context - might as well put this implicitly refereneced helper in the spec code directly
2022-03-16 15:00:18 +00:00
func toBlockId*(blck: SomeForkySignedBeaconBlock): BlockId =
BlockId(root: blck.root, slot: blck.message.slot)
keep track of latest blocks for optimistic sync (#3715) When launched with `--light-client-enable` the latest blocks are fetched and optimistic candidate blocks are passed to a callback (log for now). This helps accelerate syncing in the future (optimistic sync).
2022-06-10 14:16:37 +00:00
func toBlockId*(blck: ForkedSignedBeaconBlock |
ForkedMsgTrustedSignedBeaconBlock |
ForkedTrustedSignedBeaconBlock): BlockId =
move `BlockId` to `spec` (#3511) The spec implicitly talks about the slot of a block in several places, and keeping it readily available is useful in a number of context - might as well put this implicitly refereneced helper in the spec code directly
2022-03-16 15:00:18 +00:00
withBlck(blck): BlockId(root: blck.root, slot: blck.message.slot)
era: Capella+ support (fixes #4752) (#4853) Post-Capella, historical roots are computed from historical summaries instead of being directly stored in the beacon state. Slightly messy to pass both lists around - this is done to avoid computing the historical root unnecessarily.
2023-04-24 13:26:28 +00:00
func historical_summaries*(state: ForkedHashedBeaconState):
HashList[HistoricalSummary, Limit HISTORICAL_ROOTS_LIMIT] =
withState(state):
when consensusFork >= ConsensusFork.Capella:
forkyState.data.historical_summaries
else:
HashList[HistoricalSummary, Limit HISTORICAL_ROOTS_LIMIT]()