5985ed0d2d
Merge branch 'feat_eip-7688' into pureth
2024-12-04 15:44:58 +01:00
cf9dc4a79b
Merge branch 'dev/etan/df-forkedblobs' into feat_eip-7688
2024-12-04 14:18:18 +01:00
13df492133
Merge branch 'stable' into dev/etan/df-forkedblobs
2024-12-03 14:38:06 +01:00
5579c5234f
automated consensus spec URL updating to v1.5.0-alpha.9 ( #6725 )
2024-11-24 13:16:09 +01:00
a157760643
Init Fulu fork ( #6677 )
...
* fulu
* fix ci
* fix ncli
* attempt to fix ci
* fix wss_sim build
* fix vc api
* updated tests
* resolve merge conflicts
* fix tests
* fix check
* attempt to fix minimal test in CI
* addressed reviews
---------
Co-authored-by: tersec <tersec@users.noreply.github.com>
2024-11-13 10:29:14 +07:00
18409a69e1
Light forward sync mechanism ( #6515 )
...
* Initial commit.
* Add hybrid syncing.
* Compilation fixes.
* Cast custom event for our purposes.
* Instantiate AsyncEventQueue properly.
* Fix mistype.
* Further research on optimistic updates.
* Fixing circular deps.
* Add backfilling.
* Add block download feature.
* Add block store.
* Update backfill information before storing block.
* Use custom block verifier for backfilling sync.
* Skip signature verification in backfilling.
* Add one more generic reload to storeBackfillBlock().
* Add block verification debugging statements.
* Add more debugging
* Do not use database for backfilling, part 1.
* Fix for stash.
* Stash fixes part 2.
* Prepare for testing.
* Fix assertion.
* Fix post-restart syncing process.
* Update backfill loading log statement.
Use proper backfill slot callback for sync manager.
* Add handling of Duplicates.
* Fix store duration and block backfilled log statements.
* Add proper syncing state log statement.
* Add snappy compression to beaconchain_file.
Format syncing speed properly.
* Add blobs verification.
* Add `slot` number to file structure for easy navigation over stream of compressed objects.
* Change database filename.
* Fix structure size.
* Add more consistency properties.
* Fix checkRepair() issues.
* Preparation to state rebuild process.
* Add plain & compressed size.
* Debugging snappy encode process.
* Add one more debugging line.
* Dump blocks.
* One more filedump.
* Fix chunk corruption code.
* Fix detection issue.
* Some fixes in state rebuilding process.
* Add more clearance steps.
* Move updateHead() back to block_processor.
* Fix compilation issues.
* Make code more async friendly.
* Fix async issues.
Add more information when proposer verification failed.
* Fix 8192 slots issue.
* Fix Future double completion issue.
* Pass updateFlags to some of the core procedures.
* Fix tests.
* Improve initial sync handling mechanism.
* Fix checkStateTransition() performance improvements.
* Add some performance tuning and meters.
* Light client performance tuning.
* Remove debugging statement.
* Use single file descriptor for blockchain file.
* Attempt to fix LC.
* Fix timeleft calculation when untrusted sync backfilling started right after LC block received.
* Workaround for `chronicles` + `results` `error` issue.
Remove some compilation warnings.
Fix `CatchableError` leaks on Windows.
* Address review comments.
* Address review comments part 2.
* Address review comments part 1.
* Rebase and fix the issues.
* Address review comments part 3.
* Add tests and fix some issues in auto-repair mechanism.
* Add tests to all_tests.
* Rename binary test file to pass restrictions.
* Add `bin` extension to excluded list.
Recover binary test data.
* Rename fixture file to .bin again.
* Update AllTests.
* Address review comments part 4.
* Address review comments part 5 and fix tests.
* Address review comments part 6.
* Eliminate foldl and combine from blobs processing.
Add some tests to ensure that checkResponse() also checks for correct order.
* Fix forgotten place.
* Post rebase fixes.
* Add unique slots tests.
* Optimize updateHead() code.
* Add forgotten changes.
* Address review comments on state as argument.
2024-10-30 05:38:53 +00:00
a3d4a3ee5e
BN: Fix el_manager timeouts issue in block processing. ( #6665 )
...
* Fix el_manager + block_processor NEWPAYLOAD_TIMEOUT timeouts issue.
Use predefined array of exponential timeouts when all the requests to EL has been failed.
* Increase timeout value to (next_slot.start_time - 1.second)
* Address review comments.
* Do not repeat requests when node is optimistically synced.
2024-10-23 00:42:46 +00:00
250a80eb0c
add gossip validation for dc, and data column quarantine strategy ( #6581 )
...
* add gossip validation for dc
* review 1
* rm callback
* review 2
* added custody columns as a global entity
* alpha 8
* few typosA
2024-10-22 05:19:34 +00:00
6f6de8d9dc
Implement latest EIP-7685 `requestsHash` method ( #6667 )
...
It's now this weird one-off hashing method so that EL can partially
forget in some modules what the data schema is.
2024-10-21 17:09:26 +02:00
7e5338deb3
disable optimistic Electra EL block hash verification ( #6664 )
2024-10-21 05:09:33 +02:00
2fc2ecbfe0
Merge branch 'feat_eip-7688' into fusaka-light
2024-10-13 18:37:44 +02:00
91f47a382d
Merge branch 'dev/etan/df-forkedblobs' into feat_eip-7688
2024-10-11 15:52:10 +02:00
5608a803d7
update beacon_validators to be more Nim 2.2-compatible ( #6637 )
2024-10-11 15:39:45 +02:00
a6311884d1
Merge branch 'unstable' into dev/etan/df-forkedblobs
2024-10-10 00:55:37 +02:00
3868365ac0
automated consensus spec URL updating to v1.5.0-alpha.8 ( #6617 )
2024-10-09 08:37:35 +02:00
b370112fe0
some manual updates to EF consensus-specs v1.5.0-alpha.7 URLs ( #6604 )
2024-10-07 12:30:09 +02:00
17d66118e8
automated consensus spec URL updating to v1.5.0-alpha.7 ( #6601 )
2024-10-06 14:03:56 +00:00
d976a9313e
Merge branch 'stable' into dev/etan/df-forkedblobs
2024-10-04 16:14:58 +02:00
28b20936e9
add Electra attester slashing gossip support ( #6582 )
2024-09-26 08:11:58 +02:00
d4e441e694
add Electra attester slashing pool ( #6579 )
2024-09-24 11:01:40 +02:00
4ed4bf7d88
Merge branch 'feat_eip-7688' into fusaka-light
2024-09-21 17:09:42 +02:00
af75741f2a
Merge branch 'unstable' into feat_eip-7688
2024-09-21 14:44:53 +02:00
ff9d32d30d
some v1.5.0-alpha.6 consensus spec URL updates ( #6572 )
2024-09-21 06:53:34 +02:00
256f6b8b89
automated consensus spec URL updating to v1.5.0-alpha.6 ( #6571 )
2024-09-21 03:22:41 +02:00
16c21e1c1e
rm unused code/type conversoins; re-enable Electra block gossip verification ( #6545 )
2024-09-12 11:11:08 +02:00
5a44e39e31
bump nim-kzg4844, enable ckzg2.0.0, fix whatever needed ( #6502 )
2024-09-02 11:47:00 +00:00
dcb268e307
Merge branch 'feat_eip-7688' into feat_eip-6493
2024-09-01 16:34:50 +02:00
7ac4756e73
Merge branch 'dev/etan/df-forkedblobs' into feat_eip-7688
2024-09-01 15:48:31 +02:00
18af8dcd9f
Merge branch 'stable' into dev/etan/df-forkedblobs
2024-08-30 14:54:33 +02:00
8c2e8f2b0f
some v1.5.0-alpha.5 consensus spec URL updates ( #6509 )
2024-08-23 12:43:54 +02:00
a597fe95fa
check blob versioned hashes when no EL is connected ( #6501 )
...
* check blob versioned hashes when no EL is connected
When no EL is conencted, we have to at the very least ensure that the
data in the beacon block is consistent with the execution payload.
We already do this for the block hash, but also have to do it for the
`blob_kzg_commitments`. To validate that they are linked with the
execution payload, we have to RLP decode all EIP-4844 blob transactions
and compare their blob versioned hashes with the hashed commitments.
* simplify loop in case where `blob_versioned_hashes` doesn't exist
* skip blob transaction parsing pre Deneb
2024-08-22 06:04:03 +00:00
21aeeaf561
automated consensus spec URL updating to v1.5.0-alpha.5 ( #6504 )
2024-08-21 14:25:19 +02:00
b511f3eeb7
Use Pippenger multiplication for combining multiple sigs of same msg ( #6484 )
...
Newer `blst` releases expose multiscalar Pippenger multiplication that
allows accelerated verification of signatures pertaining to same msg.
- https://gist.github.com/wemeetagain/d52fc4b077f80db6e423935244c2afb2
2024-08-16 23:42:46 +02:00
6f7c4fffe7
Synchronously check all `transactions` to have non-zero length ( #6491 )
...
Reject blocks with zero length transactions early when no EL connected.
- https://github.com/ethereum/consensus-specs/pull/3885
2024-08-16 22:52:35 +02:00
904318cf83
automated consensus spec URL updating to v1.5.0-alpha.4 ( #6483 )
2024-08-09 18:24:49 +02:00
ea16edd886
add test for shuffled attestation signatures ( #6459 )
...
Followup of #3212 to test proper signature verification. Also document
possible further optimization based on blst `v0.3.13`.
2024-07-26 23:31:05 +00:00
6e80561080
Electra `BlobSidecar` for EIP-7688
2024-07-26 04:03:42 +02:00
97117eb769
add Nim bug reference
2024-07-26 01:54:59 +02:00
f9624b5e69
`eth2_processor` fix
2024-07-26 01:38:02 +02:00
c2d5a55d95
cleanup pre-deneb fallback
2024-07-26 00:03:47 +02:00
7d24e43080
`valueOr` needs explicit fork for default value as well
2024-07-25 22:27:35 +02:00
5df441d936
`ForkyBlobSidecar` in gossip validation
2024-07-25 22:09:24 +02:00
88bdc6ae55
`Opt[Forky]` does not work as it does in `ref` and `seq` / `openArray`
2024-07-25 21:59:49 +02:00
5e582cff8f
guard deneb specific ref in workaround
2024-07-25 21:59:15 +02:00
d028baea2a
introduce `ForkedBlobSidecar` for EIP-7688 Electra period before PeerDAS
...
On `ELECTRA_FORK_EPOCH`, PeerDAS is not yet activated, hence the current
mechanism based on `BlobSidecar` is still in use. With EIP-7688, the
generalized indices of `BeaconBlockBody` get reindexed, changing the
length of the inclusion proof within the `BlobSidecar`. Because network
Req/Resp operations allow responses across fork boundaries, this creates
the need for a `ForkedBlobSidecar` in that layer, same as already done
for `ForkedSignedBeaconBock` for similar reasons.
Note: This PR is only needed if PeerDAS is adopted _after_ EIP-7688.
If PeerDAS is adopted _before_ EIP-7688, a similar PR may be needed for
forked columns. Coincidental `Forked` jank can only be fully avoided if
both features activate at the same epoch, actual changes to blobs aside.
Delaying EIP-7688 for sole purpose of epoch alignemnt is not worth it.
2024-07-25 18:54:38 +02:00
9f21182646
construct info object for `BlobSidecar` earlier ( #6445 )
...
To avoid "forked" types creeping into `BlobSidecar`, move the reduction
to `BlobSidecarInfoObject` to the sole caller. The info object is fork
agnostic, so does not need "forked" if `BlobSidecar` ever updates.
2024-07-23 20:22:29 +00:00
7f59e80aaa
validate EL block hash in Electra when no EL is connected ( #6407 )
...
When no EL is connected, it is still required to validate the block hash
of `ExecutionPayload` to prevent attacks that trick us into attesting to
a circular chain with invalid in-between block hashes. This is already
done through Deneb but was still missing in Electra to be rectified now.
2024-07-05 10:18:50 +02:00
84a35c85c5
Fix for gcc-14 issues in kzg-4844. ( #6403 )
...
* Bump nim-kzg4844.
* Fix code to use proper KZG types.
* Add missing coma.
* Fix compilation issue.
* Bump nim-kzg4844.
* Add debugging output.
* Remove debugging output.
* Restore groupBlobs function.
2024-07-03 10:01:33 +00:00
13e766d4df
add database electra block tests ( #6394 )
2024-07-01 04:18:41 +00:00
9924aec1e3
extend light client protocol for Electra ( #6375 )
...
* extend light client protocol for Electra
Add missing Electra support for light client protocol:
- https://github.com/ethereum/consensus-specs/pull/3811
Tested against PR consensus-spec-tests, the test runner automatically
picks up the new tests once available.
* workaround `version-2-0`: `Error: cannot instantiate: 'SomeUnsignedInt'`
* fix initialization when Electra not scheduled
* try reduce stack size in test
* put correct sync committee branch version into DB
* adjust fork schedule in light client data tests
* further reduce stack size
* split function into multiple parts
* rename variable
* regenerate test reports to cover new Electra tests
* add Nim bug reference
2024-06-26 19:02:03 +00:00
Etan Kissling
tersec
Agnish Ghosh
Eugene Kabanov
Etan Kissling