2bf0df7c7f
add: column support to ENR, Metadata and Request Manager ( #6741 )
...
* add csc to enr and metadata
* add column filtering into RequestManager
* nits
* add comment
* resolved reviews 1
* added local custody column set into RequestManager as a field
* faster lookups with hashsets
* fix regressions, fix other reviews, fix response checking for columns
* simpler fix for hashsets
2024-12-15 11:46:08 +00:00
98a7f446c1
fix: response checking from RequestManager for blobs ( #6755 )
...
* rewrite: response checking from RequestManager for blobs
* clean whitespace
* use a comparator and std instead
* sort incoming blobs by index
* fix list traversal
---------
Co-authored-by: tersec <tersec@users.noreply.github.com>
2024-12-12 16:37:22 +01:00
031d24ff41
taskpools: bump ( #6757 )
...
* taskpools: bump
* better raises effects
* get rid of custom naming
* bump
* oops
* bump stable
2024-12-11 11:12:56 +00:00
f12ceb8c75
Req/Resp domain for columns part 1 ( #6723 )
...
* added column support for req resp domain
* fix
* update links
2024-11-27 05:04:19 +01:00
5579c5234f
automated consensus spec URL updating to v1.5.0-alpha.9 ( #6725 )
2024-11-24 13:16:09 +01:00
710f16f510
use EF consensus spec test vectors v1.5.0-alpha.9 ( #6724 )
2024-11-24 09:47:36 +01:00
ddad30f725
Adopt latest changes to request hash computation ( #6718 )
...
* Adopt latest changes to request hash computation
The `requestType` of empty lists is no longer part of the requests hash.
- https://github.com/ethereum/EIPs/pull/8989
* Avoid nested computeDigest scopes
2024-11-24 07:36:39 +01:00
a157760643
Init Fulu fork ( #6677 )
...
* fulu
* fix ci
* fix ncli
* attempt to fix ci
* fix wss_sim build
* fix vc api
* updated tests
* resolve merge conflicts
* fix tests
* fix check
* attempt to fix minimal test in CI
* addressed reviews
---------
Co-authored-by: tersec <tersec@users.noreply.github.com>
2024-11-13 10:29:14 +07:00
b7ea6a627e
fix some deprecation warnings ( #6702 )
2024-11-04 12:19:43 +01:00
7726f39004
VC: Fix forks management behavior. ( #6698 )
...
* Fix issue "ignore _VERSION configuration value if _EPOCH == FAR_FUTURE_EPOCH".
Add `OptionalForks` constant which should provide default values for _VERSION/_EPOCH.
Fix Fork schedule should update Fork's configuration with _EPOCH values.
* Fix compilation error.
* Add comment why and how `OptionalForks` should be maintained.
2024-11-02 09:59:07 +00:00
c0f7220ab2
rm unused and obsolete produceBlindedBlock client-side infrastructure ( #6697 )
2024-10-31 03:58:44 +00:00
c4d8ae40b0
fix ( #6688 )
2024-10-30 15:16:02 +01:00
18409a69e1
Light forward sync mechanism ( #6515 )
...
* Initial commit.
* Add hybrid syncing.
* Compilation fixes.
* Cast custom event for our purposes.
* Instantiate AsyncEventQueue properly.
* Fix mistype.
* Further research on optimistic updates.
* Fixing circular deps.
* Add backfilling.
* Add block download feature.
* Add block store.
* Update backfill information before storing block.
* Use custom block verifier for backfilling sync.
* Skip signature verification in backfilling.
* Add one more generic reload to storeBackfillBlock().
* Add block verification debugging statements.
* Add more debugging
* Do not use database for backfilling, part 1.
* Fix for stash.
* Stash fixes part 2.
* Prepare for testing.
* Fix assertion.
* Fix post-restart syncing process.
* Update backfill loading log statement.
Use proper backfill slot callback for sync manager.
* Add handling of Duplicates.
* Fix store duration and block backfilled log statements.
* Add proper syncing state log statement.
* Add snappy compression to beaconchain_file.
Format syncing speed properly.
* Add blobs verification.
* Add `slot` number to file structure for easy navigation over stream of compressed objects.
* Change database filename.
* Fix structure size.
* Add more consistency properties.
* Fix checkRepair() issues.
* Preparation to state rebuild process.
* Add plain & compressed size.
* Debugging snappy encode process.
* Add one more debugging line.
* Dump blocks.
* One more filedump.
* Fix chunk corruption code.
* Fix detection issue.
* Some fixes in state rebuilding process.
* Add more clearance steps.
* Move updateHead() back to block_processor.
* Fix compilation issues.
* Make code more async friendly.
* Fix async issues.
Add more information when proposer verification failed.
* Fix 8192 slots issue.
* Fix Future double completion issue.
* Pass updateFlags to some of the core procedures.
* Fix tests.
* Improve initial sync handling mechanism.
* Fix checkStateTransition() performance improvements.
* Add some performance tuning and meters.
* Light client performance tuning.
* Remove debugging statement.
* Use single file descriptor for blockchain file.
* Attempt to fix LC.
* Fix timeleft calculation when untrusted sync backfilling started right after LC block received.
* Workaround for `chronicles` + `results` `error` issue.
Remove some compilation warnings.
Fix `CatchableError` leaks on Windows.
* Address review comments.
* Address review comments part 2.
* Address review comments part 1.
* Rebase and fix the issues.
* Address review comments part 3.
* Add tests and fix some issues in auto-repair mechanism.
* Add tests to all_tests.
* Rename binary test file to pass restrictions.
* Add `bin` extension to excluded list.
Recover binary test data.
* Rename fixture file to .bin again.
* Update AllTests.
* Address review comments part 4.
* Address review comments part 5 and fix tests.
* Address review comments part 6.
* Eliminate foldl and combine from blobs processing.
Add some tests to ensure that checkResponse() also checks for correct order.
* Fix forgotten place.
* Post rebase fixes.
* Add unique slots tests.
* Optimize updateHead() code.
* Add forgotten changes.
* Address review comments on state as argument.
2024-10-30 05:38:53 +00:00
f85521230f
stop checking for irrelevant unsigned wraparound in Electra deposit codepath ( #6683 )
2024-10-28 17:18:01 +01:00
4565c029e1
make Eth2Digest isZero 8x faster ( #6682 )
...
* make Eth2Digest isZero 8x faster
* use staticFor and copyMem
* branchless with or
2024-10-28 05:21:18 +00:00
58a34e00a1
fix inconsistent aggregation bits len in Electra ( #6679 )
2024-10-25 16:04:35 +02:00
5d940b4c1e
Bump nim-eth to 66297c5c0a8c22ec3f16c899e902d79aa00df575 ( #6669 )
2024-10-22 14:15:33 +02:00
250a80eb0c
add gossip validation for dc, and data column quarantine strategy ( #6581 )
...
* add gossip validation for dc
* review 1
* rm callback
* review 2
* added custody columns as a global entity
* alpha 8
* few typosA
2024-10-22 05:19:34 +00:00
6f6de8d9dc
Implement latest EIP-7685 `requestsHash` method ( #6667 )
...
It's now this weird one-off hashing method so that EL can partially
forget in some modules what the data schema is.
2024-10-21 17:09:26 +02:00
2d3614ff69
update to devnet-4-compatible engine API ( #6657 )
2024-10-17 16:53:37 +02:00
bd94c20325
fix migration of `blob_gas_used`/`excess_blob_gas` from Deneb to Electra ( #6655 )
...
`blob_gas_used` and `excess_blob_gas` were reset on fork transition
from Deneb to Electra, which is not according to spec. Fix it.
2024-10-17 00:15:34 +00:00
fcf72a6e8e
VC: Electra fixes. ( #6631 )
...
* Initial commit.
* Add aggregated attestation processing.
* Add missing presets file.
* Fix compilation error.
* Fix post-rebase compilation error.
* Satisfy push raises requirement.
* Fix sync committee duties retrieval process.
* Fix forks configuration management.
* Fix deposits to use new fork configuration scheme.
* Fix /eth/v2/validator/aggregate_attestation implementation.
* Fix RANDAO preparation loop to handle blocks at epoch boundary properly.
* Simplification of RANDAO fix.
* Fix typo.
* Address review comments and fix tests.
* Fix incorrect status codes in REST test.
* Rework attestation and aggregated attestations processing code.
* Address review comments.
* Fill committee_index in RegisteredAttestation construction code.
* Address review comments part 2.
* Address review comments part 3.
* use Deneb fork epoch
* Add transition from Deneb to Electra into CI finalization test.
---------
Co-authored-by: tersec <tersec@users.noreply.github.com>
2024-10-16 17:20:39 +00:00
c4be5f677a
bump nim-eth to `171531fbf1a308c1bf4d2f6b88c6ee6924657437` ( #6645 )
...
- rm Goerli bootnodes
- update Sepolia and Holesky bootnodes
- Fix Authorization fields name to v, r, s
- Add helper for recovering authority
2024-10-15 21:47:17 +00:00
acad28d05b
avoid combining multiple aggregates from same committee ( #6642 )
2024-10-15 06:02:36 +02:00
585deb8f90
use types from `eth/common/eth_types` ( #6614 )
...
* bump nim-eth
* use types from `eth/common/eth_types`
2024-10-14 14:55:56 +00:00
c01cf6601a
attestation and aggregated attestation BN fixes for Electra ( #6641 )
...
* attestation and aggregated attestation BN fixes for Electra
* disable electra transition for this PR
* use cleaned-up verification function everywhere
2024-10-14 14:20:26 +00:00
bc51ba3077
styleCheck tweaks ( #6638 )
2024-10-12 00:51:28 +02:00
5608a803d7
update beacon_validators to be more Nim 2.2-compatible ( #6637 )
2024-10-11 15:39:45 +02:00
181f5f984d
use Deneb genesis for local testnet; add Electra forking support to local tesnet ( #6634 )
...
* use Deneb genesis for local testnet; add Electra forking support to local tesnet
* deneb -> electra in ncli_testnet help
2024-10-10 15:48:05 +00:00
9ba31fb5e6
adjust isomorphicCast to be Nim 2.2-compatible ( #6633 )
2024-10-10 12:23:23 +00:00
3868365ac0
automated consensus spec URL updating to v1.5.0-alpha.8 ( #6617 )
2024-10-09 08:37:35 +02:00
b8a424991d
use EF consensus spec v1.5.0-alpha.8 test vectors ( #6616 )
2024-10-09 04:33:17 +00:00
7990cc2d1c
Ordered trie for trie root computations ( #6610 )
...
Gives a 100x speed boost for this operation which happens during
optimistic sync when computing the block hash.
Co-authored-by: Etan Kissling <etan@nimbus.team>
2024-10-08 22:10:50 +02:00
3f37caa0da
fix deprecated warnings ( #6606 )
2024-10-08 01:54:02 +00:00
5d11c5229b
Add Web3signer electra support ( #6607 )
...
* Add Electra support to nimbus_signing_node.
Add tests.
Annotate nimbus_signing_node with asyncraises.
* Update AllTests.
2024-10-07 23:31:16 +00:00
b370112fe0
some manual updates to EF consensus-specs v1.5.0-alpha.7 URLs ( #6604 )
2024-10-07 12:30:09 +02:00
50eed81dcf
electra BN attestation aggregating ( #6596 )
2024-10-07 07:53:38 +00:00
17d66118e8
automated consensus spec URL updating to v1.5.0-alpha.7 ( #6601 )
2024-10-06 14:03:56 +00:00
9c9f3707a1
use EF consensus spec v1.5.0-alpha.7 test vectors ( #6600 )
2024-10-06 13:15:56 +02:00
8f0d910422
web: bump to new nim-eth types ( #6590 )
2024-10-02 15:26:11 +02:00
b20f1ba8b3
Update nim-eth types ( #6583 )
...
Minimal changes needed for compatiblity with
https://github.com/status-im/nim-eth/pull/733 which aligns core types
with execution spec.
2024-09-29 13:32:55 +02:00
2e64fdfa67
centralize ConsensusFork <=> string handling in spec/forks ( #6587 )
2024-09-28 09:23:45 +02:00
4beb890385
new pool attester slashings endpoint version (V2) for electra ( #6585 )
...
* new pool attester slashings endpoint version (V2) for electra
* formatting
---------
Co-authored-by: Pedro Miranda <pedro.miranda@nimbus.team>
2024-09-28 00:00:26 +00:00
744cc00984
replace default word usage ( #6580 )
...
Co-authored-by: Pedro Miranda <pedro.miranda@nimbus.team>
2024-09-26 19:49:03 +00:00
28b20936e9
add Electra attester slashing gossip support ( #6582 )
2024-09-26 08:11:58 +02:00
daf7f899c2
Attestation API updates for Electra ( #6557 )
...
* new V2 endpoint for beacon getBlockAttestations
* nnew GET endpoint version (V2) for getPoolAttestations
* new POST endpoint version (V2) for submitPoolAttestations
* remove premature ncli tests
* review improvements
* review comments and increased test coverage
* small improvements
* documentation typos
---------
Co-authored-by: Pedro Miranda <pedro.miranda@nimbus.team>
2024-09-25 12:33:58 +00:00
f2d6166099
remove block fork guessing/inference from REST JSON decoding ( #6552 )
...
* remove block fork guessing/inference from REST JSON decoding
* use template to avoid repetitive per-fork code
* consolidate RestPublishedSignedBeaconBlock and RestPublishedSignedBlockContents parsing fork handling
2024-09-25 02:58:53 +00:00
31b5c3e30e
add: inclusion proof and dc sidecar verification ( #6577 )
...
* add: inclusion proof and dc sidecar verification
* review 1
2024-09-24 14:46:05 +02:00
d4e441e694
add Electra attester slashing pool ( #6579 )
2024-09-24 11:01:40 +02:00
77e835153c
Bump nimcrypto to fix nim22 issues. ( #6578 )
...
* Bump nimcrypto to fix nim22 issues.
* Fix compilation issue.
2024-09-24 02:55:16 +00:00
Agnish Ghosh
Jacek Sieka
tersec
Etan Kissling
Eugene Kabanov
andri lim
Miran
Pedro Miranda