225ef5e69a
partially revert https://github.com/status-im/nimbus-eth2/pull/5765 ( #5833 )
2024-01-28 23:45:52 +01:00
6cd37f7a47
reduce log level on unexpected errors in network ( #5822 )
2024-01-24 18:23:12 +02:00
4fd3177dab
clean up UnusedImport and Deprecated warnings ( #5813 )
2024-01-22 17:35:19 +01:00
6328c77778
raises for gossip ( #5808 )
...
* raises for gossip
* fix light client
2024-01-22 17:34:54 +01:00
d669eef97b
rm unused code; fix a Deprecated warning; proc to func ( #5807 )
2024-01-20 21:36:01 +00:00
042169ac9d
rm some unnecessary stew/shims/net imports to reduce deprecation warnings ( #5806 )
2024-01-20 16:42:19 +00:00
6c53dc1e11
automated consensus spec URL updating to v1.4.0-beta.6 ( #5804 )
2024-01-20 11:19:47 +00:00
3ff9b69bf1
simplify eth2_network error handling ( #5765 )
...
This PR gets rid of a bunch of redundant exception handling through
async raises guarantees.
More can be removed once libp2p gets properly annotated.
2024-01-19 21:05:52 +00:00
a5daa6d7e9
bump `holesky` to `d05bc1cd68dd16a54fb844181191ccaba15bd5ef` ( #5796 )
...
- schedule dencun on holesky
2024-01-19 15:40:02 +00:00
e06853d8e6
bump `sepolia` to `ff09a161f61959285c64b355d452cd25eae094bd` ( #5795 )
...
- schedule dencun on sepolia
2024-01-19 04:09:17 +01:00
cf1bec7670
update some deprecated stew/results to results imports ( #5743 )
2024-01-16 22:37:14 +00:00
19860029c2
use `macrocache` for protocol index counter ( #5745 )
2024-01-16 18:37:47 +00:00
05fb7ffff0
Don't require getopt to be installed by brew on macOS for Nix users
...
Other changes:
* Add/Update copyright banners
* Add post-review comment for https://github.com/status-im/nimbus-eth2/pull/5719
2024-01-13 12:37:41 +02:00
b98f46c04d
Avoid global in p2p macro ( fixes #4578 ) ( #5719 )
...
* Avoid global in p2p macro (fixes #4578 )
* copy p2p macro to this repo and start de-crufting it
* make protocol registration dynamic, removing light client hacks et al
* split out light client protocol into its own file
* cleanups
* Option -> Opt
* remove more cruft
* further split beacon_sync
this allows the light client to respond to peer metadata messages
without exposing the block sync protocol
* better protocol init
* "constant" protocol index
* avoid casts
* copyright
* move some discovery code to discovery
* avoid extraneous data copy when sending chunks
* remove redundant forkdigest field
* document how to connect to a specific peer
2024-01-13 11:54:24 +02:00
b54bbdecae
bump `gnosis-chain-configs` to `ff5fbe9aecbf28df9beedb662920eeee537629b0` ( #5725 )
...
- Add deneb config vars to Chiado config
- Schedule Deneb on Chiado
2024-01-12 11:31:07 +01:00
62cbdeefc5
verify `genesis_time` more strictly ( fixes #1667 ) ( #5694 )
...
Bogus values lead to crashes down the line when timers overflow
2024-01-06 15:26:56 +01:00
508f3b6368
add missing `std/` prefix to more imports ( #5696 )
...
Bumping some `std` imports to explicitly include the prefix.
Also add explicit `./` prefix for local directory imports.
2024-01-06 07:18:28 +01:00
3f525acb87
chronos: bump ( #5684 )
...
This PR causes a few new warnings to appear - these are harmless but
will need addressing separately as they span several libraries.
* new asyncraises syntax
* asyncraises support in several modules
* `sink` usage reduces spurious copying
* `?` compatiblity for `async` + `results`
* remove `-d:chronosStrictException` (obsolete)
2024-01-05 10:08:38 +01:00
571193d450
bump `goerli` to `6522ac6684693740cd4ddcc2a0662e03702aa4a1` ( #5687 )
...
- schedule dencun on goerli
2024-01-02 22:39:55 +01:00
af63291df4
load Goerli metadata from `goerli` repo ( #5680 )
...
The `eth2-networks` repo often receives metadata updates with a delay.
Switch to `goerli` repo to obtain the latest config (Dencun scheduling)
when it is updated. This is in line with how Sepolia / Holesky work.
- https://github.com/eth-clients/goerli/pull/178
2024-01-02 16:15:44 +01:00
9c6ba7d142
consensus spec v1.4.0-beta.5 URL updates ( #5672 )
2023-12-16 03:27:06 +01:00
15147cccb1
Bump nim-web3 to dcabb8f29ee55afedefdf93cd3e102bb1daee354 ( #5664 )
...
* bump nim-web3 to dcabb8f29ee55afedefdf93cd3e102bb1daee354
also bump json-rpc to a8731e91bc336d930ac66f985d3b88ed7cf2a7d7
2023-12-12 22:15:00 +07:00
4776fecc33
consensus spec v1.4.0-beta.5 URL updates ( #5655 )
2023-12-06 22:16:55 +00:00
91029ce6d6
fix XDeclaredButNotUsed hints ( #5652 )
2023-12-06 17:23:45 +01:00
9efb2958ec
automated consensus spec URL updating to v1.4.0-beta.5 ( #5647 )
2023-12-05 03:34:45 +01:00
ab5343d1bc
update some consensus spec URLs to v1.4.0-beta.4 ( #5631 )
2023-11-27 19:56:34 +01:00
946ebe54cf
simplify `chunkMaxSize[T]` helper implementation ( #5614 )
...
There is no longer a `MAX_CHUNK_SIZE_BELLATRIX` since #5284 , and we have
not used separate limits since #4558 . Clean up to reflect that.
2023-11-21 23:08:31 +01:00
c96163dbca
update some consensus spec URLs to v1.4.0-beta.4 ( #5594 )
2023-11-11 06:27:53 +01:00
c7952ff778
bump nim-eth to remove ValidIpAddress and replace with IpAddress ( #5587 )
2023-11-10 16:58:48 +01:00
68a77926e8
rm ropsten and rinkleby chain IDs from EL manager ( #5586 )
2023-11-09 23:35:40 +03:00
c279bd4474
Fix issue when peers was not disconnected on low score. ( #5579 )
2023-11-08 13:42:50 +00:00
7e3aeaea09
automated consensus spec URL updating to v1.4.0-beta.4 ( #5577 )
2023-11-08 05:28:03 +00:00
d8a7f0df81
update Deneb for blob sidecar inclusion proofs ( #5565 )
...
`BlobSidecar` is no longer signed, instead use Merkle proof to link
blobs with block.
- https://github.com/ethereum/consensus-specs/pull/3531
Associated beacon-API / builder-specs still TBD; minimal changes done
to compile in similar style to previous spec, but not standardized yet.
- https://github.com/ethereum/beacon-APIs/pull/369
- https://github.com/ethereum/builder-specs/pull/90
2023-11-06 07:48:43 +01:00
87a37a32e3
introduce `BlobId` type for tracking blob subnets ( #5560 )
...
Instead of mixing up `SubnetId` (attestation subnet type) for blobs,
introduce dedicated `BlobId` type.
2023-11-04 14:20:34 +00:00
ed446b1d5a
replace ValidIpAddress with IpAddress in configurations ( #5536 )
2023-11-01 08:33:00 +01:00
556d5e7114
rm unused code ( #5538 )
2023-11-01 05:53:09 +01:00
62d59daaa7
consensus-spec URL updates to v1.4.0-beta.3 ( #5541 )
2023-10-30 06:44:43 +00:00
4ddd771127
automated consensus spec URL updating to v1.4.0-beta.3 ( #5514 )
2023-10-19 10:26:38 +00:00
40616b6243
update some consensus spec URLs to v1.4.0-beta.2 ( #5497 )
2023-10-12 05:07:41 +00:00
a4cf203849
fix mainnet bootstrap node comment parsing; fix nimbus guide grammar ( #5486 )
2023-10-06 19:26:30 +00:00
24c68bbcf7
fix `ProveField` warning in `network_metadata` ( #5476 )
...
Spurious `ProveField` warning can be avoided by using `case` instead of
`if` on `metadata.genesis.kind`. Also suppress `GlobalVar` hints when
`incbinEnabled` is used, which has global `let` definitions.
2023-10-04 10:19:05 +02:00
77d6bc5f42
Merge stable into unstable
2023-09-28 11:32:54 +01:00
cfa0268d89
Version 23.9.1
...
Changes:
* Updated network metadata for Holesky
* Use hash_tree_root instead of SHA256 when verifying the Holesky
genesis state
2023-09-25 21:24:25 +01:00
47639ef89c
replace `Eth2NetworkMetadata` case object with `Result` ( #5452 )
...
`Eth2NetworkMetadata` has an `incompatible` case to hold an error string
in case the loaded file is not compatible with the compile-time config.
The same can be modeled with a `Result[Eth2NetworkMetadata, string]` and
avoids followup checks for the `incompatible` case.
2023-09-22 23:45:24 +02:00
caaad4777c
BN+LC+SN: Fix cancellation deprecate warnings. ( #5455 )
...
* Fix deprecation cancel() warnings in SN, BN, LC.
* Fix missing import.
2023-09-22 11:06:27 +00:00
4918a4e2e0
Fix direct peers ( #5427 )
...
* Fix direct peers
* Support ENRs in DP, use DP in local testnet
* fix docs
* bump libp2p
2023-09-15 18:45:55 +00:00
7a001d4896
remove 4 more missing constants in preset handling warning ( #5428 )
2023-09-14 12:37:35 +00:00
6b1ab81046
Support both snappy-encoded and pure SSZ genesis states
2023-09-12 01:52:15 +03:00
c7db7d0f2c
Add CLI options `--genesis-state` and `--genesis-state-url`
2023-09-08 13:10:18 +03:00
53589b5a7d
Add metadata for the Holesky network ( #5337 )
...
* Add metadata for the Holesky network
* Add copyright banner to the new Nim module
* Working version
* Bump Chronos to fix downloading from Github
* Add checksum check of the downloaded file
* Clean up debugging code and obsolete imports
2023-09-08 08:53:27 +03:00
db6f4e8090
update some consensus-spec URLs to v1.4.0-beta.1 ( #5357 )
2023-08-25 15:58:44 +00:00
c211a3849e
remove `{.raises: [Defect].}` Nim 1.2 compatibility ( #5352 )
...
In Nim 1.6, `{.raises: [Defect].}` is no longer necessary. Remove it.
2023-08-25 11:29:07 +02:00
36413c8f21
Bump libp2p for gossipsub improvements ( #5229 )
...
* Bump libp2p
* Add bandwidthEstimate param
* Fix typo and type
* Add config for light client
* Fix unit
* Add debug prefix
---------
Co-authored-by: Jacek Sieka <jacek@status.im>
Co-authored-by: diegomrsantos <diegomrsantos@gmail.com>
Co-authored-by: Diego <diego@status.im>
2023-08-24 16:04:19 +02:00
2dae8ea26e
cleanup `{.raises.}` for `writeValue` ( #5308 )
...
- Remove unnecessary `Defect` references
- Remove spurious `SerializationError` references
- Remove duplicate `writeValue` template in `keystore.nim`;
same implementation already exists a bit further above in same file.
2023-08-19 17:11:56 +02:00
8064f5bcce
explicitly mention which `Success` enum to use ( #5309 )
...
In Nim 2.0 it can no longer infer that we mean `ResponseCode.Success`
inside `eth2_network`. Explicitly refer to that type to work around.
2023-08-17 18:33:35 +00:00
d171303133
update some consensus spec URLs to v1.4.0-beta.1 ( #5287 )
2023-08-12 10:38:06 +00:00
6cd8f3ba55
Update constants/presets for consistency with consensus-specs v1.4.0 ( #5284 )
2023-08-12 03:10:12 +00:00
85e1976ac3
automated consensus spec URL updating to v1.4.0-beta.1 ( #5280 )
2023-08-09 03:58:47 +00:00
001fbd0970
Revert "Revert "correctly align genesis size ( #5244 )" ( #5253 )" ( #5254 )
...
This reverts commit 26dcee111b
2023-08-04 20:49:12 +00:00
26dcee111b
Revert "correctly align genesis size ( #5244 )" ( #5253 )
...
This reverts commit 706ce01bb1
2023-08-04 20:11:20 +00:00
706ce01bb1
correctly align genesis size ( #5244 )
2023-08-04 18:08:15 +03:00
b8a32419b8
async batch verification (+40% sig verification throughput) ( #5176 )
...
* async batch verification
When batch verification is done, the main thread is blocked reducing
concurrency.
With this PR, the new thread signalling primitive in chronos is used to
offload the full batch verification process to a separate thread
allowing the main threads to continue async operations while the other
threads verify signatures.
Similar to previous behavior, the number of ongoing batch verifications
is capped to prevent runaway resource usage.
In addition to the asynchronous processing, 3 addition changes help
drive throughput:
* A loop is used for batch accumulation: this prevents a stampede of
small batches in eager mode where both the eager and the scheduled batch
runner would pick batches off the queue, prematurely picking "fresh"
batches off the queue
* An additional small wait is introduced for small batches - this helps
create slightly larger batches which make better used of the increased
concurrency
* Up to 2 batches are scheduled to the threadpool during high pressure,
reducing startup latency for the threads
Together, these changes increase attestation verification throughput
under load up to 30%.
* fixup
* Update submodules
* fix blst build issues (and a PIC warning)
* bump
---------
Co-authored-by: Zahary Karadjov <zahary@gmail.com>
2023-08-03 11:36:45 +03:00
e9a17fb99f
remove workaround for long-since-fixed Nim bug ( #5219 )
2023-07-31 22:20:09 +00:00
74c993d616
feat: add support for Chiado ( #5208 )
2023-07-26 15:54:16 +03:00
565edfa351
remove unused code ( #5158 )
...
* remove unused code
* add copyright header
2023-07-15 16:30:52 +00:00
1bac029935
avoid unnecessary buffer zero:ing ( #5178 )
2023-07-11 08:01:45 +02:00
49056c3e39
use v1.3.0 stability subnet behavior when appropriate ( #5156 )
2023-07-07 04:16:12 +00:00
1e2d3b12c4
update some consensus-specs ref URLs to v1.4.0-beta.0 ( #5163 )
2023-07-05 16:02:55 +00:00
1234900065
Add blob handling to message router ( #5106 )
...
* Add blob handling to message router
* address review feedback
* Fix typos
2023-06-28 17:55:31 +00:00
614202e30d
automated consensus spec URL updating to v1.4.0-beta.0 ( #5121 )
2023-06-24 15:43:30 +00:00
b62664915e
consensus spec v1.4.0 attestation stability subnets ( #5092 )
2023-06-23 09:30:46 +00:00
11d18acfeb
Add Yamux experimental support ( #5080 )
2023-06-23 09:16:30 +02:00
cbc4cef981
bump `gnosis-chain-configs` to `19060cb894ea0fb8ff3c8ec2fd26c0433f56c52c` ( #5114 )
...
https://github.com/gnosischain/configs/pull/12
- Schedule shapella for gnosis
2023-06-22 11:14:02 +03:00
2722778ce5
reduce `nim-eth` dependencies just for RNG ( #5099 )
...
We have several modules that import `nim-eth` for the sole purpose of
its `keys.newRng` function. This function is meanwhile a simple wrapper
around `nim-bearssl`'s `HmacDrbgContext.new()`, so the import doesn't
really serve a use anymore. Replace `keys.newRng` with the direct call
to reduce `nim-eth` imports.
2023-06-19 22:43:50 +00:00
591c2246d5
update consensus spec URLs to v1.4.0-alpha.3 ( #5088 )
2023-06-16 16:45:09 +00:00
8eec6ab221
avoid `ProveField` warning in `network_metadata` ( #5066 )
...
Before assigning to `genesisData` or returning `cfg`, have to check that
metadata is not `incompatible` to avoid `ProveField` warning.
The way how we use it was already correct (`incompatible` unreachable).
Use `case` syntax to silence the warning, and add comments referring to
the existing checks that make `incompatible` unreachable.
2023-06-16 12:15:42 +00:00
a6f0a7a55d
broaden `SszError` catches to `SerializationError` ( #5081 )
...
`nim-serialization` is tagged with `{.raises:[SerializationError].}` so
it is no longer sufficient to catch `SszError` in some situations.
`SszError` inherits from `SerializationError`, so broadening the caught
exception types can be done now, to enable bumping `nim-serialization`.
https://github.com/status-im/nimbus-eth2/pull/5043#issuecomment-1584227993
#5061 is also needed to bump `nim-serialization`.
2023-06-15 16:29:13 +00:00
98ab0afcc3
Bump libp2p ( #5079 )
...
* Bump libp2p
* Switch to unstable
2023-06-15 12:59:35 +00:00
54cc7bb7a1
update some consensus-spec URLs to v1.4.0-alpha.3 ( #5074 )
2023-06-13 21:07:39 +00:00
788cdb7133
automated v1.4.0-alpha.2 to v1.4.0-alpha.3 consensus spec URL updates ( #5065 )
2023-06-13 14:03:49 +00:00
22208836b1
automated v1.4.0-alpha.1 to v1.4.0-alpha.2 consensus spec URL updates ( #5056 )
2023-06-10 09:56:54 +00:00
46a12639b8
Read messages before applying quota to avoid mplex backpressure issues ( #4697 )
...
* Apply global quota after reading messages
* Also wait quota for failed requests
* Better integration
* comments
2023-06-08 14:20:41 +00:00
8db87a0cfc
bump chronos ( #5039 )
...
* separate futures import / Defect cleanups
* unittest2 fix to allow `stackTrace` as a symbol name generally
2023-06-08 13:42:19 +00:00
30c859e8a4
update some consensus-spec URLs to v1.4.0-alpha.1 ( #5035 )
2023-06-06 17:09:48 +00:00
a24f3cde7e
more flexible compile time resource path
2023-06-05 12:52:25 +07:00
f86febc111
update consensus spec URLs to v1.4.0-alpha.1 ( #5027 )
2023-06-04 10:32:50 +00:00
ee71b6cc36
update consensus spec URLs to v1.4.0-alpha.0 ( #5022 )
2023-06-02 12:59:38 +00:00
1f535336da
automated v1.3.0 to v1.4.0-alpha.0 consensus spec URL updates ( #4996 )
...
* automated v1.3.0 to v1.4.0-alpha.0 consensus spec URL updates
* add copyright year headers
2023-05-26 00:14:28 +02:00
74b670a4c9
reenable incbin on 64-bit platforms ( #4988 )
...
turns out we're still making releases for 32-bit platforms 😲
2023-05-24 23:43:41 +03:00
c14d396718
harden req/resp peer scoring ( #4966 )
2023-05-19 15:01:27 +03:00
4c3850f7df
Disable the use of incbin as it breaks the retail build on Linux/ARM
2023-05-19 04:08:02 +03:00
938d21f1ed
fix linking / compile warnings on pie/etc ( #4939 )
...
* fix linking / compile warnings on pie/etc
* oops
* too much nim of late
* quotes
2023-05-12 07:57:49 +00:00
b3c6320d56
embed genesis states using incbin ( #4905 )
2023-05-11 11:11:00 +00:00
d3929cbb45
update some beacon API spec URLs; fix some Name and DuplicateModuleImport hints ( #4929 )
2023-05-10 10:20:55 +00:00
508819633a
more consensus-specs v1.3.0 bumps ( #4898 )
...
Updates more consensus-specs references to v1.3.0.
This PR only includes updates for sections otherwise unmodified.
2023-05-05 20:38:51 +00:00
e6a6019ef9
Fix the cross-compilation for Windows
2023-04-27 16:28:10 +03:00
b390911e93
automatic update of v1.3.0-rc.5 consensus spec URLs to v1.3.0 ( #4848 )
2023-04-21 18:52:43 +00:00
464e680efc
detect missing network definitions at compile-time ( #4784 )
2023-04-03 15:39:12 +00:00
aa04d45335
use canonical, standalone sepolia network definition repository ( #4762 )
2023-03-29 11:37:14 +03:00
813fddee8c
Capella hard-fork epoch for Mainnet
2023-03-21 23:33:06 +02:00
tersec
Jacek Sieka
Etan Kissling
Zahary Karadjov
andri lim
Eugene Kabanov
Tanguy
Philippe Schommers
henridf