4380 Commits

Author SHA1 Message Date
bhartnett
e33537420d
Fix copyright. 2025-01-30 22:08:39 +08:00
bhartnett
ac109f05d6
Run nph and update nim-eth. 2025-01-30 22:00:13 +08:00
bhartnett
0d73e57777
Remove wrong subprotocol ban and add tests. 2025-01-30 21:50:58 +08:00
bhartnett
b2f2784d2b
Enable node bans in portal cli and utp test. 2025-01-30 19:44:22 +08:00
bhartnett
915cab289d
Enable discv5 ban nodes in tests. 2025-01-30 15:23:14 +08:00
bhartnett
287262b776
Improve node bans. 2025-01-30 13:54:55 +08:00
bhartnett
279e2eb4f9
Fix tests. 2025-01-30 11:39:08 +08:00
bhartnett
4b855f1c65
Add config parameter to support disabling node bans. 2025-01-30 11:01:53 +08:00
bhartnett
885a1c08b0
Ban on message response errors. Filter out banned nodes in findContent. 2025-01-30 10:06:35 +08:00
bhartnett
89d72301fb
Use latest nim-eth feature branch. 2025-01-30 09:39:04 +08:00
bhartnett
628285f6d2
Merge branch 'master' into fluffy-peer-ban-list 2025-01-30 09:36:39 +08:00
Jordan Hrycaj
bc0620f6ca
Provide global sync progress, supersedes activation indicator (#3039) 2025-01-29 16:20:25 +00:00
pmmiranda
3e1f5e0b5f
Improved logging (#3001)
* Improved logging using nimbus-eth2 options

- log file support removal
- auto detection of tty, colour support and related.

* Added EthTime serializer (implemented on eth_types_json_serialization)

* added json chronicles logging support
 for some eth, web3 and confutils types

---------

Co-authored-by: Pedro Miranda <pedro.miranda@nimbus.team>
2025-01-29 15:04:27 +00:00
Jordan Hrycaj
b9e1c94b99
Beacon sync provide activation status globally (#3038)
* Cosmetics, rename some functions, add/update comments

* Provide globally accessible syncer status query function
2025-01-29 12:31:06 +00:00
Jordan Hrycaj
8bc8094413
Beacon sync fix stalling while block processing (#3037)
* Correct docu

why:
  `T` is mentioned on the metrics table but not explained

* Update state sync ticker

why:
  Print last named state for debugging unexpected states.

* Rename `nec_consensus_head`=> `nec_sync_consensus_head`

why:
  This variable is syncer local, derived from what would be vaguely be
  the consensus head. In fact, at some point it is the consensus head
  but often will keep that value while the consensus head advances.

* Handle legit system state when block processing is cancelled

why:
  This state context was previously missing. It happens with problematic
  blocks (i.e. corrupt or missing.) Rather than trying to remedy the batch
  queue, all will be cancelled and the batch queue rebuilt from scratch.

* Update block queue with unexpectedly missing blocks

why:
  Concurrently serving `RPC` requests might cause a reset of the `FC`
  module data area. This in turn might produce a gap between expected `FC`
  module top and the beginning of the already downloaded blocks list.

  Currently this led to a deadlock situation because the missing blocks
  were never downloaded by the syncer, neither installed into `FC` module
  via `RFC`.

* Fix copyright year
2025-01-29 11:30:40 +00:00
kdeme
cdd71cac2e
Portal: Remove pruneDeprecatedAccumulatorRecords (#3031)
This was added to cleanup database from a content type that was
removed.

After ping extensions upgrade all active nodes must have been
updated to remain compatible and thus must have ran this pruning
code.
2025-01-29 10:20:29 +01:00
bhartnett
0ca892ab9e
Merge branch 'master' into fluffy-peer-ban-list 2025-01-29 16:08:03 +08:00
bhartnett
aed4020983
Fix copyright. 2025-01-29 15:49:43 +08:00
andri lim
13961fbae6
Bump nim-eth to 254be32672d0ffbddd110e21ecb55c32f9e90b02 (#3030)
* Bump nim-eth to 254be32672d0ffbddd110e21ecb55c32f9e90b02

* Bump nim-eth to e589cc0288b139509a19f3a27cd0cf0368ca0834
2025-01-29 13:53:47 +07:00
bhartnett
1b78aea40d
Bump nim-rocksdb (#3034) 2025-01-29 11:46:11 +08:00
andri lim
de80eb4214
Bump nim-stew to 687d1b4ab1a91e6cc9c92e4fd4d98bec7874c259 (#3032) 2025-01-29 08:48:03 +07:00
bhartnett
f78f82e8c9
Fluffy: Randomize gossip in neighborhoodGossip (#3029) 2025-01-29 08:49:37 +08:00
kdeme
28f9b792d9
Minimal implementation of Portal ping payload extensions spec (#3010)
* Minimal implementation of Portal ping payload extensions spec

* Remove serialization layer for CustomPayload (spec change)
2025-01-27 19:26:23 +01:00
andri lim
c4bc2a4eea
devnet-6: Update EIP-7840: Add BaseFeeUpdateFraction (#3022)
* devnet-6: Update EIP-7840: Add BaseFeeUpdateFraction

* Fix missing baseFeeUpdateFraction fallback

* Fix and add test
2025-01-27 16:20:39 +00:00
Advaita Saha
c16fc30358
Fix engine api misconceptions (#3025)
* fix shanghai misconception

* incorporate spec changes

* shanghai only check

* ForkchoiceUpdatedV2 after Cancun with beacon root field must return INVALID_PAYLOAD_ATTRIBUTES

* better exception positioning

* beter error msg
2025-01-27 19:07:03 +05:30
kdeme
c24335ce29
Bump nph formatter in CI to v0.6.1 (#3024) 2025-01-27 13:07:34 +01:00
kdeme
de80acdf79
Bump portal-spec-test (test-vectors) to latest (#3023) 2025-01-27 10:54:44 +00:00
bhartnett
22d4627251
Update portal protocol to use routing table node bans. 2025-01-27 11:41:23 +08:00
andri lim
c11f20f8b0
devnet-6: Update EIP-7702: update EXTCODE* opcodes to act on full 'delegation designator' (#3021) 2025-01-25 14:32:39 +00:00
tersec
49523c5d8f
rm unused pre-1559 gas limit update calculation (#3011)
* rm unused pre-1559 gas limit update calculation

* wiki links 404
2025-01-25 17:36:43 +07:00
Advaita Saha
8372736600
custom genesis config fallback case for blobs (#3020)
* clear re-org misconception

* fcuV3 allow shanghai head

* add fallback blobcount for custom network

* fix tests
2025-01-24 22:49:11 +00:00
kdeme
b917be54ab
Fix wrong Result error usage in eth_data_exporter (#3018) 2025-01-24 08:36:28 +01:00
kdeme
9a5fd34dac
Portal history: Add ephemeral content type (#3017)
This does not yet enable the offer/accept and storage of the
ephemeral headers as it requires database changes.
Follow-up PR for that functionality.
2025-01-23 21:45:51 +01:00
Advaita Saha
f973b86dd8
nrpc re-org handling (#2994)
* reorg handling

* formatting fix

* fix validation condition

* eip-7685 compatible

* more exception handling

* remove strict checking
2025-01-23 01:51:44 +01:00
Jordan Hrycaj
184af027dc
Beacon sync metrics managemnt update (#3016)
* Sync scheduler provides an independent `ticker` loop process

why:
  Can be used to update `metrics` and for debug logging. While an event
  driven solution would stall if there are no events at the moment (e.g.
  when the syncer hibernates, the `ticker` will run regardless.

* Use `runTicker()` loop interface alike for updating ticker

why:
  Not event driven anymore so it will not stall when the syncer
  hibernates.

* Re-implement logging ticker by running it within the `runTicker()` driver

why:
  Simplifies implementation

* Re-name metrics variable to better fit into the current naming schemes

* Fix copyright header
2025-01-22 10:12:50 +00:00
kdeme
4b893eb88e
Discard received data on uTP content stream timeout (#3014)
Discard the received data on uTP content stream read timeout.
Before the data was still added to the queue and being processed
and should normally fail in validation. However as we know not all
data got read it should not even move to the validation step.

Added however a FIN send after the timeout instead of the delayed
socket clean-up which does not make much sense in that scenario
either. Basically either be nice and still send a FIN or just
destroy the socket immediatly.
2025-01-21 17:44:02 +01:00
andri lim
c62024ea24
devnet-5: Add EIP-7623: Increase calldata cost (#3015)
* devnet5: Add EIP-7623: Increase calldata cost

* Fix copyright year
2025-01-21 11:26:23 +00:00
kdeme
234487a8cb
Portal JSON-RPC: add eth_blockNumber and fix eth_getBlockByNumber (#3013)
- add eth_blockNumber
- fix eth_getBlockByNumber: latest vs safe fix.
2025-01-21 09:44:13 +01:00
bhartnett
5e38c95a55
Merge branch 'master' into fluffy-peer-ban-list 2025-01-20 21:00:36 +08:00
bhartnett
285b6de4bc
Fluffy: Cleanup unused code from PortalProtocol (#3006) 2025-01-20 20:57:18 +08:00
bhartnett
5f91b1b685
Remove helper templates. 2025-01-20 20:40:24 +08:00
bhartnett
4b8cf1c57a
Merge branch 'master' into fluffy-peer-ban-list 2025-01-20 20:19:29 +08:00
Jordan Hrycaj
3aae33d6cc
Beacon sync maintenance update (#3012)
* Force metrics update when peers vanish

why:
  After that there might be reduced activity so that the next metrics
  update is delayed.

* Update comments (code cosmetics)

* Tidy up nano-sleep wait directives to an `update.nim`-function

* Fix copyright year
2025-01-20 10:30:04 +00:00
bhartnett
5b74335977
Update nim-rocksdb to v9.8.4.0 (#2997) 2025-01-17 18:23:24 +01:00
Advaita Saha
bf57c8e0e4
fix copyright lint failure (#3008) 2025-01-17 16:29:26 +05:30
kdeme
fa147f90ed
Portal JSON-RPC: minor clean-up (#3000)
Minor cleanup/refactor + add a basic TraceObject when returning
locally found content.
2025-01-17 11:57:15 +01:00
andri lim
aa85d6a61c
Only hashing immutable part of network configuration for dataDir ID (#2955)
* Only hashing immutable part of network configuration for dataDir ID

* Add debug- prefix to rewrite-datadir-id
2025-01-17 15:33:15 +05:30
bhartnett
db11fb16c9
Filter out and ignore banned peers in portal protocol. 2025-01-17 13:45:01 +08:00
bhartnett
000e2bbca0
Ban nodes when state network content lookups and offers fail validation. 2025-01-17 11:23:32 +08:00
bhartnett
1f7869be8c
Implement ban list data structure, banPeer and isBanned. 2025-01-16 15:19:29 +08:00