Commit Graph

7085 Commits

Author SHA1 Message Date
Agnish Ghosh 99bb845227
add column support to beacon chain db (#6660)
* add column support to beacon chain db

* slight fix

* fix db util

* fix import issues

* gate fulu columns if fulu fork epoch is far future epoch

* fixed all tests file

* fix comment
2024-11-19 06:53:13 +01:00
Eugene Kabanov bd04dcc3dc
Fix syncing problem introduced by light forward syncing PR. (#6714)
* Fix blobs check response algorithm and add more logging information.

* Add MAX_BLOBS_PER_BLOCK check.
Add tests.

* Adopt AllTests.

* Address review comments.

* One more missed lenu64.
2024-11-19 06:35:09 +01:00
Etan Kissling 63fe01fb86
Bump nim-eth to `88e4be4dc40e044834dca68f8b69d144744bf145` (#6715)
- devp2p: upgrade to v5 (EIP-706)
2024-11-17 19:03:58 +07:00
Agnish Ghosh a157760643
Init Fulu fork (#6677)
* fulu

* fix ci

* fix ncli

* attempt to fix ci

* fix wss_sim build

* fix vc api

* updated tests

* resolve merge conflicts

* fix tests

* fix check

* attempt to fix minimal test in CI

* addressed reviews

---------

Co-authored-by: tersec <tersec@users.noreply.github.com>
2024-11-13 10:29:14 +07:00
tersec 0c19270db9
bump nim-lib2p to v1.7.1 (#6710) 2024-11-09 00:01:13 +01:00
suchsoon e06af18f4d
fix: fix incorrect html tag (#6708)
Signed-off-by: suchsoon <silverjadebeauty@gmail.com>
2024-11-07 08:58:53 +00:00
Etan Kissling 75f4877f71
Bump nim-secp256k1 to `e5f0ed8bc27d477b13c174d9c2768d2b0c41da07` (#6706)
- Bump secp256k1 to `v0.6.0`
2024-11-06 18:42:48 +01:00
Etan Kissling ff59e759a4
Bump nim-eth to `034b7886de225705c80ff1e822040cacb553aeee` (#6704)
- devp2p: drop pre-EIP8 support, fix snappy negotiation
- remove unusued rlpx features, tighten hello exchange and some error
  handling
- clean up redundant code in eth/rlp/writer.nim
2024-11-06 18:38:22 +01:00
Etan Kissling 905025e31d
Bump holesky to `901c0f33339f8e79250a1053dc9d995270b666e9` (#6703)
- Update Teku bootnodes for holesky
2024-11-06 18:21:31 +01:00
Etan Kissling 7b2ef3ccd9
Bump nim-presto to `v0.1.0` (#6705)
- v0.1.0
2024-11-06 18:06:12 +01:00
Etan Kissling 0e127e94bd
Bump nim-web3 to `6f441a9c1d7a90adca0019d01adec31f6fa35caa` (#6695)
- re-enable ObservableStores and GcUnsafe2 warnings
2024-11-06 17:01:29 +01:00
tersec a89ee31850
bump nim-libp2p to v1.7.0 (#6701) 2024-11-04 12:47:27 +01:00
tersec b7ea6a627e
fix some deprecation warnings (#6702) 2024-11-04 12:19:43 +01:00
Etan Kissling 544b07ba0d
Bump nim-libbacktrace to `0c1a0edaf2e599d4fa74bc5813ee76e87f3a7a30` (#6693)
- Bump libbacktrace to `d48f84034ce3e53e501d10593710d025cb1121db`
2024-11-04 12:18:19 +01:00
Jacek Sieka 25665eed4f
refresh nimbus guide (#6687)
Small updates to the nimbus guide to update or remove some obsolete
points.
2024-11-02 09:59:35 +00:00
Eugene Kabanov 7726f39004
VC: Fix forks management behavior. (#6698)
* Fix issue "ignore _VERSION configuration value if _EPOCH == FAR_FUTURE_EPOCH".
Add `OptionalForks` constant which should provide default values for _VERSION/_EPOCH.
Fix Fork schedule should update Fork's configuration with _EPOCH values.

* Fix compilation error.

* Add comment why and how `OptionalForks` should be maintained.
2024-11-02 09:59:07 +00:00
Jacek Sieka 6cf388065d
network: remove unusede p2p macro stuff (#6700) 2024-11-01 16:40:13 +01:00
tersec a40b071a1a
switch to Nim v2.0.12 (#6699) 2024-11-01 14:32:24 +01:00
Anton Iakimov 3b806d16e4
change era1 mainnet link to nimbus.team 2024-10-31 13:36:54 +01:00
tersec c0f7220ab2
rm unused and obsolete produceBlindedBlock client-side infrastructure (#6697) 2024-10-31 03:58:44 +00:00
Etan Kissling d7f77a7b8a
Bump nim-faststreams to `cf8d4d22636b8e514caf17e49f9c786ac56b0e85` (#6691)
- restore 1.6 compat
2024-10-30 21:30:00 +01:00
Etan Kissling 5315c3addc
Bump nim-snappy to `0c308d34241c9f0764f6d111a0288428ded173bc` (#6694)
- Replace `apt-fast` with `apt-get` and don't test with `cpp`
2024-10-30 21:21:47 +01:00
Etan Kissling d04bf7d926
Bump nim-eth to `719c0dfd56c14814379d2f1c400df8dcfb7d5199` (#6690)
- fix potential infinite loop in randomNodes
- discv4: prefer ipv6
- eth_hash: condition converter deprecation warning on nim version
2024-10-30 19:30:08 +01:00
Etan Kissling 91e0215b00
Bump nim-json-rpc to `31af0f2bda1486ffb7326c5df1dc47dc63d73fff` (#6692)
- v0.5.0
2024-10-30 18:12:09 +01:00
Etan Kissling 9d8c7345fb
Bump nim-websock to `53c2ba2696ac5ad72a70b36d0711a0837f0b1c8f` (#6696)
- bump version
2024-10-30 16:33:13 +01:00
Etan Kissling d7d4579fe6
Bump nim-confutils to `cb858a27f4347be949d10ed74b58713d687936d2` (#6689)
- Fix `cli` invocation from nimscript
2024-10-30 15:56:45 +01:00
Agnish Ghosh c4d8ae40b0
fix (#6688) 2024-10-30 15:16:02 +01:00
Eugene Kabanov 18409a69e1
Light forward sync mechanism (#6515)
* Initial commit.

* Add hybrid syncing.

* Compilation fixes.

* Cast custom event for our purposes.

* Instantiate AsyncEventQueue properly.

* Fix mistype.

* Further research on optimistic updates.

* Fixing circular deps.

* Add backfilling.

* Add block download feature.

* Add block store.

* Update backfill information before storing block.

* Use custom block verifier for backfilling sync.

* Skip signature verification in backfilling.

* Add one more generic reload to storeBackfillBlock().

* Add block verification debugging statements.

* Add more debugging

* Do not use database for backfilling, part 1.

* Fix for stash.

* Stash fixes part 2.

* Prepare for testing.

* Fix assertion.

* Fix post-restart syncing process.

* Update backfill loading log statement.
Use proper backfill slot callback for sync manager.

* Add handling of Duplicates.

* Fix store duration and block backfilled log statements.

* Add proper syncing state log statement.

* Add snappy compression to beaconchain_file.
Format syncing speed properly.

* Add blobs verification.

* Add `slot` number to file structure for easy navigation over stream of compressed objects.

* Change database filename.

* Fix structure size.

* Add more consistency properties.

* Fix checkRepair() issues.

* Preparation to state rebuild process.

* Add plain & compressed size.

* Debugging snappy encode process.

* Add one more debugging line.

* Dump blocks.

* One more filedump.

* Fix chunk corruption code.

* Fix detection issue.

* Some fixes in state rebuilding process.

* Add more clearance steps.

* Move updateHead() back to block_processor.

* Fix compilation issues.

* Make code more async friendly.

* Fix async issues.
Add more information when proposer verification failed.

* Fix 8192 slots issue.

* Fix Future double completion issue.

* Pass updateFlags to some of the core procedures.

* Fix tests.

* Improve initial sync handling mechanism.

* Fix checkStateTransition() performance improvements.

* Add some performance tuning and meters.

* Light client performance tuning.

* Remove debugging statement.

* Use single file descriptor for blockchain file.

* Attempt to fix LC.

* Fix timeleft calculation when untrusted sync backfilling started right after LC block received.

* Workaround for `chronicles` + `results` `error` issue.
Remove some compilation warnings.
Fix `CatchableError` leaks on Windows.

* Address review comments.

* Address review comments part 2.

* Address review comments part 1.

* Rebase and fix the issues.

* Address review comments part 3.

* Add tests and fix some issues in auto-repair mechanism.

* Add tests to all_tests.

* Rename binary test file to pass restrictions.

* Add `bin` extension to excluded list.
Recover binary test data.

* Rename fixture file to .bin again.

* Update AllTests.

* Address review comments part 4.

* Address review comments part 5 and fix tests.

* Address review comments part 6.

* Eliminate foldl and combine from blobs processing.
Add some tests to ensure that checkResponse() also checks for correct order.

* Fix forgotten place.

* Post rebase fixes.

* Add unique slots tests.

* Optimize updateHead() code.

* Add forgotten changes.

* Address review comments on state as argument.
2024-10-30 05:38:53 +00:00
tersec 03fe86f448
devel-branch-compatibility tweaks for Nim in test_validator_client (#6686) 2024-10-30 05:21:20 +01:00
tersec a39dd8e874
remove remaining references to logtrace (#6684) 2024-10-29 11:02:44 +01:00
Jacek Sieka 6973c38de2
bump mdbook version req
* use same versions as style guide
* remove obsoletion notice from summary - this is not supported by
mdbook: https://github.com/rust-lang/mdBook/issues/1766
2024-10-29 08:57:11 +01:00
Jacek Sieka 012ff59ff1
eth1 docs (#6680)
Minimal quickstart for setting up the execution client

* bump mkdocs to resolve a strange cython incompatibility
2024-10-29 08:39:18 +01:00
tersec 00f276eacf
Merge remote-tracking branch 'origin/stable' into unstable 2024-10-29 07:29:04 +00:00
andri lim 4394e5eb1e
Bump nim-web3 and nim-serialization (#6676)
- No need to use derefType anymore when using useDefault***In #174 in nim-web3
  - dependency: nim-serialization
- Fix subscription handler #175 in nim-web3
2024-10-29 01:19:09 +00:00
Jacek Sieka d71309b943
json_rpc: bump (#6659)
* json_rpc: bump

* refactored error handling, logging and other fixes
* crash fix on overlong array in json

* bump
2024-10-29 00:40:26 +00:00
tersec c4037d6361
version v24.10.0 2024-10-29 00:27:43 +00:00
tersec f85521230f
stop checking for irrelevant unsigned wraparound in Electra deposit codepath (#6683) 2024-10-28 17:18:01 +01:00
tersec 4565c029e1
make Eth2Digest isZero 8x faster (#6682)
* make Eth2Digest isZero 8x faster

* use staticFor and copyMem

* branchless with or
2024-10-28 05:21:18 +00:00
tersec 58a34e00a1
fix inconsistent aggregation bits len in Electra (#6679) 2024-10-25 16:04:35 +02:00
tersec 8a6eab7af8
unhide ObservableStores and hide ImplicitTemplateRedefinition warnings (#6678) 2024-10-24 12:40:56 +02:00
Jacek Sieka 40f2acc93c
json-ser (#6674)
bump for overlong array crash fix
2024-10-23 17:12:42 +02:00
Eugene Kabanov a3d4a3ee5e
BN: Fix el_manager timeouts issue in block processing. (#6665)
* Fix el_manager + block_processor NEWPAYLOAD_TIMEOUT timeouts issue.
Use predefined array of exponential timeouts when all the requests to EL has been failed.

* Increase timeout value to (next_slot.start_time - 1.second)

* Address review comments.

* Do not repeat requests when node is optimistically synced.
2024-10-23 00:42:46 +00:00
Etan Kissling ead72deaa2
Bump nim-libbacktrace to `31d8d5c170441f11a730582ef353e506a3780b7a` (#6671)
- Replace `apt-fast` with `apt-get`
- Bump libbacktrace to `531aec7c52b66cd750a28a698f3c060f279b18b0`
2024-10-22 18:24:32 +02:00
Etan Kissling 117fecad99
Bump nim-web3 to `c76ddefea96e7763c3cc5b28ec5cbac1adefc4e7` (#6670)
- Fix AuthorizationObject fields name to v, r, s
2024-10-22 18:13:36 +02:00
andri lim 5d940b4c1e
Bump nim-eth to 66297c5c0a8c22ec3f16c899e902d79aa00df575 (#6669) 2024-10-22 14:15:33 +02:00
Agnish Ghosh 250a80eb0c
add gossip validation for dc, and data column quarantine strategy (#6581)
* add gossip validation for dc

* review 1

* rm callback

* review 2

* added custody columns as a global entity

* alpha 8

* few typosA
2024-10-22 05:19:34 +00:00
Etan Kissling 3cb7b9140a
Remove request details from LC (#6666)
Requests are no longer exposed by execution data, remove from LC API.
2024-10-22 03:41:01 +00:00
Etan Kissling 6f6de8d9dc
Implement latest EIP-7685 `requestsHash` method (#6667)
It's now this weird one-off hashing method so that EL can partially
forget in some modules what the data schema is.
2024-10-21 17:09:26 +02:00
tersec 7e5338deb3
disable optimistic Electra EL block hash verification (#6664) 2024-10-21 05:09:33 +02:00
Caleb Omoniyi eb993ffcee
Fix comment to reflect correct validator balance count transition (#6663) 2024-10-21 00:40:14 +00:00