status-im/nimbus-eth2

Fork 0

mirror of https://github.com/status-im/nimbus-eth2.git synced 2025-01-27 14:58:46 +00:00

History

Eugene Kabanov 18409a69e1

Light forward sync mechanism (#6515 )

* Initial commit.

* Add hybrid syncing.

* Compilation fixes.

* Cast custom event for our purposes.

* Instantiate AsyncEventQueue properly.

* Fix mistype.

* Further research on optimistic updates.

* Fixing circular deps.

* Add backfilling.

* Add block download feature.

* Add block store.

* Update backfill information before storing block.

* Use custom block verifier for backfilling sync.

* Skip signature verification in backfilling.

* Add one more generic reload to storeBackfillBlock().

* Add block verification debugging statements.

* Add more debugging

* Do not use database for backfilling, part 1.

* Fix for stash.

* Stash fixes part 2.

* Prepare for testing.

* Fix assertion.

* Fix post-restart syncing process.

* Update backfill loading log statement.
Use proper backfill slot callback for sync manager.

* Add handling of Duplicates.

* Fix store duration and block backfilled log statements.

* Add proper syncing state log statement.

* Add snappy compression to beaconchain_file.
Format syncing speed properly.

* Add blobs verification.

* Add `slot` number to file structure for easy navigation over stream of compressed objects.

* Change database filename.

* Fix structure size.

* Add more consistency properties.

* Fix checkRepair() issues.

* Preparation to state rebuild process.

* Add plain & compressed size.

* Debugging snappy encode process.

* Add one more debugging line.

* Dump blocks.

* One more filedump.

* Fix chunk corruption code.

* Fix detection issue.

* Some fixes in state rebuilding process.

* Add more clearance steps.

* Move updateHead() back to block_processor.

* Fix compilation issues.

* Make code more async friendly.

* Fix async issues.
Add more information when proposer verification failed.

* Fix 8192 slots issue.

* Fix Future double completion issue.

* Pass updateFlags to some of the core procedures.

* Fix tests.

* Improve initial sync handling mechanism.

* Fix checkStateTransition() performance improvements.

* Add some performance tuning and meters.

* Light client performance tuning.

* Remove debugging statement.

* Use single file descriptor for blockchain file.

* Attempt to fix LC.

* Fix timeleft calculation when untrusted sync backfilling started right after LC block received.

* Workaround for `chronicles` + `results` `error` issue.
Remove some compilation warnings.
Fix `CatchableError` leaks on Windows.

* Address review comments.

* Address review comments part 2.

* Address review comments part 1.

* Rebase and fix the issues.

* Address review comments part 3.

* Add tests and fix some issues in auto-repair mechanism.

* Add tests to all_tests.

* Rename binary test file to pass restrictions.

* Add `bin` extension to excluded list.
Recover binary test data.

* Rename fixture file to .bin again.

* Update AllTests.

* Address review comments part 4.

* Address review comments part 5 and fix tests.

* Address review comments part 6.

* Eliminate foldl and combine from blobs processing.
Add some tests to ensure that checkResponse() also checks for correct order.

* Fix forgotten place.

* Post rebase fixes.

* Add unique slots tests.

* Optimize updateHead() code.

* Add forgotten changes.

* Address review comments on state as argument.

2024-10-30 05:38:53 +00:00

.gitignore

A simple script for fetching detailed deposit data

2021-05-28 19:34:20 +03:00

deposit_downloader.nim

verify genesis_time more strictly (fixes #1667 ) (#5694 )

2024-01-06 15:26:56 +01:00

download_mainnet_deposits.sh

A simple script for fetching detailed deposit data

2021-05-28 19:34:20 +03:00

e2store.nim

Split era specific code from e2s specific code (#5866 )

2024-02-09 08:59:36 +01:00

e2store.py

e2store: avoid uint48 (#4625 )

2023-02-15 14:51:17 +01:00

era.nim

era: speed up index reading (#6305 )

2024-05-22 10:21:04 +02:00

ncli_common.nim

update ncli_db to use Opt (#6575 )

2024-09-23 10:02:09 +02:00

ncli_db.nim

Light forward sync mechanism (#6515 )

2024-10-30 05:38:53 +00:00

ncli_split_keystore.nim

verify genesis_time more strictly (fixes #1667 ) (#5694 )

2024-01-06 15:26:56 +01:00

ncli_testnet.nim

Deprecate logtrace tool. (#6643 )

2024-10-15 13:54:07 +00:00

ncli.nim

rm outdated/semi-duplicate execution layer withdrawal request processing (#6301 )

2024-05-22 01:59:11 +02:00

nim.cfg

styleCheck tweaks (#6638 )

2024-10-12 00:51:28 +02:00

nimquery.nim

add missing std/ prefix to more imports (#5696 )

2024-01-06 07:18:28 +01:00

README.md

docs: fix typos (#5571 )

2023-11-06 03:56:07 +00:00

requirements.txt

Bump tornado from 6.3.3 to 6.4.1 in /ncli (#6328 )

2024-06-06 23:38:04 +00:00

resttest-rules.json

VC: Electra fixes. (#6631 )

2024-10-16 17:20:39 +00:00

resttest.nim

update some deprecated stew/results to results imports (#5743 )

2024-01-16 22:37:14 +00:00

resttest.nim.cfg

Keymanager API for the validator client (#3976 )

2022-08-19 13:30:07 +03:00

validator_db_aggregator.nim

update ncli_db to use Opt (#6575 )

2024-09-23 10:02:09 +02:00

validator_db_reports.ipynb

Streamline the validator reward analysis

2022-02-01 11:30:14 +02:00

README.md

Introduction

ncli is a set of low level / debugging tools to interact with the nimbus beacon chain specification implementation, similar to zcli. With it, you explore SSZ, make state transitions and compute hash tree roots.

Tools

transition: Perform state transition given a pre-state and a block to apply (both in SSZ format)
hash_tree_root: Print tree root of an SSZ object
pretty: Pretty-print SSZ object as JSON

Building

Follow the instructions from nimbus-eth2

git clone https://github.com/status-im/nimbus-eth2.git
cd nimbus-eth2
make

Usage

# Build with minimal config
../env.sh nim c -d:const_preset=minimal ncli_transition
# Build with mainnet config
../env.sh nim c -d:const_preset=mainnet ncli_transition

# Run..
./ncli_transition --help