mirror of https://github.com/status-im/nimbus-eth2.git synced 2025-01-09 22:06:21 +00:00

History

Jacek Sieka 22ddf74752 Upgrade database schema

The `kvstore` design we're using now turns out to not be the best way to
use `sqlite` - in particular, there are some significant benefits to
using rowid in certain situations and to keep data in separate tables.

With this branch, there are massive improvements in startup time
(seconds instead of minutes) and state/block storage and pruning times
(milliseconds instead of seconds) - these improvements can in particular
be seen on slow drives and translate directly into better attestation
performance.

* update kvstore to new keyspace design
* remove `DirStoreRef` and the hidden `--state-db-kind` option - this
was an experiment to store large blobs in files, but with the new
kvstore, there's no compelling reason to do so
* remove `DbMap` - unused and would need updating for new keyspace
design
* introduce separate tables for each data type (blocks, states etc)
* remove "WITHOUT ROWID" pessimization for tables with large blobs
* close DbSeq statements explicitly (and earlier)
* store beacon block summaries in separate table, without SSZ
compression and load them all with single query on startup
* stop storing backwards compat full states
* mark genesis beacon block as trusted
* avoid faststreams when loading SSZ data
* remove `DisagreementBehavior` (unused)

2021-05-14 20:05:23 +03:00

.gitignore

rm ncli_signing_root

2019-12-17 00:06:03 +02:00

e2store.nim

e2store: add era format (#2382 )

2021-03-15 11:31:39 +01:00

e2store.py

e2store: add era format (#2382 )

2021-03-15 11:31:39 +01:00

inspector.nim

Perform attestation check before broadcast (#2550 )

2021-05-10 09:13:36 +02:00

inspector.nim.cfg

Move tools (#2370 )

2021-03-02 15:02:10 +01:00

logtrace.nim

Move tools (#2370 )

2021-03-02 15:02:10 +01:00

ncli_db.nim

Upgrade database schema

2021-05-14 20:05:23 +03:00

ncli_query.nim

12x speedup on state sim with 100k validators sans BLS by caching get_beacon_proposer_index(...)

2020-06-04 17:07:51 +00:00

ncli_slashing.nim

Consolidate modules by areas [part 1] (#2365 )

2021-03-02 11:27:45 +01:00

ncli.nim

add attestation stats tool to ncli_db (#2539 )

2021-05-07 13:36:21 +02:00

nim.cfg

minimize imports, specially for spec - cuts 2/3 of ncli build time (#500 )

2019-10-25 12:59:56 +02:00

nimquery.nim

Move tools (#2370 )

2021-03-02 15:02:10 +01:00

README.md

update nim-beacon-chain to nimbus-eth2 in beacon_chain/, ncli/, tests/, and README.md (#1843 )

2020-10-08 19:02:05 +00:00

resttest-rules.json

REST API test framework and tests. (#2492 )

2021-04-27 23:46:24 +03:00

resttest.nim

REST API test framework and tests. (#2492 )

2021-04-27 23:46:24 +03:00

README.md

Introduction

ncli is a set of low level / debugging tools to interact with the nimbus beacon chain specification implementation, simliar to zcli. With it, you explore SSZ, make state transitions and compute hash tree roots.

Tools

transition: Perform state transition given a pre-state and a block to apply (both in SSZ format)
hash_tree_root: Print tree root of an SSZ object
pretty: Pretty-print SSZ object as JSON

Building

Follow the instructions from nimbus-eth2

git clone https://github.com/status-im/nimbus-eth2.git
cd nimbus-eth2
make

Usage

# Build with minimal config
../env.sh nim c -d:const_preset=minimal ncli_transition
# Build with mainnet config
../env.sh nim c -d:const_preset=mainnet ncli_transition

# Run..
./ncli_transition --help