status-im
/
nimbus-eth2
mirror of https://github.com/status-im/nimbus-eth2.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
nimbus-eth2/beacon_chain.nimble

83 lines
3.0 KiB
Plaintext
Raw Normal View History

Makefile that only works in a Git submodule (#210) - updated README.md - beacon_chain.nimble: accept compilation flags as params - nim.cfg: enable `--opt:speed` at the top level - simulation scripts: allow overriding GIT_ROOT and do some refactoring
2019-03-28 15:18:59 +00:00
mode = ScriptMode.Verbose
A LibP2P-based networking stack; To enable it, comment out the 'withLibp2p' line in nim.cfg The history was squashed in order to remove an accidentally commited binary file. Other changes: * SSZ was adapted to use the common serialization framework * gossibsup.subscribe is not using async handlers at the moment and this allowed me to simplify it
2019-03-05 22:54:08 +00:00
import
Fix the nimble version issue
2019-03-12 12:56:33 +00:00
beacon_chain/version as ver
A LibP2P-based networking stack; To enable it, comment out the 'withLibp2p' line in nim.cfg The history was squashed in order to remove an accidentally commited binary file. Other changes: * SSZ was adapted to use the common serialization framework * gossibsup.subscribe is not using async handlers at the moment and this allowed me to simplify it
2019-03-05 22:54:08 +00:00
initial commit
2018-07-20 13:46:03 +00:00
packageName = "beacon_chain"
A LibP2P-based networking stack; To enable it, comment out the 'withLibp2p' line in nim.cfg The history was squashed in order to remove an accidentally commited binary file. Other changes: * SSZ was adapted to use the common serialization framework * gossibsup.subscribe is not using async handlers at the moment and this allowed me to simplify it
2019-03-05 22:54:08 +00:00
version = versionAsStr
initial commit
2018-07-20 13:46:03 +00:00
author = "Status Research & Development GmbH"
Config CI + use Milagro BLS signatures
2018-09-26 16:26:39 +00:00
description = "Eth2.0 research implementation of the beacon chain"
initial commit
2018-07-20 13:46:03 +00:00
license = "MIT or Apache License 2.0"
spec updates (#45) * spec updates * random small updates * ssz no longer sorts by field, fix enum serialization * rewire block processing a little to avoid a few state copies * add a state simulation tool that writes out jsons
2018-12-21 22:37:46 +00:00
installDirs = @["beacon_chain", "research"]
Address review comments
2019-11-28 22:01:12 +00:00
skipDirs = @["nfuzz"]
spec updates (#45) * spec updates * random small updates * ssz no longer sorts by field, fix enum serialization * rewire block processing a little to avoid a few state copies * add a state simulation tool that writes out jsons
2018-12-21 22:37:46 +00:00
bin = @[
"beacon_chain/beacon_node",
spec updates (#48) * spec updates * balances move out to separate seq * bunch of placeholders for proof-of-custody / phase1 * fix inclusion distance adjustment * modify state in-place in `updateState` (tests spent over 80% time copying state! now it's down to 25-50) * document several conditions and conversations * some renames here and there to follow spec
2018-12-27 20:14:37 +00:00
"research/serialized_sizes",
get nbench compiling again
2020-02-27 11:14:24 +00:00
"nbench/nbench",
spec updates (#48) * spec updates * balances move out to separate seq * bunch of placeholders for proof-of-custody / phase1 * fix inclusion distance adjustment * modify state in-place in `updateState` (tests spent over 80% time copying state! now it's down to 25-50) * document several conditions and conversations * some renames here and there to follow spec
2018-12-27 20:14:37 +00:00
]
initial commit
2018-07-20 13:46:03 +00:00
### Dependencies
fix nim version dep
2019-02-07 11:02:40 +00:00
requires "nim >= 0.19.0",
initial state replay implementation * fix initial attestation pool on reordered attestations * simplify db layer api * load head block from database on startup, then load state * significantly changes database format * move subscriptions to separate proc's * implement block replay from historical state * avoid rescheduling epoch actions on block receipt (why?) * make sure genesis block is created and used * relax initial state sim parameters a bit
2019-02-21 04:42:17 +00:00
"blscurve",
work-in-progress beacon node skeleton (not compiling at the moment)
2018-11-23 23:58:49 +00:00
"chronicles",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"chronos",
work-in-progress beacon node skeleton (not compiling at the moment)
2018-11-23 23:58:49 +00:00
"confutils",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"eth",
Asyncdispatch2 rebranding to chronos (#84) * Asyncdispatch2 rebranding to chronos * nim-eth and nim-chronos part of nimble packages * fix package name
2019-02-06 17:56:04 +00:00
"json_rpc",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"json_serialization",
lightweight stack traces - plus some light test runner refactoring and some Makefile cosmetic changes - compile tools with LOG_LEVEL=TRACE in CI - bump a couple of submodules
2020-02-13 12:19:12 +00:00
"libbacktrace",
Added web3 dependency
2019-07-31 08:32:35 +00:00
"libp2p",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"metrics",
"nimcrypto",
"serialization",
"stew",
Spec-compliant implementation of Eth1 monitoring; Eth1-enabled local sim BEWARE! This commit will trigger a stack overflow during local sim
2020-03-24 11:13:07 +00:00
"testutils",
Integrate nim-prompt
2019-10-02 12:38:14 +00:00
"prompt",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"web3",
"yaml"
initial commit
2018-07-20 13:46:03 +00:00
### Helper functions
include both static and dynamic check for invariants to ensure that get_crosslink_committee(...) can access all committees by ensure that SHARD_COUNT >= SLOTS_PER_EPOCH (#318) * include both static and dynamic check for invariants to ensure that get_crosslink_committee(...) can access all committees by ensure that SHARD_COUNT >= SLOTS_PER_EPOCH * add state_sim to CI, to ensure that it also doesn't break SHARD_COUNT/SLOTS_PER_EPOCH assumptions, along with just in general not breaking
2019-07-13 15:58:01 +00:00
proc buildBinary(name: string, srcDir = "./", params = "", cmdParams = "", lang = "c") =
initial commit
2018-07-20 13:46:03 +00:00
if not dirExists "build":
mkDir "build"
Makefile that only works in a Git submodule (#210) - updated README.md - beacon_chain.nimble: accept compilation flags as params - nim.cfg: enable `--opt:speed` at the top level - simulation scripts: allow overriding GIT_ROOT and do some refactoring
2019-03-28 15:18:59 +00:00
# allow something like "nim test --verbosity:0 --hints:off beacon_chain.nims"
var extra_params = params
for i in 2..<paramCount():
extra_params &= " " & paramStr(i)
Make: add USE_LIBBACKTRACE flag
2020-02-20 16:41:10 +00:00
exec "nim " & lang & " --out:./build/" & name & " -r " & extra_params & " " & srcDir & name & ".nim" & " " & cmdParams
initial commit
2018-07-20 13:46:03 +00:00
Spec-compliant implementation of Eth1 monitoring; Eth1-enabled local sim BEWARE! This commit will trigger a stack overflow during local sim
2020-03-24 11:13:07 +00:00
task moduleTests, "Run all module tests":
buildBinary "beacon_node", "beacon_chain/",
"-d:chronicles_log_level=TRACE " &
"-d:const_preset=minimal " &
"-d:testutils_test_build"
initial commit
2018-07-20 13:46:03 +00:00
### tasks
task test, "Run all tests":
lightweight stack traces - plus some light test runner refactoring and some Makefile cosmetic changes - compile tools with LOG_LEVEL=TRACE in CI - bump a couple of submodules
2020-02-13 12:19:12 +00:00
# We're enabling the TRACE log level so we're sure that those rarely used
# pieces of code get tested regularly. Increased test output verbosity is the
# price we pay for that.
Introduce constant presets (#269) * Initial move constants to mainnet preset * Bump fixtures to include shuffling with minimal preset * Add minimal preset with shuffling test * Add minimal preset to the full test suite * use preset() everywhere
2019-05-27 12:48:13 +00:00
# Minimal config
[Ready 1/2] Fork choice rewrite (#865) * initial fork-choice refactor * Add fork_choice test for "no votes" * Initial test with voting: fix handling of unknown validators and parent blocks * Fix tiebreak of votes * Cleanup debugging traces * Complexify the vote test * fakeHash use the bigEndian repr of number + fix tiebreak for good * Stash changes: found critical bug in nimcrypto `==` and var openarray * Passing fork choice tests with varying votes * Add FFG fork choice scenario + fork choice to the test suite * Not sure why lmdb / rocksdb reappeared in rebase * Add sanity checks to .nimble file + integrate fork choice tests to the test DB and test timing * Cleanup debugging echos * nimcrypto fix https://github.com/status-im/nim-beacon-chain/pull/864 as been merged, remove TODO comment * Turn fork choice exception-free * Cleanup "result" to ensure early return is properly used * Add a comment on private/public error code vs Result * result -> results following https://github.com/status-im/nim-beacon-chain/pull/866 * Address comments: - raises: [Defect] doesn't work -> TODO - process_attestation cannot fail - try/except as expression pending Nim v1.2.0 - cleanup TODOs * re-enable all sanity checks * tag no raise for process_attestation * use raises defect everywhere in fork choice and fix process_attestation test
2020-04-09 16:15:00 +00:00
buildBinary "proto_array", "beacon_chain/fork_choice/", "-d:const_preset=minimal"
buildBinary "fork_choice", "beacon_chain/fork_choice/", "-d:const_preset=minimal"
lightweight stack traces - plus some light test runner refactoring and some Makefile cosmetic changes - compile tools with LOG_LEVEL=TRACE in CI - bump a couple of submodules
2020-02-13 12:19:12 +00:00
buildBinary "all_tests", "tests/", "-d:chronicles_log_level=TRACE -d:const_preset=minimal"
# Mainnet config
[Ready 1/2] Fork choice rewrite (#865) * initial fork-choice refactor * Add fork_choice test for "no votes" * Initial test with voting: fix handling of unknown validators and parent blocks * Fix tiebreak of votes * Cleanup debugging traces * Complexify the vote test * fakeHash use the bigEndian repr of number + fix tiebreak for good * Stash changes: found critical bug in nimcrypto `==` and var openarray * Passing fork choice tests with varying votes * Add FFG fork choice scenario + fork choice to the test suite * Not sure why lmdb / rocksdb reappeared in rebase * Add sanity checks to .nimble file + integrate fork choice tests to the test DB and test timing * Cleanup debugging echos * nimcrypto fix https://github.com/status-im/nim-beacon-chain/pull/864 as been merged, remove TODO comment * Turn fork choice exception-free * Cleanup "result" to ensure early return is properly used * Add a comment on private/public error code vs Result * result -> results following https://github.com/status-im/nim-beacon-chain/pull/866 * Address comments: - raises: [Defect] doesn't work -> TODO - process_attestation cannot fail - try/except as expression pending Nim v1.2.0 - cleanup TODOs * re-enable all sanity checks * tag no raise for process_attestation * use raises defect everywhere in fork choice and fix process_attestation test
2020-04-09 16:15:00 +00:00
buildBinary "proto_array", "beacon_chain/fork_choice/", "-d:const_preset=mainnet"
buildBinary "fork_choice", "beacon_chain/fork_choice/", "-d:const_preset=mainnet"
lightweight stack traces - plus some light test runner refactoring and some Makefile cosmetic changes - compile tools with LOG_LEVEL=TRACE in CI - bump a couple of submodules
2020-02-13 12:19:12 +00:00
buildBinary "all_tests", "tests/", "-d:const_preset=mainnet"
Attempt to make the test suite green
2019-08-07 03:09:26 +00:00
Integrate to the test suite
2019-11-06 11:17:03 +00:00
# Generic SSZ test, doesn't use consensus objects minimal/mainnet presets
lightweight stack traces - plus some light test runner refactoring and some Makefile cosmetic changes - compile tools with LOG_LEVEL=TRACE in CI - bump a couple of submodules
2020-02-13 12:19:12 +00:00
buildBinary "test_fixture_ssz_generic_types", "tests/official/", "-d:chronicles_log_level=TRACE"
Integrate to the test suite
2019-11-06 11:17:03 +00:00
# Consensus object SSZ tests
lightweight stack traces - plus some light test runner refactoring and some Makefile cosmetic changes - compile tools with LOG_LEVEL=TRACE in CI - bump a couple of submodules
2020-02-13 12:19:12 +00:00
buildBinary "test_fixture_ssz_consensus_objects", "tests/official/", "-d:chronicles_log_level=TRACE -d:const_preset=minimal"
buildBinary "test_fixture_ssz_consensus_objects", "tests/official/", "-d:const_preset=mainnet"
Attempt to make the test suite green
2019-08-07 03:09:26 +00:00
lightweight stack traces - plus some light test runner refactoring and some Makefile cosmetic changes - compile tools with LOG_LEVEL=TRACE in CI - bump a couple of submodules
2020-02-13 12:19:12 +00:00
buildBinary "all_fixtures_require_ssz", "tests/official/", "-d:chronicles_log_level=TRACE -d:const_preset=minimal"
buildBinary "all_fixtures_require_ssz", "tests/official/", "-d:const_preset=mainnet"
V0.8.3 tests part 3 - sanity checks for slots and blocks (#375) * Add sanity check for slot processing (also impacted by https://github.com/status-im/nim-beacon-chain/issues/373) * use reportDiff also for all state tests vs EF * initial sanity checks for blocks - workaround zero signature in block headers: https://github.com/status-im/nim-beacon-chain/issues/374 * Remove generic object variant compare commented code * Add the one block state transition sanity checks * generalize blocks test to multiple blocks * simplify slots test runner * Add official epoch transitions, sanity blocks, sanity slots to the test suite * Fix index out-of-bounds in initiate_validator_exit - enable proposer slashings unittest
2019-09-03 18:02:21 +00:00
verify that state_sim is justifying and finalizing; fix 3 more warnings; rename crosslink_committee_cache to beacon_committee_cache; fix O(n^2) usage of get_base_reward(...)
2019-11-15 22:37:39 +00:00
# State sim; getting into 4th epoch useful to trigger consensus checks
re-enable mainnet attestation pool tests (#946) * re-enable mainnet attestation pool tests; since https://github.com/status-im/nim-beacon-chain/pull/930 double CI state sim validators * bump deposits spec ref to v0.11.1
2020-04-29 11:44:07 +00:00
buildBinary "state_sim", "research/", "-d:const_preset=minimal", "--validators=2000 --slots=32"
buildBinary "state_sim", "research/", "-d:const_preset=mainnet", "--validators=2000 --slots=128"