status-im
/
nimbus-eth2
mirror of https://github.com/status-im/nimbus-eth2.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
nimbus-eth2/beacon_chain.nimble

101 lines
5.3 KiB
Plaintext
Raw Normal View History

Makefile that only works in a Git submodule (#210) - updated README.md - beacon_chain.nimble: accept compilation flags as params - nim.cfg: enable `--opt:speed` at the top level - simulation scripts: allow overriding GIT_ROOT and do some refactoring
2019-03-28 15:18:59 +00:00
mode = ScriptMode.Verbose
A LibP2P-based networking stack; To enable it, comment out the 'withLibp2p' line in nim.cfg The history was squashed in order to remove an accidentally commited binary file. Other changes: * SSZ was adapted to use the common serialization framework * gossibsup.subscribe is not using async handlers at the moment and this allowed me to simplify it
2019-03-05 22:54:08 +00:00
import
Fix the nimble version issue
2019-03-12 12:56:33 +00:00
beacon_chain/version as ver
A LibP2P-based networking stack; To enable it, comment out the 'withLibp2p' line in nim.cfg The history was squashed in order to remove an accidentally commited binary file. Other changes: * SSZ was adapted to use the common serialization framework * gossibsup.subscribe is not using async handlers at the moment and this allowed me to simplify it
2019-03-05 22:54:08 +00:00
initial commit
2018-07-20 13:46:03 +00:00
packageName = "beacon_chain"
A LibP2P-based networking stack; To enable it, comment out the 'withLibp2p' line in nim.cfg The history was squashed in order to remove an accidentally commited binary file. Other changes: * SSZ was adapted to use the common serialization framework * gossibsup.subscribe is not using async handlers at the moment and this allowed me to simplify it
2019-03-05 22:54:08 +00:00
version = versionAsStr
initial commit
2018-07-20 13:46:03 +00:00
author = "Status Research & Development GmbH"
Config CI + use Milagro BLS signatures
2018-09-26 16:26:39 +00:00
description = "Eth2.0 research implementation of the beacon chain"
initial commit
2018-07-20 13:46:03 +00:00
license = "MIT or Apache License 2.0"
spec updates (#45) * spec updates * random small updates * ssz no longer sorts by field, fix enum serialization * rewire block processing a little to avoid a few state copies * add a state simulation tool that writes out jsons
2018-12-21 22:37:46 +00:00
installDirs = @["beacon_chain", "research"]
Address review comments
2019-11-28 22:01:12 +00:00
skipDirs = @["nfuzz"]
spec updates (#45) * spec updates * random small updates * ssz no longer sorts by field, fix enum serialization * rewire block processing a little to avoid a few state copies * add a state simulation tool that writes out jsons
2018-12-21 22:37:46 +00:00
bin = @[
Rename binaries; Mimic the original repo layout in the distribution
2020-11-07 18:00:31 +00:00
"beacon_chain/nimbus_beacon_node",
spec updates (#48) * spec updates * balances move out to separate seq * bunch of placeholders for proof-of-custody / phase1 * fix inclusion distance adjustment * modify state in-place in `updateState` (tests spent over 80% time copying state! now it's down to 25-50) * document several conditions and conversations * some renames here and there to follow spec
2018-12-27 20:14:37 +00:00
"research/serialized_sizes",
get nbench compiling again
2020-02-27 11:14:24 +00:00
"nbench/nbench",
spec updates (#48) * spec updates * balances move out to separate seq * bunch of placeholders for proof-of-custody / phase1 * fix inclusion distance adjustment * modify state in-place in `updateState` (tests spent over 80% time copying state! now it's down to 25-50) * document several conditions and conversations * some renames here and there to follow spec
2018-12-27 20:14:37 +00:00
]
initial commit
2018-07-20 13:46:03 +00:00
### Dependencies
fix nim version dep
2019-02-07 11:02:40 +00:00
requires "nim >= 0.19.0",
initial state replay implementation * fix initial attestation pool on reordered attestations * simplify db layer api * load head block from database on startup, then load state * significantly changes database format * move subscriptions to separate proc's * implement block replay from historical state * avoid rescheduling epoch actions on block receipt (why?) * make sure genesis block is created and used * relax initial state sim parameters a bit
2019-02-21 04:42:17 +00:00
"blscurve",
work-in-progress beacon node skeleton (not compiling at the moment)
2018-11-23 23:58:49 +00:00
"chronicles",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"chronos",
work-in-progress beacon node skeleton (not compiling at the moment)
2018-11-23 23:58:49 +00:00
"confutils",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"eth",
Asyncdispatch2 rebranding to chronos (#84) * Asyncdispatch2 rebranding to chronos * nim-eth and nim-chronos part of nimble packages * fix package name
2019-02-06 17:56:04 +00:00
"json_rpc",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"json_serialization",
lightweight stack traces - plus some light test runner refactoring and some Makefile cosmetic changes - compile tools with LOG_LEVEL=TRACE in CI - bump a couple of submodules
2020-02-13 12:19:12 +00:00
"libbacktrace",
Added web3 dependency
2019-07-31 08:32:35 +00:00
"libp2p",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"metrics",
"nimcrypto",
Address #1694
2020-10-02 14:48:27 +00:00
"normalize",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"serialization",
"stew",
Spec-compliant implementation of Eth1 monitoring; Eth1-enabled local sim BEWARE! This commit will trigger a stack overflow during local sim
2020-03-24 11:13:07 +00:00
"testutils",
Integrate nim-prompt
2019-10-02 12:38:14 +00:00
"prompt",
Address #1694
2020-10-02 14:48:27 +00:00
"unicodedb",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"web3",
Address #1690 Min password entropy
2020-10-06 18:55:04 +00:00
"yaml",
"zxcvbn"
initial commit
2018-07-20 13:46:03 +00:00
### Helper functions
Azure: reduce 32-bit Windows job runtime (#1168) * Azure: lighten the load on 32-bit * disable mainnet tests on 32-bit Windows
2020-06-14 02:25:19 +00:00
proc buildAndRunBinary(name: string, srcDir = "./", params = "", cmdParams = "", lang = "c") =
initial commit
2018-07-20 13:46:03 +00:00
if not dirExists "build":
mkDir "build"
Makefile that only works in a Git submodule (#210) - updated README.md - beacon_chain.nimble: accept compilation flags as params - nim.cfg: enable `--opt:speed` at the top level - simulation scripts: allow overriding GIT_ROOT and do some refactoring
2019-03-28 15:18:59 +00:00
# allow something like "nim test --verbosity:0 --hints:off beacon_chain.nims"
var extra_params = params
for i in 2..<paramCount():
extra_params &= " " & paramStr(i)
Make: add USE_LIBBACKTRACE flag
2020-02-20 16:41:10 +00:00
exec "nim " & lang & " --out:./build/" & name & " -r " & extra_params & " " & srcDir & name & ".nim" & " " & cmdParams
initial commit
2018-07-20 13:46:03 +00:00
Spec-compliant implementation of Eth1 monitoring; Eth1-enabled local sim BEWARE! This commit will trigger a stack overflow during local sim
2020-03-24 11:13:07 +00:00
task moduleTests, "Run all module tests":
Rename binaries; Mimic the original repo layout in the distribution
2020-11-07 18:00:31 +00:00
buildAndRunBinary "nimbus_beacon_node", "beacon_chain/",
"-d:chronicles_log_level=TRACE " &
remove v0.12.3 and medalla support (#2038)
2020-11-20 13:49:49 +00:00
"-d:const_preset=minimal " &
Rename binaries; Mimic the original repo layout in the distribution
2020-11-07 18:00:31 +00:00
"-d:testutils_test_build"
Spec-compliant implementation of Eth1 monitoring; Eth1-enabled local sim BEWARE! This commit will trigger a stack overflow during local sim
2020-03-24 11:13:07 +00:00
initial commit
2018-07-20 13:46:03 +00:00
### tasks
task test, "Run all tests":
lightweight stack traces - plus some light test runner refactoring and some Makefile cosmetic changes - compile tools with LOG_LEVEL=TRACE in CI - bump a couple of submodules
2020-02-13 12:19:12 +00:00
# We're enabling the TRACE log level so we're sure that those rarely used
# pieces of code get tested regularly. Increased test output verbosity is the
# price we pay for that.
remove v0.12.3 and medalla support (#2038)
2020-11-20 13:49:49 +00:00
buildAndRunBinary "test_fixture_const_sanity_check", "tests/official/", """-d:const_preset=minimal -d:chronicles_sinks="json[file]""""
buildAndRunBinary "test_fixture_const_sanity_check", "tests/official/", """-d:const_preset=mainnet -d:chronicles_sinks="json[file]""""
re-add minimal constant checking; organize presets by spec version (#1203) * re-add minimal preset constant checking; organize presets to better support multiple spec versions * bump spec ref * increase Azure timeout to 90 minutes to accomodate Nim compiler building
2020-06-20 07:12:45 +00:00
Opt-in Slashing protection + interchange (#1643) * Slashing protection + interchange initial commit * Restrict the when UseSlashingProtection dance in other modules * Integrate slashing tests in other all_tests * Add attestation slashing protection support * Add a message that mention if built with/without slashing protection * no op the initialization proc * test slashing protection in Jenkins (temp) * where to configure NIMFLAGS in Jenkins ... * Jenkins -> ensure Built with slashing protection * Add slashing protection complete import * use Opt.get(otherwise) * Don't use negation in proc name * Turn slashing protection on by default
2020-09-16 11:30:03 +00:00
# Generic SSZ test, doesn't use consensus objects minimal/mainnet presets
remove v0.12.3 and medalla support (#2038)
2020-11-20 13:49:49 +00:00
buildAndRunBinary "test_fixture_ssz_generic_types", "tests/official/", """-d:chronicles_log_level=TRACE -d:chronicles_sinks="json[file]""""
minimal v0.12.3 update (#1716)
2020-09-21 15:58:35 +00:00
add v1.0.0-rc.0 support behind compile-time flag (#1852) * add v1.0.0-rc.0 support behind compile-time flag * keep runtime presets consistent
2020-10-13 17:21:25 +00:00
# Consensus object SSZ tests
remove v0.12.3 and medalla support (#2038)
2020-11-20 13:49:49 +00:00
buildAndRunBinary "test_fixture_ssz_consensus_objects", "tests/official/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:chronicles_sinks="json[file]""""
add v1.0.0-rc.0 support behind compile-time flag (#1852) * add v1.0.0-rc.0 support behind compile-time flag * keep runtime presets consistent
2020-10-13 17:21:25 +00:00
Opt-in Slashing protection + interchange (#1643) * Slashing protection + interchange initial commit * Restrict the when UseSlashingProtection dance in other modules * Integrate slashing tests in other all_tests * Add attestation slashing protection support * Add a message that mention if built with/without slashing protection * no op the initialization proc * test slashing protection in Jenkins (temp) * where to configure NIMFLAGS in Jenkins ... * Jenkins -> ensure Built with slashing protection * Add slashing protection complete import * use Opt.get(otherwise) * Don't use negation in proc name * Turn slashing protection on by default
2020-09-16 11:30:03 +00:00
# EF tests
remove v0.12.3 and medalla support (#2038)
2020-11-20 13:49:49 +00:00
buildAndRunBinary "all_fixtures_require_ssz", "tests/official/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:chronicles_sinks="json[file]""""
Opt-in Slashing protection + interchange (#1643) * Slashing protection + interchange initial commit * Restrict the when UseSlashingProtection dance in other modules * Integrate slashing tests in other all_tests * Add attestation slashing protection support * Add a message that mention if built with/without slashing protection * no op the initialization proc * test slashing protection in Jenkins (temp) * where to configure NIMFLAGS in Jenkins ... * Jenkins -> ensure Built with slashing protection * Add slashing protection complete import * use Opt.get(otherwise) * Don't use negation in proc name * Turn slashing protection on by default
2020-09-16 11:30:03 +00:00
Slashing protection refactor - EIP 3076 (#2094) * Create CLI tool for slashing export * Use SQLite as a DB instead of a KV-store * Keeps v1 and v2 DBs around * Uses the same schema as Lighthouse v1.1.0 * Passes all interchange tests + skeleton of finalization pruning * Removes tests that would violate v5 / minimal slashing DB and MinSlot rules * Migration tool added using low-watermark scheme for faster migration of large number of validators
2021-02-09 15:23:06 +00:00
# EIP-3076 - Slashing interchange
buildAndRunBinary "test_official_interchange_vectors", "tests/slashing_protection/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:chronicles_sinks="json[file]""""
disable "minimal" preset tests
2020-06-17 17:41:59 +00:00
# Mainnet config
remove v0.12.3 and medalla support (#2038)
2020-11-20 13:49:49 +00:00
buildAndRunBinary "proto_array", "beacon_chain/fork_choice/", """-d:const_preset=mainnet -d:chronicles_sinks="json[file]""""
buildAndRunBinary "fork_choice", "beacon_chain/fork_choice/", """-d:const_preset=mainnet -d:chronicles_sinks="json[file]""""
buildAndRunBinary "all_tests", "tests/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:chronicles_sinks="json[file]""""
Work around BLST build issues
2020-10-30 14:30:19 +00:00
# TODO `test_keystore` is extracted from the rest of the tests because it uses conflicting BLST headers
remove v0.12.3 and medalla support (#2038)
2020-11-20 13:49:49 +00:00
buildAndRunBinary "test_keystore", "tests/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:chronicles_sinks="json[file]""""
Bump nim-blscurve (#1491) * Bump BLSCurve * Use unified aggregation API * use new blscurve with unified aggregate API * bump * fix toRaw * replace state_sim combine with AggregateSignature * Fix 32-bit * Fix 32-bit for real and test deactivating ccache for fno-tree-lopp-vectorize flag * change compilation switches to narrow down Linux issue * Use -fno-tree-vectorize to disable both tree-loop-vectorize and tree-slp-vectorize * blscurve now disables both Loop and SLP vectorization * Add tests for the miracl/milagro fallback * Travis has max log size of 4MB * Test with Miracl in the finalization test * fix state_sim log level * Coment out the slow fallback tests
2020-08-15 17:33:58 +00:00
Bump blst: perf + 32-bit platforms support + pure C fallback + drop Miracl fallback tests (#2152) * bump BLST * Cached subgroup checks * Bump BLST - BLST now has pure C fallback for all arch (Miracl unneeded) * Drop testing Miracl fallback in Nimbus * Charting uncharted waters: 32-bit should imply -mno-adx
2020-12-10 09:18:07 +00:00
# As BLST has a pure C fallback as of Dec 2020 undergoing audit and formal verification
# we skip Miracl checks as they are costly in CI time.
# # Check Miracl/Milagro fallback on select tests
# buildAndRunBinary "test_interop", "tests/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_sinks="json[file]""""
# buildAndRunBinary "test_process_attestation", "tests/spec_block_processing/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_sinks="json[file]""""
# buildAndRunBinary "test_process_deposits", "tests/spec_block_processing/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_sinks="json[file]""""
# buildAndRunBinary "all_fixtures_require_ssz", "tests/official/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_sinks="json[file]""""
# buildAndRunBinary "test_attestation_pool", "tests/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_sinks="json[file]""""
# buildAndRunBinary "test_block_pool", "tests/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_sinks="json[file]""""
Attempt to make the test suite green
2019-08-07 03:09:26 +00:00
remove v0.11.3 support; add block_sim to CI (#1253) * remove v0.11.3 support; add block_sim to CI * rm stray PERSISTENT_COMMITTEE_PERIOD * remove TopicFilter.InteropAttestations * bump two comment-spec-refs to v0.12.1
2020-06-29 18:08:58 +00:00
# State and block sims; getting to 4th epoch triggers consensus checks
remove v0.12.3 and medalla support (#2038)
2020-11-20 13:49:49 +00:00
buildAndRunBinary "state_sim", "research/", "-d:const_preset=mainnet -d:chronicles_log_level=INFO", "--validators=3000 --slots=128"
# buildAndRunBinary "state_sim", "research/", "-d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_log_level=INFO", "--validators=3000 --slots=128"
buildAndRunBinary "block_sim", "research/", "-d:const_preset=mainnet", "--validators=3000 --slots=128"
# buildAndRunBinary "block_sim", "research/", "-d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl", "--validators=3000 --slots=128"