status-im
/
nimbus-eth2
mirror of https://github.com/status-im/nimbus-eth2.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
nimbus-eth2/beacon_chain.nimble

90 lines
4.5 KiB
Plaintext
Raw Normal View History

Makefile that only works in a Git submodule (#210) - updated README.md - beacon_chain.nimble: accept compilation flags as params - nim.cfg: enable `--opt:speed` at the top level - simulation scripts: allow overriding GIT_ROOT and do some refactoring
2019-03-28 15:18:59 +00:00
mode = ScriptMode.Verbose
A LibP2P-based networking stack; To enable it, comment out the 'withLibp2p' line in nim.cfg The history was squashed in order to remove an accidentally commited binary file. Other changes: * SSZ was adapted to use the common serialization framework * gossibsup.subscribe is not using async handlers at the moment and this allowed me to simplify it
2019-03-05 22:54:08 +00:00
import
Fix the nimble version issue
2019-03-12 12:56:33 +00:00
beacon_chain/version as ver
A LibP2P-based networking stack; To enable it, comment out the 'withLibp2p' line in nim.cfg The history was squashed in order to remove an accidentally commited binary file. Other changes: * SSZ was adapted to use the common serialization framework * gossibsup.subscribe is not using async handlers at the moment and this allowed me to simplify it
2019-03-05 22:54:08 +00:00
initial commit
2018-07-20 13:46:03 +00:00
packageName = "beacon_chain"
A LibP2P-based networking stack; To enable it, comment out the 'withLibp2p' line in nim.cfg The history was squashed in order to remove an accidentally commited binary file. Other changes: * SSZ was adapted to use the common serialization framework * gossibsup.subscribe is not using async handlers at the moment and this allowed me to simplify it
2019-03-05 22:54:08 +00:00
version = versionAsStr
initial commit
2018-07-20 13:46:03 +00:00
author = "Status Research & Development GmbH"
Config CI + use Milagro BLS signatures
2018-09-26 16:26:39 +00:00
description = "Eth2.0 research implementation of the beacon chain"
initial commit
2018-07-20 13:46:03 +00:00
license = "MIT or Apache License 2.0"
spec updates (#45) * spec updates * random small updates * ssz no longer sorts by field, fix enum serialization * rewire block processing a little to avoid a few state copies * add a state simulation tool that writes out jsons
2018-12-21 22:37:46 +00:00
installDirs = @["beacon_chain", "research"]
Address review comments
2019-11-28 22:01:12 +00:00
skipDirs = @["nfuzz"]
spec updates (#45) * spec updates * random small updates * ssz no longer sorts by field, fix enum serialization * rewire block processing a little to avoid a few state copies * add a state simulation tool that writes out jsons
2018-12-21 22:37:46 +00:00
bin = @[
"beacon_chain/beacon_node",
spec updates (#48) * spec updates * balances move out to separate seq * bunch of placeholders for proof-of-custody / phase1 * fix inclusion distance adjustment * modify state in-place in `updateState` (tests spent over 80% time copying state! now it's down to 25-50) * document several conditions and conversations * some renames here and there to follow spec
2018-12-27 20:14:37 +00:00
"research/serialized_sizes",
get nbench compiling again
2020-02-27 11:14:24 +00:00
"nbench/nbench",
spec updates (#48) * spec updates * balances move out to separate seq * bunch of placeholders for proof-of-custody / phase1 * fix inclusion distance adjustment * modify state in-place in `updateState` (tests spent over 80% time copying state! now it's down to 25-50) * document several conditions and conversations * some renames here and there to follow spec
2018-12-27 20:14:37 +00:00
]
initial commit
2018-07-20 13:46:03 +00:00
### Dependencies
fix nim version dep
2019-02-07 11:02:40 +00:00
requires "nim >= 0.19.0",
initial state replay implementation * fix initial attestation pool on reordered attestations * simplify db layer api * load head block from database on startup, then load state * significantly changes database format * move subscriptions to separate proc's * implement block replay from historical state * avoid rescheduling epoch actions on block receipt (why?) * make sure genesis block is created and used * relax initial state sim parameters a bit
2019-02-21 04:42:17 +00:00
"blscurve",
work-in-progress beacon node skeleton (not compiling at the moment)
2018-11-23 23:58:49 +00:00
"chronicles",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"chronos",
work-in-progress beacon node skeleton (not compiling at the moment)
2018-11-23 23:58:49 +00:00
"confutils",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"eth",
Asyncdispatch2 rebranding to chronos (#84) * Asyncdispatch2 rebranding to chronos * nim-eth and nim-chronos part of nimble packages * fix package name
2019-02-06 17:56:04 +00:00
"json_rpc",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"json_serialization",
lightweight stack traces - plus some light test runner refactoring and some Makefile cosmetic changes - compile tools with LOG_LEVEL=TRACE in CI - bump a couple of submodules
2020-02-13 12:19:12 +00:00
"libbacktrace",
Added web3 dependency
2019-07-31 08:32:35 +00:00
"libp2p",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"metrics",
"nimcrypto",
"serialization",
"stew",
Spec-compliant implementation of Eth1 monitoring; Eth1-enabled local sim BEWARE! This commit will trigger a stack overflow during local sim
2020-03-24 11:13:07 +00:00
"testutils",
Integrate nim-prompt
2019-10-02 12:38:14 +00:00
"prompt",
Integrate nim-metrics and add some metrics from the ETH2 spec (#394)
2019-09-07 17:48:05 +00:00
"web3",
"yaml"
initial commit
2018-07-20 13:46:03 +00:00
### Helper functions
Azure: reduce 32-bit Windows job runtime (#1168) * Azure: lighten the load on 32-bit * disable mainnet tests on 32-bit Windows
2020-06-14 02:25:19 +00:00
proc buildAndRunBinary(name: string, srcDir = "./", params = "", cmdParams = "", lang = "c") =
initial commit
2018-07-20 13:46:03 +00:00
if not dirExists "build":
mkDir "build"
Makefile that only works in a Git submodule (#210) - updated README.md - beacon_chain.nimble: accept compilation flags as params - nim.cfg: enable `--opt:speed` at the top level - simulation scripts: allow overriding GIT_ROOT and do some refactoring
2019-03-28 15:18:59 +00:00
# allow something like "nim test --verbosity:0 --hints:off beacon_chain.nims"
var extra_params = params
for i in 2..<paramCount():
extra_params &= " " & paramStr(i)
Make: add USE_LIBBACKTRACE flag
2020-02-20 16:41:10 +00:00
exec "nim " & lang & " --out:./build/" & name & " -r " & extra_params & " " & srcDir & name & ".nim" & " " & cmdParams
initial commit
2018-07-20 13:46:03 +00:00
Spec-compliant implementation of Eth1 monitoring; Eth1-enabled local sim BEWARE! This commit will trigger a stack overflow during local sim
2020-03-24 11:13:07 +00:00
task moduleTests, "Run all module tests":
Azure: reduce 32-bit Windows job runtime (#1168) * Azure: lighten the load on 32-bit * disable mainnet tests on 32-bit Windows
2020-06-14 02:25:19 +00:00
buildAndRunBinary "beacon_node", "beacon_chain/",
Spec-compliant implementation of Eth1 monitoring; Eth1-enabled local sim BEWARE! This commit will trigger a stack overflow during local sim
2020-03-24 11:13:07 +00:00
"-d:chronicles_log_level=TRACE " &
remove v0.11.3 support; add block_sim to CI (#1253) * remove v0.11.3 support; add block_sim to CI * rm stray PERSISTENT_COMMITTEE_PERIOD * remove TopicFilter.InteropAttestations * bump two comment-spec-refs to v0.12.1
2020-06-29 18:08:58 +00:00
"-d:const_preset=minimal " &
Spec-compliant implementation of Eth1 monitoring; Eth1-enabled local sim BEWARE! This commit will trigger a stack overflow during local sim
2020-03-24 11:13:07 +00:00
"-d:testutils_test_build"
initial commit
2018-07-20 13:46:03 +00:00
### tasks
task test, "Run all tests":
lightweight stack traces - plus some light test runner refactoring and some Makefile cosmetic changes - compile tools with LOG_LEVEL=TRACE in CI - bump a couple of submodules
2020-02-13 12:19:12 +00:00
# We're enabling the TRACE log level so we're sure that those rarely used
# pieces of code get tested regularly. Increased test output verbosity is the
# price we pay for that.
re-add minimal constant checking; organize presets by spec version (#1203) * re-add minimal preset constant checking; organize presets to better support multiple spec versions * bump spec ref * increase Azure timeout to 90 minutes to accomodate Nim compiler building
2020-06-20 07:12:45 +00:00
# Just the part of minimal config which explicitly differs from mainnet
Bump nim-blscurve (#1491) * Bump BLSCurve * Use unified aggregation API * use new blscurve with unified aggregate API * bump * fix toRaw * replace state_sim combine with AggregateSignature * Fix 32-bit * Fix 32-bit for real and test deactivating ccache for fno-tree-lopp-vectorize flag * change compilation switches to narrow down Linux issue * Use -fno-tree-vectorize to disable both tree-loop-vectorize and tree-slp-vectorize * blscurve now disables both Loop and SLP vectorization * Add tests for the miracl/milagro fallback * Travis has max log size of 4MB * Test with Miracl in the finalization test * fix state_sim log level * Coment out the slow fallback tests
2020-08-15 17:33:58 +00:00
buildAndRunBinary "test_fixture_const_sanity_check", "tests/official/", """-d:const_preset=minimal -d:chronicles_sinks="json[file]""""
re-add minimal constant checking; organize presets by spec version (#1203) * re-add minimal preset constant checking; organize presets to better support multiple spec versions * bump spec ref * increase Azure timeout to 90 minutes to accomodate Nim compiler building
2020-06-20 07:12:45 +00:00
disable "minimal" preset tests
2020-06-17 17:41:59 +00:00
# Mainnet config
Bump nim-blscurve (#1491) * Bump BLSCurve * Use unified aggregation API * use new blscurve with unified aggregate API * bump * fix toRaw * replace state_sim combine with AggregateSignature * Fix 32-bit * Fix 32-bit for real and test deactivating ccache for fno-tree-lopp-vectorize flag * change compilation switches to narrow down Linux issue * Use -fno-tree-vectorize to disable both tree-loop-vectorize and tree-slp-vectorize * blscurve now disables both Loop and SLP vectorization * Add tests for the miracl/milagro fallback * Travis has max log size of 4MB * Test with Miracl in the finalization test * fix state_sim log level * Coment out the slow fallback tests
2020-08-15 17:33:58 +00:00
buildAndRunBinary "proto_array", "beacon_chain/fork_choice/", """-d:const_preset=mainnet -d:chronicles_sinks="json[file]""""
buildAndRunBinary "fork_choice", "beacon_chain/fork_choice/", """-d:const_preset=mainnet -d:chronicles_sinks="json[file]""""
buildAndRunBinary "all_tests", "tests/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:chronicles_sinks="json[file]""""
# Check Miracl/Milagro fallback on select tests
buildAndRunBinary "test_interop", "tests/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_sinks="json[file]""""
buildAndRunBinary "test_process_attestation", "tests/spec_block_processing/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_sinks="json[file]""""
buildAndRunBinary "test_process_deposits", "tests/spec_block_processing/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_sinks="json[file]""""
buildAndRunBinary "all_fixtures_require_ssz", "tests/official/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_sinks="json[file]""""
buildAndRunBinary "test_attestation_pool", "tests/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_sinks="json[file]""""
buildAndRunBinary "test_block_pool", "tests/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_sinks="json[file]""""
Attempt to make the test suite green
2019-08-07 03:09:26 +00:00
Integrate to the test suite
2019-11-06 11:17:03 +00:00
# Generic SSZ test, doesn't use consensus objects minimal/mainnet presets
Bump nim-blscurve (#1491) * Bump BLSCurve * Use unified aggregation API * use new blscurve with unified aggregate API * bump * fix toRaw * replace state_sim combine with AggregateSignature * Fix 32-bit * Fix 32-bit for real and test deactivating ccache for fno-tree-lopp-vectorize flag * change compilation switches to narrow down Linux issue * Use -fno-tree-vectorize to disable both tree-loop-vectorize and tree-slp-vectorize * blscurve now disables both Loop and SLP vectorization * Add tests for the miracl/milagro fallback * Travis has max log size of 4MB * Test with Miracl in the finalization test * fix state_sim log level * Coment out the slow fallback tests
2020-08-15 17:33:58 +00:00
buildAndRunBinary "test_fixture_ssz_generic_types", "tests/official/", """-d:chronicles_log_level=TRACE -d:chronicles_sinks="json[file]""""
Integrate to the test suite
2019-11-06 11:17:03 +00:00
# Consensus object SSZ tests
Bump nim-blscurve (#1491) * Bump BLSCurve * Use unified aggregation API * use new blscurve with unified aggregate API * bump * fix toRaw * replace state_sim combine with AggregateSignature * Fix 32-bit * Fix 32-bit for real and test deactivating ccache for fno-tree-lopp-vectorize flag * change compilation switches to narrow down Linux issue * Use -fno-tree-vectorize to disable both tree-loop-vectorize and tree-slp-vectorize * blscurve now disables both Loop and SLP vectorization * Add tests for the miracl/milagro fallback * Travis has max log size of 4MB * Test with Miracl in the finalization test * fix state_sim log level * Coment out the slow fallback tests
2020-08-15 17:33:58 +00:00
buildAndRunBinary "test_fixture_ssz_consensus_objects", "tests/official/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:chronicles_sinks="json[file]""""
Attempt to make the test suite green
2019-08-07 03:09:26 +00:00
Bump nim-blscurve (#1491) * Bump BLSCurve * Use unified aggregation API * use new blscurve with unified aggregate API * bump * fix toRaw * replace state_sim combine with AggregateSignature * Fix 32-bit * Fix 32-bit for real and test deactivating ccache for fno-tree-lopp-vectorize flag * change compilation switches to narrow down Linux issue * Use -fno-tree-vectorize to disable both tree-loop-vectorize and tree-slp-vectorize * blscurve now disables both Loop and SLP vectorization * Add tests for the miracl/milagro fallback * Travis has max log size of 4MB * Test with Miracl in the finalization test * fix state_sim log level * Coment out the slow fallback tests
2020-08-15 17:33:58 +00:00
buildAndRunBinary "all_fixtures_require_ssz", "tests/official/", """-d:chronicles_log_level=TRACE -d:const_preset=mainnet -d:chronicles_sinks="json[file]""""
Azure: reduce 32-bit Windows job runtime (#1168) * Azure: lighten the load on 32-bit * disable mainnet tests on 32-bit Windows
2020-06-14 02:25:19 +00:00
remove v0.11.3 support; add block_sim to CI (#1253) * remove v0.11.3 support; add block_sim to CI * rm stray PERSISTENT_COMMITTEE_PERIOD * remove TopicFilter.InteropAttestations * bump two comment-spec-refs to v0.12.1
2020-06-29 18:08:58 +00:00
# State and block sims; getting to 4th epoch triggers consensus checks
Bump nim-blscurve (#1491) * Bump BLSCurve * Use unified aggregation API * use new blscurve with unified aggregate API * bump * fix toRaw * replace state_sim combine with AggregateSignature * Fix 32-bit * Fix 32-bit for real and test deactivating ccache for fno-tree-lopp-vectorize flag * change compilation switches to narrow down Linux issue * Use -fno-tree-vectorize to disable both tree-loop-vectorize and tree-slp-vectorize * blscurve now disables both Loop and SLP vectorization * Add tests for the miracl/milagro fallback * Travis has max log size of 4MB * Test with Miracl in the finalization test * fix state_sim log level * Coment out the slow fallback tests
2020-08-15 17:33:58 +00:00
buildAndRunBinary "state_sim", "research/", "-d:const_preset=mainnet -d:chronicles_log_level=INFO", "--validators=3000 --slots=128"
# buildAndRunBinary "state_sim", "research/", "-d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl -d:chronicles_log_level=INFO", "--validators=3000 --slots=128"
fix attestation handling bottlenecks in slot processing and quadratic-time inclusion delay rewards/palties in epoch processing; create infrastructure for dynamically (un)subscribing to/from attestation topics (#1294)
2020-07-10 09:24:04 +00:00
buildAndRunBinary "block_sim", "research/", "-d:const_preset=mainnet", "--validators=3000 --slots=128"
Bump nim-blscurve (#1491) * Bump BLSCurve * Use unified aggregation API * use new blscurve with unified aggregate API * bump * fix toRaw * replace state_sim combine with AggregateSignature * Fix 32-bit * Fix 32-bit for real and test deactivating ccache for fno-tree-lopp-vectorize flag * change compilation switches to narrow down Linux issue * Use -fno-tree-vectorize to disable both tree-loop-vectorize and tree-slp-vectorize * blscurve now disables both Loop and SLP vectorization * Add tests for the miracl/milagro fallback * Travis has max log size of 4MB * Test with Miracl in the finalization test * fix state_sim log level * Coment out the slow fallback tests
2020-08-15 17:33:58 +00:00
# buildAndRunBinary "block_sim", "research/", "-d:const_preset=mainnet -d:BLS_FORCE_BACKEND=miracl", "--validators=3000 --slots=128"