164d171bd9
revert previous commit
2020-04-17 20:27:42 +02:00
ef92529feb
fix remaining block sanity test vectors
2020-04-17 20:25:18 +02:00
17a0a965fc
ambiguous calls between toHex from byteutils and nimcrypto ( #901 )
...
* Fix potential ambiguous calls between toHex from byteutils and nimcrypto due to mixin
* remove the mixins
2020-04-17 20:10:39 +02:00
3df9a22ff7
fix remaining attester slashing tests from EF phase0 spec tests by checking for uniqueness
2020-04-17 16:01:32 +00:00
05d1d1246a
bump a couple more eth2 phase0 spec refs to v0.11.1
2020-04-17 16:37:52 +03:00
943a7da610
bump some eth2 phase0 spec refs to v0.11.1
2020-04-17 16:37:52 +03:00
4f970a067a
fix variable offset bounding/comparison
2020-04-17 16:37:52 +03:00
71e802c740
harden SSZ reader
2020-04-17 16:37:52 +03:00
8b6c51e78d
secp: convenience api ( #897 )
2020-04-17 15:29:49 +02:00
a4830976ab
hotfix: fix the selecting of the syncing protocol handlers
2020-04-16 15:01:19 +03:00
7b8d6ea61c
bump vendor/nimbus-build-system ( #894 )
...
* bump vendor/nimbus-build-system
* change beacon_node banner
* beacon_node: update copyright years
* version.nim is imported in beacon_chain.nimble
2020-04-16 00:20:27 +02:00
c44d66c697
Fix more typos
2020-04-16 01:01:18 +03:00
99f9bc4eee
Fix the inspector build
2020-04-16 01:01:18 +03:00
672f690bf6
Implement most of the v0.11.1 networking changes
2020-04-16 01:01:18 +03:00
8d639d9bd7
Avoid accidental memory allocations in SSZ
2020-04-16 01:01:18 +03:00
22e5f8165e
Don't use `defer` in eth2_network to avoid https://github.com/nim-lang/Nim/issues/13899
2020-04-16 01:01:18 +03:00
f34fd46e3a
Add snappy and protobuf-serialization; Use the latest FastStreams API
2020-04-16 01:01:18 +03:00
d559f4ee89
create distinct CommitteeIndex type
2020-04-15 09:59:49 +00:00
f49dbf68e6
refactor some Merkle proof generation code outside tests; remove unused variables/functions
2020-04-15 09:59:49 +00:00
8eafa6e094
fork: push defect ( #888 )
2020-04-15 11:21:22 +02:00
b7a32a17ba
bump submodules
...
and remove failing syncManagerGroupRecoveryTest
2020-04-14 18:21:56 +02:00
cab68c28ef
fixed name in logging - was causing confusing (and wrong) output regarding the filalized slots
2020-04-13 18:17:24 +03:00
d25d674502
Remove more warnings, both deprecations and unused imports ( #884 )
...
* fix warnings by switching from deprecated chronos API addTimer(...) to setTimer(...) and removing especially some unnecessary chronicles and extras imports from test suite modules
* update a couple v0.10.1 spec references to v0.11.1
2020-04-11 19:41:50 +02:00
afa08c8e3c
crypto: cleanup ( #882 )
...
* crypto: cleanup
* fix several Defect-on-user-input
* make crypto interface more similar to secp
* use `crypto.nim` in all of nbc
* digest: raises
* fix
* vendor
2020-04-11 10:51:07 +02:00
31bf8fa408
remove all but one UnusedImport warning ( #881 )
...
* remove all but one UnusedImport warning
* bump a few more spec version references from v0.10.1 to v0.11.1
* more v0.10.1 spec reference updates/removals
* yet more v0.10.1 spec reference updates
2020-04-10 16:06:24 +02:00
ccbbce79a9
Mostly remove skipMerkleValidation by fixing Merkle proof construction/usage ( #879 )
...
* refactor and fix merkle proof construction in test suite and thereby remove most remaining skipMerkleValidation flags, now unnecessary
* a few non-semantic comment update/removals
2020-04-10 15:59:17 +02:00
cbc998ed93
[Ready 1/2] Fork choice rewrite ( #865 )
...
* initial fork-choice refactor
* Add fork_choice test for "no votes"
* Initial test with voting: fix handling of unknown validators and parent blocks
* Fix tiebreak of votes
* Cleanup debugging traces
* Complexify the vote test
* fakeHash use the bigEndian repr of number + fix tiebreak for good
* Stash changes: found critical bug in nimcrypto `==` and var openarray
* Passing fork choice tests with varying votes
* Add FFG fork choice scenario + fork choice to the test suite
* Not sure why lmdb / rocksdb reappeared in rebase
* Add sanity checks to .nimble file + integrate fork choice tests to the test DB and test timing
* Cleanup debugging echos
* nimcrypto fix https://github.com/status-im/nim-beacon-chain/pull/864 as been merged, remove TODO comment
* Turn fork choice exception-free
* Cleanup "result" to ensure early return is properly used
* Add a comment on private/public error code vs Result
* result -> results following https://github.com/status-im/nim-beacon-chain/pull/866
* Address comments:
- raises: [Defect] doesn't work -> TODO
- process_attestation cannot fail
- try/except as expression pending Nim v1.2.0
- cleanup TODOs
* re-enable all sanity checks
* tag no raise for process_attestation
* use raises defect everywhere in fork choice and fix process_attestation test
2020-04-09 18:15:00 +02:00
0f47c76b50
reenable block bls verification ( #875 )
...
* finalizing state_transition
* cleanup
Co-authored-by: Dustin Brody <tersec@users.noreply.github.com>
2020-04-09 09:41:02 +00:00
96431bfd86
post-merge fixes
2020-04-08 23:09:52 +02:00
b574799088
Merge branch 'devel'
2020-04-08 22:54:18 +02:00
2930b65eb4
[skip ci] simple logging fix
2020-04-07 19:04:49 +03:00
b4fc641b8c
result->results, bump bearssl
2020-04-07 12:08:59 +00:00
2771deadfc
re-add test_interop to all_tests and mark several v0.10.1 phase 0 spec references as v0.11.1
2020-04-07 13:16:55 +03:00
e7de8aae20
fix/restore 0.11.1 BeaconState genesis interop: (a) use GENESIS_FORK_VERSION properly in BeaconState init; (b) use GENESIS_FORK_VERSION to be compatible with zcli/zrnt initial eth1 deposits; (c) let List[foo] work with 64-bit ints, so BeaconState.validators SSZ-serializes properly; and (d) update test_interop to use new spec/crypto API
2020-04-07 13:16:55 +03:00
e1d18b431b
reraise defect in generic exception handler
2020-04-06 20:08:39 +02:00
b9cc91aef8
keep up with nim-eth
2020-04-06 14:13:20 +03:00
04cf6d30eb
vendor: bump nim-eth + fallout ( #861 )
2020-04-05 11:50:31 +02:00
60df05a420
mark several v0.10.1 spec references as v0.11.1-compatible
2020-04-04 13:43:04 +00:00
f9e45dc121
document and temporary workaround for extended validation issue
2020-04-04 13:43:04 +00:00
d180724d41
Bump eth ( #857 )
...
* vendor: bump stew
* vendor: bump nim-eth
* vendor: bump web3 too
2020-04-03 11:12:38 +02:00
fc2fff249b
Discv5: Don't pass ip address when external ip is not known
2020-04-02 00:52:34 +03:00
ea59f2ecf2
comments-only changes: update a bunch of v0.10.1 spec references to v0.11.0 and explain rationale for extended validation design in code ( #847 )
2020-04-01 11:41:39 +00:00
6eb4f1f39d
initial attestation aggregation ( #769 )
...
* initial attestation aggregation
* fix usage of committee index, vs index in committee; uniformly set trailing/following distance; document how the only-broadcast-if mechanism works better and what aggregation already happens, not otherwise sufficiently clear; use correct BlockSlot across epoch boundaries
* address inconsistent notion of which slot in past to target for aggregate broadcast; follow 0.11.x aggregate broadcast p2p interface topic
* Fix get_slot_signature(...) call after get_domain(...) change required genesis_validators_root
* mark all spec references which aren't dealt with in other PRs as v0.11.1
* update two more spec refs to v0.11.1
2020-04-01 09:59:55 +00:00
cd388bc9bb
extended validation ( #812 )
...
* initial extended validation setup
* flesh out all TODO items for attestation and beaconblock verification
* fix finalization and add chronicles debugging messages
* directly use blockPool.headState rather than pointlessly updating it and document this constraint
* fix logic relating to first-attestation checking; support validating blocks across multiple forks
2020-03-31 18:39:02 +00:00
daabb1b5b2
complete all (non-semantic, comment-only) 0.11.0 -> 0.11.1 beacon chain spec updates, mark all beacon chain v0.11.0 spec references as v0.11.1, and remove now unnecessary/unused UpdateFlags vars from 4 test fixtures ( #841 )
2020-03-30 23:40:24 +00:00
e37c12b810
Merge branch 'peerinfo' into devel
2020-03-30 19:55:24 +02:00
f5f939bd31
0.11.1 beacon chain spec update ( #836 )
...
* initial 0.11.1 spec commit; no test regressions and finalizes in eth2_network_simulation
* with BLS 0.10/0.11 available, stop skipping attester slashing, proposer slashing, and voluntary exist operations fixture tests
* switch param orders to group state.{fork, genesis_validators_root}; bump spec/datatypes spec version for network purposes
* mark attestation construction and broadcast and some minimal/mainnet constants as 0.11.1-compatible; remove phase 1 sharding constants from minimal which don't exist in that preset
2020-03-30 11:31:44 +00:00
97abe77398
close unused PeerInfo instance
...
Should not be needed from the GC's point of view, but needed when
gathering Future.state statistics, due to `PeerInfo.lifefut`.
2020-03-30 00:23:01 +02:00
46e395c647
Switch to GossipSub
2020-03-25 23:32:05 +02:00
22876da593
Fix gcsafety issues in the test suite
2020-03-24 22:14:40 +02:00
86a3bea1ec
Use the latest Chronos and Libp2p
2020-03-24 22:14:40 +02:00
b80a5b90df
Adjustments to store bootnode enrs in discovery object + bump nim-eth
2020-03-24 22:14:40 +02:00
f2434139e9
Hotfix: Don't report failure to connect to bootstrap node due to the initial sync taking more than 30 seconds
2020-03-23 22:29:50 +02:00
d63e4870e6
Fix Stream EOF problem.
2020-03-23 22:21:27 +02:00
bd5400aea4
Oops, change back the default network_type in the master branch
2020-03-23 18:19:31 +02:00
64fbad1efa
Some build fixes required for pushing testnet0
2020-03-23 16:13:11 +02:00
46a3009c63
Restore the address file feature (and use it for synchronization in local sim)
2020-03-23 14:59:33 +02:00
4623aa81ec
Clean up some obsolete code
2020-03-23 14:59:33 +02:00
d5e4e640b4
Merge libp2p_backend into eth2_network
2020-03-23 14:59:33 +02:00
0c018cb68a
Mechanically remove all mentions of the daemon from the code
2020-03-23 14:59:33 +02:00
8300cee131
Merge the contents of backends_common in libp2p_backend
2020-03-23 14:59:33 +02:00
5868afe341
Restore compilation with -d:p2pdump
2020-03-22 19:28:11 +02:00
286d6e14da
Attempt to fix the Travis ARM build
2020-03-22 19:00:09 +02:00
1d78a43724
Don't return Option[BlockRef] because BlockRef is a ref type
2020-03-22 19:00:09 +02:00
d2b7ee27de
The RPC service listens on localhost by default
2020-03-22 19:00:09 +02:00
7d2381240f
Bump nim-eth and nim-json-rpc
2020-03-22 19:00:09 +02:00
19847bbd20
Remove some warnings
2020-03-22 19:00:09 +02:00
5a2a52869e
Add a RPC proc similar to /spec/eth2_config
2020-03-22 19:00:09 +02:00
adcec61081
Initial implementation of a JSON-RPC service
2020-03-22 19:00:09 +02:00
53e4b0a26c
complete (except for get_domain(...)) 0.11.0 beacon chain spec update ( #822 )
...
* complete (except for get_domain(...)) 0.11.0 beacon chain spec update
* mark compute_start_slot_at_epoch(...), is_active_validator(...), compute_signing_root(...), and get_seed(...) as 0.11.0
2020-03-22 16:03:07 +00:00
689bcf71c4
clean up block creation
...
* consistently use state at new block slot to produce block
* factor out signature funcs
* fix missing block application test
2020-03-22 11:15:07 +00:00
ccace9a034
Fix shortlog crypto ( #818 )
...
* fix shortlogs of crypto types
* Valid signature without a "real: " prefix tag
* remove 0x prefix
2020-03-19 17:18:48 +01:00
f7ecd09e95
mark aggregate(...), AttesterSlashing, IndexedAttestation, AttestationData, Deposit, DepositData, VoluntaryExit, BeaconBlock, BeaconBlockHeader, BeaconState, HistoricalBatch, Fork, SigningRoot, SignedVoluntaryExit, SignedBeaconBlock, SignedBeaconBlockHeader, get_current_epoch(...), and get_randao_mix(...) as 0.11.0
2020-03-17 12:06:56 +02:00
cae1c0fd1a
address beacon_node TODO regarding missing proposer index; mark initiate_validator_exit(...), is_eligible_for_activation_queue(...), Attestation, DepositMessage, BeaconBlockBody, PendingAttestation, Eth1Data, and integer_squareroot(...) as 0.11.0
2020-03-17 12:06:56 +02:00
ebcde664e5
mark decrease_balance(...), get_validator_churn_limit(...), network spec version, Checkpoint, compute_epoch_at_slot(...), get_active_validator_indices(...), and get_committee_count_at_slot(...) as 0.11.0
2020-03-17 12:06:56 +02:00
313109c743
align process_block(...) name with spec; fix beacon chain proposer index generation when some validators aren't active to fix the two regressing 0.11.0 block sanity tests
2020-03-17 12:06:56 +02:00
11300fc290
fix finalization
2020-03-17 12:06:56 +02:00
6068dd960b
initial 0.11.0 spec version update
2020-03-17 12:06:56 +02:00
33687c3e41
remove lmdb ( #809 )
2020-03-14 11:33:37 +01:00
2aae54a15f
Fix serialization of deposits
2020-03-13 12:20:41 +00:00
c1c7435808
Skip tests:
...
- EF - attester slashings - 2 tests
- EF - sanity blocks - 1 test
- NBC - attestation - 1 test
2020-03-13 12:20:41 +00:00
88002ddb02
Fix ambiguous call newKeyPair
2020-03-13 12:20:41 +00:00
28dc8a6a29
Fix mock signatures/validator keys and stack smashing
2020-03-13 12:20:41 +00:00
65d668c3f6
Update validator keygen
2020-03-13 12:20:41 +00:00
14bc9e60ca
"init" should handle fake/invalid pubkeys and signatures
2020-03-13 12:20:41 +00:00
3c140d0c3d
Try to solve the stack smashing / discriminant changes object branch
2020-03-13 12:20:41 +00:00
31bd13a5d3
init for mainchain_monitor
2020-03-13 12:20:41 +00:00
bfd4df912e
Update to BLS v0.10.1
2020-03-13 12:20:41 +00:00
ab0879958a
don't log message content in P2PStream.readMsgBytes()
...
because it adds too much noise to the trace logs
2020-03-12 13:50:21 +02:00
d802fa593c
Add pubsub message logging.
...
Initial commit of logtrace tool.
2020-03-11 17:26:30 +00:00
0d3de00714
remove unused imports
2020-03-11 10:50:55 +00:00
a327c82820
Revert "finalizing state_transition ( #792 )"
...
This reverts commit 91d75bdfdd
2020-03-10 16:44:42 +00:00
91d75bdfdd
finalizing state_transition ( #792 )
2020-03-10 12:19:00 +01:00
7902d070cd
prefer endians2
2020-03-05 18:13:28 +02:00
9a3db7a81f
[WIP] Fake bls at runtime ( #735 )
...
* Initial implementation of runtime bls skipping.
Add libnfuzz skipBLSValidation handling, check that it propagates.
* Rename skipBLSValidation -> skipBlsValidation, start skipStateRootValidation
* Replace skipValidation flags with more granular flags.
Also added skipBlockParentRootValidation flag
Mainly replaced with skipBlsValidation but also StateRoot or
BlockParentRootValidation flags where appropriate.
* Adjust interop test to pass when skipping merkle validation.
* Stop skipping validation for mainchain_monitor.
* Remove comment.
* Also skipMerkleValidation for test_beacon_chain_db.
2020-03-05 13:52:10 +01:00
c382c6434a
Use peerPool len + fix removal of peerPool on disconnect
2020-03-05 13:17:34 +02:00
02717a6354
Use randomNodes from discv5 instead of lookup
2020-03-05 13:17:34 +02:00
91f87b55b4
SignedBeaconBlock in state_transition ( #773 )
...
* using SignedBeaconBlock in state_transition
2020-02-29 16:15:44 +01:00
ab1a08084b
One more attempt to fix compilation error.
2020-02-28 14:44:41 +02:00
278b91d6ce
Supporting 2 backends is hell.
2020-02-28 14:44:41 +02:00
5ae0026f72
Fix one more compilation error.
2020-02-28 14:44:41 +02:00
dd316e04d1
Fix one more compilation error.
2020-02-28 14:44:41 +02:00
0f0a839444
Fix compilation errors.
2020-02-28 14:44:41 +02:00
547c8a44d0
Replace Table[PeerID, Peer] with PeerPool.
...
Add `score` Peer.
2020-02-28 14:44:41 +02:00
c2c570fcb0
bump submodules
...
plus a few small modifications
2020-02-26 01:14:20 +01:00
3d99c7b28e
mark some spec functions .used. to avoid warnings; misc cleanups
2020-02-25 09:17:06 +00:00
fa0f3b4468
Use the specified extip address in the advertised ENR records
2020-02-22 20:54:15 +02:00
425b0e13da
remove potential error condition in getAttestationTopic; subscribe to all topics in parallel; add test cases for larger-than-ATTESTATION_SUBNET_COUNT committee indexes
2020-02-21 19:44:03 +00:00
62584b633e
update relevant portions of attestation aggregation spec version; tweak inspector
2020-02-21 19:44:03 +00:00
a8567cafb5
mark out where/how AttestationData and Attestation construction are honest validator-compliant
2020-02-21 19:44:03 +00:00
32872c7ee6
bump spec version to 0.10.1 (more accurate than 0.10.0); fix inspector building
2020-02-21 19:44:03 +00:00
6c87af9aab
split attestation beacon topic per honest validator spec
2020-02-21 19:44:03 +00:00
bced5ca656
implement is_proposer(...)
2020-02-21 19:44:03 +00:00
4782ae06e6
implement get_committee_assignment(...) by spec transcription
2020-02-21 19:44:03 +00:00
08915ed597
bump libp2p and increase bootstrap timeout
2020-02-21 12:03:19 -06:00
c25f8d4adf
sqlite kvstore backend ( #749 )
2020-02-20 11:49:34 +01:00
9e58e22761
[skip ci] remove an obsolete comment
2020-02-20 10:58:38 +02:00
5742299c94
Fix freezes in connection initialization.
2020-02-20 10:58:38 +02:00
880b981a0a
Don't wait for 10 seconds when connecting to the network
2020-02-19 12:45:34 +02:00
55886ff0ac
More proper fix replacing hotfix 052a6ac3bc
...
nim-eth was bumped to take advantage of a fixed `==` for public eth keys
2020-02-19 11:59:38 +02:00
3b9e9fefa8
Make the persistent network keys compatible with the Go daemon
...
The daemon requires its key file to be encoded as ProtoBuf value
with a proper `key scheme` discriminator.
2020-02-19 10:58:10 +02:00
1b1cd915db
Support ENR boot records with the Go daemon
2020-02-19 10:26:32 +02:00
052a6ac3bc
Hotfix: disable the bootstrap node connectivity check
...
This used to behave properly before the rebase, but currently
it forces the bootstrap node to exit, because it ends up being
launched with an ENR list telling it to connect to itself.
The root cause will be investigated in a follow-up PR.
2020-02-18 20:42:25 +02:00
57811dce89
Don't log unwanted lines in beacon_node --help
2020-02-18 12:53:49 +02:00
b2d5aba749
Advertise the TCP port of the bootstrap node properly
2020-02-18 12:53:49 +02:00
2a3e40e298
Fix test_discovery_helpers
2020-02-18 12:53:49 +02:00
2c814db750
Temporary switch to supporting only ENR bootstrap addresses
...
Turns out the DiscV5 code relies heavily on the presence of ENR
records at the moment, so we cannot drive it with ENodes. @kdeme
is working on refactoring that will relax these requirements.
2020-02-18 12:53:49 +02:00
7f395e554a
WIP Working local network sim with discovery
...
* The bootstrap_nodes.txt file in the node's data dir is now optional
* Log more data on start-up
* Use the latest ENR APIs
* Fix simulation build errors
2020-02-18 12:53:49 +02:00
d2f59ebab9
Switch to ENR records in the bootstrap_nodes.txt file
2020-02-18 12:53:49 +02:00
ee7c2c9dff
Unify the bootstrap nodes handling code
...
We no longer discriminate between ENR, MultiAddress or ENode
bootstrap records (all of them are remapped to ENodes).
The discovery loop will stochastically try to reconnect to
accidentally disconnected nodes.
2020-02-18 12:53:49 +02:00
4fb654f2af
Remove some SSZ compilation warnings
2020-02-18 12:53:49 +02:00
a620c83916
Handle status bar spanning multiple lines (relevant for the Tmux network sim)
2020-02-18 12:53:49 +02:00
bde1eefdcf
improve option naming
2020-02-17 22:00:41 +00:00
e13846bec6
allow beacon_node to verify finalization when appropriate, and enable by default for make eth2_network_simulation
2020-02-17 22:00:41 +00:00
d99ce1bcf0
fix json compile
2020-02-08 19:42:45 +01:00
521b0ed6ba
Clean 20200205 ( #729 )
...
* beacon node code cleanup
* rudimentary error checking on mainnet monitor
* start client even when sending deposit
* work around missing block number exception
* connect to testnet with web3 url
* pretty-print digests in json
2020-02-07 08:13:38 +01:00
09d735212d
initial refactoring of block sanity test runner, with several new tests ( #736 )
...
* initial refactoring of block sanity test runner, with several new tests enabled
* remove trailing whitespace
2020-02-07 08:11:26 +01:00
7efd113a75
store empty slot states also
2020-02-05 19:24:07 +00:00
fb9c4fabf4
fix state rewind
...
* rewind fast path comparison was not taking skipped slots into account
properly
* less messy blockref creation
2020-02-05 19:24:07 +00:00
b39f36b49b
use floodsub instead of gossipsub
2020-02-05 17:20:04 +01:00
1ffc2df23d
add a couple new deposit tests; fix the false-positive BLS verifications while keeping all but two tests working, despite mismatched 0.9/0.10 BLS standards; better-factor the skipping of BLS validation and Merkle tree validation
2020-02-04 18:39:38 +00:00
e4922cb177
implement compute_signing_root() and mark some functions as 0.10.1-compatible
2020-02-04 12:24:30 +00:00
45dd12cf3f
update process_deposit() to actually check is_valid_merkle_branch() unless skipValidation specified
2020-01-30 09:31:08 +00:00
98dc701473
Add PeerPool.addPeer async version and tests.
2020-01-29 15:28:41 +00:00
db20fc1172
Fix SyncQueue push(data) bug.
...
Rename lastSlot to HeadSlot.
Add failure test.
2020-01-29 15:28:41 +00:00
73dc72583f
Initial commit.
2020-01-29 15:28:41 +00:00
1f1a244f3f
Implement more checks and wire up the invalid SSZ tests
2020-01-29 10:10:28 +02:00
182593ccb5
Tenative fix for the test suite
2020-01-29 10:10:28 +02:00
2a3c237bbb
Handle malformed SSZ inputs properly
2020-01-29 10:10:28 +02:00
60b1775879
update check_attestation/process_attestation() to 0.10.1 and fill in missing check
2020-01-28 12:07:33 +02:00
Dustin Brody
Mamy Ratsimbazafy
Jacek Sieka
Zahary Karadjov
Ștefan Talpalaru
Viktor Kirilov
kdeme
cheatfate
Joao Gabriel Carvalho
Dmitriy Ryajov