bd5400aea4
Oops, change back the default network_type in the master branch
2020-03-23 18:19:31 +02:00
64fbad1efa
Some build fixes required for pushing testnet0
2020-03-23 16:13:11 +02:00
46a3009c63
Restore the address file feature (and use it for synchronization in local sim)
2020-03-23 14:59:33 +02:00
4623aa81ec
Clean up some obsolete code
2020-03-23 14:59:33 +02:00
d5e4e640b4
Merge libp2p_backend into eth2_network
2020-03-23 14:59:33 +02:00
0c018cb68a
Mechanically remove all mentions of the daemon from the code
2020-03-23 14:59:33 +02:00
8300cee131
Merge the contents of backends_common in libp2p_backend
2020-03-23 14:59:33 +02:00
5868afe341
Restore compilation with -d:p2pdump
2020-03-22 19:28:11 +02:00
286d6e14da
Attempt to fix the Travis ARM build
2020-03-22 19:00:09 +02:00
1d78a43724
Don't return Option[BlockRef] because BlockRef is a ref type
2020-03-22 19:00:09 +02:00
d2b7ee27de
The RPC service listens on localhost by default
2020-03-22 19:00:09 +02:00
7d2381240f
Bump nim-eth and nim-json-rpc
2020-03-22 19:00:09 +02:00
19847bbd20
Remove some warnings
2020-03-22 19:00:09 +02:00
5a2a52869e
Add a RPC proc similar to /spec/eth2_config
2020-03-22 19:00:09 +02:00
adcec61081
Initial implementation of a JSON-RPC service
2020-03-22 19:00:09 +02:00
53e4b0a26c
complete (except for get_domain(...)) 0.11.0 beacon chain spec update ( #822 )
...
* complete (except for get_domain(...)) 0.11.0 beacon chain spec update
* mark compute_start_slot_at_epoch(...), is_active_validator(...), compute_signing_root(...), and get_seed(...) as 0.11.0
2020-03-22 16:03:07 +00:00
689bcf71c4
clean up block creation
...
* consistently use state at new block slot to produce block
* factor out signature funcs
* fix missing block application test
2020-03-22 11:15:07 +00:00
ccace9a034
Fix shortlog crypto ( #818 )
...
* fix shortlogs of crypto types
* Valid signature without a "real: " prefix tag
* remove 0x prefix
2020-03-19 17:18:48 +01:00
f7ecd09e95
mark aggregate(...), AttesterSlashing, IndexedAttestation, AttestationData, Deposit, DepositData, VoluntaryExit, BeaconBlock, BeaconBlockHeader, BeaconState, HistoricalBatch, Fork, SigningRoot, SignedVoluntaryExit, SignedBeaconBlock, SignedBeaconBlockHeader, get_current_epoch(...), and get_randao_mix(...) as 0.11.0
2020-03-17 12:06:56 +02:00
cae1c0fd1a
address beacon_node TODO regarding missing proposer index; mark initiate_validator_exit(...), is_eligible_for_activation_queue(...), Attestation, DepositMessage, BeaconBlockBody, PendingAttestation, Eth1Data, and integer_squareroot(...) as 0.11.0
2020-03-17 12:06:56 +02:00
ebcde664e5
mark decrease_balance(...), get_validator_churn_limit(...), network spec version, Checkpoint, compute_epoch_at_slot(...), get_active_validator_indices(...), and get_committee_count_at_slot(...) as 0.11.0
2020-03-17 12:06:56 +02:00
313109c743
align process_block(...) name with spec; fix beacon chain proposer index generation when some validators aren't active to fix the two regressing 0.11.0 block sanity tests
2020-03-17 12:06:56 +02:00
11300fc290
fix finalization
2020-03-17 12:06:56 +02:00
6068dd960b
initial 0.11.0 spec version update
2020-03-17 12:06:56 +02:00
33687c3e41
remove lmdb ( #809 )
2020-03-14 11:33:37 +01:00
2aae54a15f
Fix serialization of deposits
2020-03-13 12:20:41 +00:00
c1c7435808
Skip tests:
...
- EF - attester slashings - 2 tests
- EF - sanity blocks - 1 test
- NBC - attestation - 1 test
2020-03-13 12:20:41 +00:00
88002ddb02
Fix ambiguous call newKeyPair
2020-03-13 12:20:41 +00:00
28dc8a6a29
Fix mock signatures/validator keys and stack smashing
2020-03-13 12:20:41 +00:00
65d668c3f6
Update validator keygen
2020-03-13 12:20:41 +00:00
14bc9e60ca
"init" should handle fake/invalid pubkeys and signatures
2020-03-13 12:20:41 +00:00
3c140d0c3d
Try to solve the stack smashing / discriminant changes object branch
2020-03-13 12:20:41 +00:00
31bd13a5d3
init for mainchain_monitor
2020-03-13 12:20:41 +00:00
bfd4df912e
Update to BLS v0.10.1
2020-03-13 12:20:41 +00:00
ab0879958a
don't log message content in P2PStream.readMsgBytes()
...
because it adds too much noise to the trace logs
2020-03-12 13:50:21 +02:00
d802fa593c
Add pubsub message logging.
...
Initial commit of logtrace tool.
2020-03-11 17:26:30 +00:00
0d3de00714
remove unused imports
2020-03-11 10:50:55 +00:00
a327c82820
Revert "finalizing state_transition ( #792 )"
...
This reverts commit 91d75bdfdd
2020-03-10 16:44:42 +00:00
91d75bdfdd
finalizing state_transition ( #792 )
2020-03-10 12:19:00 +01:00
7902d070cd
prefer endians2
2020-03-05 18:13:28 +02:00
9a3db7a81f
[WIP] Fake bls at runtime ( #735 )
...
* Initial implementation of runtime bls skipping.
Add libnfuzz skipBLSValidation handling, check that it propagates.
* Rename skipBLSValidation -> skipBlsValidation, start skipStateRootValidation
* Replace skipValidation flags with more granular flags.
Also added skipBlockParentRootValidation flag
Mainly replaced with skipBlsValidation but also StateRoot or
BlockParentRootValidation flags where appropriate.
* Adjust interop test to pass when skipping merkle validation.
* Stop skipping validation for mainchain_monitor.
* Remove comment.
* Also skipMerkleValidation for test_beacon_chain_db.
2020-03-05 13:52:10 +01:00
c382c6434a
Use peerPool len + fix removal of peerPool on disconnect
2020-03-05 13:17:34 +02:00
02717a6354
Use randomNodes from discv5 instead of lookup
2020-03-05 13:17:34 +02:00
91f87b55b4
SignedBeaconBlock in state_transition ( #773 )
...
* using SignedBeaconBlock in state_transition
2020-02-29 16:15:44 +01:00
ab1a08084b
One more attempt to fix compilation error.
2020-02-28 14:44:41 +02:00
278b91d6ce
Supporting 2 backends is hell.
2020-02-28 14:44:41 +02:00
5ae0026f72
Fix one more compilation error.
2020-02-28 14:44:41 +02:00
dd316e04d1
Fix one more compilation error.
2020-02-28 14:44:41 +02:00
0f0a839444
Fix compilation errors.
2020-02-28 14:44:41 +02:00
547c8a44d0
Replace Table[PeerID, Peer] with PeerPool.
...
Add `score` Peer.
2020-02-28 14:44:41 +02:00
c2c570fcb0
bump submodules
...
plus a few small modifications
2020-02-26 01:14:20 +01:00
3d99c7b28e
mark some spec functions .used. to avoid warnings; misc cleanups
2020-02-25 09:17:06 +00:00
fa0f3b4468
Use the specified extip address in the advertised ENR records
2020-02-22 20:54:15 +02:00
425b0e13da
remove potential error condition in getAttestationTopic; subscribe to all topics in parallel; add test cases for larger-than-ATTESTATION_SUBNET_COUNT committee indexes
2020-02-21 19:44:03 +00:00
62584b633e
update relevant portions of attestation aggregation spec version; tweak inspector
2020-02-21 19:44:03 +00:00
a8567cafb5
mark out where/how AttestationData and Attestation construction are honest validator-compliant
2020-02-21 19:44:03 +00:00
32872c7ee6
bump spec version to 0.10.1 (more accurate than 0.10.0); fix inspector building
2020-02-21 19:44:03 +00:00
6c87af9aab
split attestation beacon topic per honest validator spec
2020-02-21 19:44:03 +00:00
bced5ca656
implement is_proposer(...)
2020-02-21 19:44:03 +00:00
4782ae06e6
implement get_committee_assignment(...) by spec transcription
2020-02-21 19:44:03 +00:00
08915ed597
bump libp2p and increase bootstrap timeout
2020-02-21 12:03:19 -06:00
c25f8d4adf
sqlite kvstore backend ( #749 )
2020-02-20 11:49:34 +01:00
9e58e22761
[skip ci] remove an obsolete comment
2020-02-20 10:58:38 +02:00
5742299c94
Fix freezes in connection initialization.
2020-02-20 10:58:38 +02:00
880b981a0a
Don't wait for 10 seconds when connecting to the network
2020-02-19 12:45:34 +02:00
55886ff0ac
More proper fix replacing hotfix 052a6ac3bc
...
nim-eth was bumped to take advantage of a fixed `==` for public eth keys
2020-02-19 11:59:38 +02:00
3b9e9fefa8
Make the persistent network keys compatible with the Go daemon
...
The daemon requires its key file to be encoded as ProtoBuf value
with a proper `key scheme` discriminator.
2020-02-19 10:58:10 +02:00
1b1cd915db
Support ENR boot records with the Go daemon
2020-02-19 10:26:32 +02:00
052a6ac3bc
Hotfix: disable the bootstrap node connectivity check
...
This used to behave properly before the rebase, but currently
it forces the bootstrap node to exit, because it ends up being
launched with an ENR list telling it to connect to itself.
The root cause will be investigated in a follow-up PR.
2020-02-18 20:42:25 +02:00
57811dce89
Don't log unwanted lines in beacon_node --help
2020-02-18 12:53:49 +02:00
b2d5aba749
Advertise the TCP port of the bootstrap node properly
2020-02-18 12:53:49 +02:00
2a3e40e298
Fix test_discovery_helpers
2020-02-18 12:53:49 +02:00
2c814db750
Temporary switch to supporting only ENR bootstrap addresses
...
Turns out the DiscV5 code relies heavily on the presence of ENR
records at the moment, so we cannot drive it with ENodes. @kdeme
is working on refactoring that will relax these requirements.
2020-02-18 12:53:49 +02:00
7f395e554a
WIP Working local network sim with discovery
...
* The bootstrap_nodes.txt file in the node's data dir is now optional
* Log more data on start-up
* Use the latest ENR APIs
* Fix simulation build errors
2020-02-18 12:53:49 +02:00
d2f59ebab9
Switch to ENR records in the bootstrap_nodes.txt file
2020-02-18 12:53:49 +02:00
ee7c2c9dff
Unify the bootstrap nodes handling code
...
We no longer discriminate between ENR, MultiAddress or ENode
bootstrap records (all of them are remapped to ENodes).
The discovery loop will stochastically try to reconnect to
accidentally disconnected nodes.
2020-02-18 12:53:49 +02:00
4fb654f2af
Remove some SSZ compilation warnings
2020-02-18 12:53:49 +02:00
a620c83916
Handle status bar spanning multiple lines (relevant for the Tmux network sim)
2020-02-18 12:53:49 +02:00
bde1eefdcf
improve option naming
2020-02-17 22:00:41 +00:00
e13846bec6
allow beacon_node to verify finalization when appropriate, and enable by default for make eth2_network_simulation
2020-02-17 22:00:41 +00:00
d99ce1bcf0
fix json compile
2020-02-08 19:42:45 +01:00
521b0ed6ba
Clean 20200205 ( #729 )
...
* beacon node code cleanup
* rudimentary error checking on mainnet monitor
* start client even when sending deposit
* work around missing block number exception
* connect to testnet with web3 url
* pretty-print digests in json
2020-02-07 08:13:38 +01:00
09d735212d
initial refactoring of block sanity test runner, with several new tests ( #736 )
...
* initial refactoring of block sanity test runner, with several new tests enabled
* remove trailing whitespace
2020-02-07 08:11:26 +01:00
7efd113a75
store empty slot states also
2020-02-05 19:24:07 +00:00
fb9c4fabf4
fix state rewind
...
* rewind fast path comparison was not taking skipped slots into account
properly
* less messy blockref creation
2020-02-05 19:24:07 +00:00
b39f36b49b
use floodsub instead of gossipsub
2020-02-05 17:20:04 +01:00
1ffc2df23d
add a couple new deposit tests; fix the false-positive BLS verifications while keeping all but two tests working, despite mismatched 0.9/0.10 BLS standards; better-factor the skipping of BLS validation and Merkle tree validation
2020-02-04 18:39:38 +00:00
e4922cb177
implement compute_signing_root() and mark some functions as 0.10.1-compatible
2020-02-04 12:24:30 +00:00
45dd12cf3f
update process_deposit() to actually check is_valid_merkle_branch() unless skipValidation specified
2020-01-30 09:31:08 +00:00
98dc701473
Add PeerPool.addPeer async version and tests.
2020-01-29 15:28:41 +00:00
db20fc1172
Fix SyncQueue push(data) bug.
...
Rename lastSlot to HeadSlot.
Add failure test.
2020-01-29 15:28:41 +00:00
73dc72583f
Initial commit.
2020-01-29 15:28:41 +00:00
1f1a244f3f
Implement more checks and wire up the invalid SSZ tests
2020-01-29 10:10:28 +02:00
182593ccb5
Tenative fix for the test suite
2020-01-29 10:10:28 +02:00
2a3c237bbb
Handle malformed SSZ inputs properly
2020-01-29 10:10:28 +02:00
60b1775879
update check_attestation/process_attestation() to 0.10.1 and fill in missing check
2020-01-28 12:07:33 +02:00
3efbe36c30
additional 0.10.1 updates where already-implemented code is already done
2020-01-27 12:50:54 +00:00
dab107fa1e
more 0.10.1 updates
2020-01-27 12:50:54 +00:00
1ba2cebd85
v0.10.1 (test vectors + unchanged parts) ( #696 )
...
* update to 0.10.1
* SSZ Generic and nbench uses the v0.10.1 fixtures
* Tests + spec links: v0.10.0 -> v0.10.1
* Add v0.10.1 TODO in get_latest_attesting_balance (forkchoice)
* SSZ Bytes are now ByteList
* Remove nim-result submodules that was leftover/added by mistake in the branch
2020-01-27 10:56:32 +00:00
270c25c8b8
drop rlpx support ( #679 )
2020-01-24 09:32:52 +01:00
7dc2434e0d
clean up attestation logging
2020-01-23 18:48:26 +01:00
9cade2a5c4
LMDB: fix comment
2020-01-23 18:23:27 +02:00
d9c98b15c8
fix block pool finalization point init
2020-01-23 14:34:58 +02:00
95437e103a
disable state pruning
...
* fix crash when state root is present but state is missing
* fix state root removal when state is removed
* fix block pool initialization which needs tail state
* remove tail block pruning
* incomplete - fork states are not pruned
* incomplete - fork blocks are not pruned
* incomplete - empty slot states are not pruned
* unknown - tail/finalized block on empty slot might be incorrect
2020-01-22 19:45:38 +02:00
50f633209c
mark a couple dozen 0.9.2/0.9.4 spec locations as still consistent with 0.10.0; no functional changes
2020-01-22 13:03:45 +00:00
6cfa28e1f5
fix finalization cleanup
...
* add block pool finalization test
2020-01-21 15:53:53 +02:00
0743b3507c
Fix the build after the rebase
2020-01-21 01:26:57 +02:00
63b98f0334
Less confusing debug logging
2020-01-21 01:26:57 +02:00
c65575d105
Improved logging related to bootstrap nodes
2020-01-21 01:26:57 +02:00
589a3f06df
Fix an error introduced during rebasing
2020-01-21 01:26:57 +02:00
4848b12050
Detect and use Lighthouse's boot_enr.yaml files
2020-01-21 01:26:57 +02:00
07d329acb8
Wire-up the peer dialing loop and introduce --max-peers option
2020-01-21 01:26:57 +02:00
52878405b7
Integrate Discovery V5 and support ENR bootstrap records
2020-01-21 01:26:57 +02:00
74fc34eef2
Restore some constants to pass the constants & presets test
2020-01-21 01:26:57 +02:00
7e356b3fa6
Restore compilation with trace-level logging; Fixes #642
2020-01-21 01:26:57 +02:00
095b271bd4
Implement a loader for custom const presets
...
The loader has been tested with the presets published by Lighthouse.
You can try connecting to one of their testnets by running:
cd nim-beacon-chain
./connect-to-testnet lighthouse/testnet0
2020-01-21 01:26:57 +02:00
7a8054d36d
clean up block pool
...
* remove BlockPool.blocksBySlot (unused)
* simplify head pruning condition
* add head list smoke tests
* additional logging
2020-01-21 00:54:23 +02:00
14e1e3af52
LMDB: create db dir
2020-01-20 13:39:37 +00:00
7113259137
lmdb: 32-bit Windows fixes
2020-01-20 13:39:37 +00:00
2a67ac3c05
trie -> kv store
...
* simplify data storage to key-value, tries are not relevant for NBC
* locked-down version of lmdb dependency
* easier to build / maintain on various platforms
2020-01-20 13:39:37 +00:00
d853d7c024
remove SigKey.init (unused, fixes #664 )
2020-01-18 10:22:17 +01:00
3439763a9e
fix beacon node init
...
* update forkversion correctly
* ensure supplied state snapshot starts at genesis - we don't support
anything else
* more database sanity checks
2020-01-17 21:26:28 +00:00
c301e5d42f
mark 49 0.9.2/0.9.4 spec functions/data types as 0.10.0
2020-01-15 12:34:16 +00:00
860be026e1
fix block pool init head selection
...
the head state is not necessarily saved in the database, so we need to
make sure we update things to the correct place
2020-01-15 12:17:49 +00:00
b49003988a
Add Epoch Processing to nbench
2020-01-15 10:03:56 +00:00
8eaebf7163
update to spec version 0.10.0
2020-01-14 18:17:16 +00:00
2f68ee0ffe
new libp2p API
2020-01-13 20:26:19 +01:00
5d1e20012a
import base58 from stew
2020-01-13 20:02:29 +01:00
7c4d636f83
undo try blocks; that's not the traceback's source
2020-01-13 19:02:38 +01:00
468e0815b3
not a CatchableError
2020-01-13 18:53:59 +01:00
003a4c90be
sendErrorResponse(): don't crash when unable to send to peer
2020-01-13 17:12:49 +01:00
148527c716
slot fixes
...
* fix slot time navigation, add tests
* skip block proposal if head is more recent already - shouldn't happen
* use correct head when attesting to previous blocks
* log slot start/end processing
2019-12-23 17:56:56 +00:00
46de726e3d
mark all compatible 0.9.3 functions and data structures as 0.9.4
2019-12-20 17:24:42 +00:00
106352aff3
Nbench - Flexible benchmarking of Nimbus internals ( #641 )
...
* nbench PoC
* Remove the yaml files from the example scenarios
* update README with current status
* Add an alternative implementation that uses defer
* Forgot to add the old proc body
* slots-processing
* allow benching state_transition failures
* Add Attestations processing (workaround confutils bug:
- https://github.com/status-im/nim-confutils/issues/10
- https://github.com/status-im/nim-confutils/issues/11
- https://github.com/status-im/nim-confutils/issues/12
* Add CLI command in the readme
* Filter report and add notes about CPU cycles
* Report averages
* Add debugecho style time/cycle print
* Report when we skip BLS and state root verification
* Update to 0.9.3
* Generalize scenario parsing
* Support all block processing scenarios
* parallel bench runner PoC
* gitBetter load issues reporting (the load issues were invalid signature and expected to fail)
2019-12-20 17:14:43 +01:00
417f96213d
fix genesis interop by fixing deposit signature handling; add TRACE-level compilation to CI
2019-12-20 15:26:48 +00:00
746659bdc6
bump stew, fix warnings ( #655 )
2019-12-20 14:25:33 +01:00
b994da78a7
Move some attestation/block logic out of beacon node
...
* state data cache in block pool
* keep head state around
* more attestation logic in attestation pool
* first fork choice tests (!)
* fix fork choice (it's still likely broken / out of date)
2019-12-19 16:17:45 +00:00
ea4afd7454
mark 19 more 0.9.2-compatible entities as 0.9.3-compatible
2019-12-19 11:46:30 +00:00
350a6c071a
mark a couple compatible dozen 0.9.2 functions/data structures as 0.9.3
2019-12-18 16:13:39 +00:00
0328cd49bf
mark several more functions and data structures as 0.9.3
2019-12-18 10:00:17 +00:00
1610981be6
mark several more spec-referencing code/data parts as 0.9.3
2019-12-17 16:51:46 +00:00
27bf8908a9
mark a couple dozen functions and data structures as 0.9.3; fix TRACE-level compiling; stop downloading 0.9.2 test vectors; update cosmetic/display spec versions in test suite
2019-12-17 16:51:46 +00:00
22c44d254c
fix decoding for 0.9.3 types
2019-12-17 11:25:36 +01:00
15f289a281
Temporary switch back to the LibP2P daemon as the default choice
2019-12-17 00:13:51 +02:00
c824416f56
initial 0.9.3 spec update
2019-12-17 00:06:03 +02:00
8c104a0b94
inspector: add readme entry, decoding option
2019-12-16 16:08:30 +02:00
963f23e5ea
remove obsolete insecure comment
2019-12-16 13:36:39 +01:00
c66ca39cee
update heads when adding resolved blocks
2019-12-16 12:18:08 +02:00
4e85b50cb6
update head while syncing
2019-12-16 12:18:08 +02:00
741570113b
properly construct attestation data for selected slot
2019-12-13 09:04:30 +00:00
fbdb078eb3
fix return type to properly construct AggregateAndProof; check ATTESTATION_PROPAGATION_SLOT_RANGE as required, maintaining consistent slot offset
2019-12-13 09:04:30 +00:00
5880fc22ad
roadmap rest of naive attestation aggregation
2019-12-13 09:04:30 +00:00
c4daa726b5
fix AggregateAndProof definition
2019-12-13 09:04:30 +00:00
e2c68e075f
outline general flow of naive attestation aggregation
2019-12-13 09:04:30 +00:00
294db6aaca
initially implement specified attestation aggregation functions and data structures
2019-12-13 09:04:30 +00:00
cb1bc6cbf1
move attesting up from halfway to one third of the way through slots ( #643 )
...
* per honest validator and naïve/simple aggregator attestation specs, move attesting up from halfway to one third of the way through slots
* Update beacon_chain/beacon_node.nim
Co-Authored-By: Jacek Sieka <jacek@status.im>
2019-12-11 14:02:07 +01:00
a3145f0f5c
cleanups
...
* move stuff out of beaconnode
* fix use-after-free in query
2019-12-10 14:47:52 +00:00
10e6d4842f
Local sim finalizes with native LibP2P
2019-12-10 15:02:16 +02:00
98656377a3
Eliminate the code duplication in the LibP2P back-ends
2019-12-10 15:02:16 +02:00
889031453f
The beacon node can be compiled with the LibP2P native back-end
...
This hasn't been tested yet even in local sim.
2019-12-10 15:02:16 +02:00
eea523a89e
logging fixes
...
* don't log out-of-sync when there's no work to do
* small logging fixes
2019-12-10 10:18:30 +00:00
8ab0248209
Revert "tighten a few imports"
...
This reverts commit b24a9200d9
2019-12-10 02:18:47 +02:00
b24a9200d9
tighten a few imports
2019-12-09 12:58:28 +00:00
eef040954c
remove unused hasSigningRoot(...); stop running time-consuming-but-stubbed-out tests; add timing for peer connection tests
2019-12-06 16:48:32 +00:00
362ef752dc
dedeplicate some functions duplicated between libp2p_backend and libp2p_daemon_backend; remove some unused declared variables
2019-12-06 12:55:13 +00:00
5729ceb58e
rename notice field
2019-12-06 12:12:59 +00:00
86f267bc5d
switch debug to notice and add some contextual information
2019-12-06 12:12:59 +00:00
c762c0232d
render get_beacon_proposer_index(...) return value an option and remove overly aggressive assertion formerly causing crashes when missing validators ( #617 )
...
* render get_beacon_proposer_index(...) return value an option and remove overly aggressive assertion formerly causing crashes when missing validators
* follow addBlock(...) after refactoring
* [skip ci] fix typo
2019-12-04 11:49:59 +01:00
3b3a2b10f1
First attempt to have some fuzz tests exported for the fuzzing framework
2019-12-03 14:33:47 +02:00
a1198e5532
web3 fixes suggested by @yglukhov [skip ci]
2019-12-03 14:10:47 +02:00
afc0686b36
save ssz dummps during processing ( #471 )
2019-12-03 11:32:27 +00:00
c457904a61
avoid recursion when getting lmd ancestors
2019-12-03 13:24:16 +02:00
a641331448
Reduce the sync-related tracing in the testnets [skip ci]
2019-12-03 13:07:43 +02:00
ee2448b221
Simple validator onboarding
...
On your very first connection to each testnet, you'll be asked to
become a validator. Please consult our private repo for a Goerli
Eth1 private key that you can use for deposits.
Other changes:
* Added a simple wrapper ./connect-to-testnet script calling the
nims file in the correct environment. No extension was used to
make the command the same on Unix and Windows.
* Bumped a number of modules with fixes from this week
* `make testnet0` and `make testnet1` will no longer delete your
existing database. This is considered a more appropriate behavior
for testing forward sync.
2019-12-03 02:23:17 +02:00
7682a010a9
remove getCurrentExceptionMsg()
2019-12-02 22:06:42 +02:00
e88e559caf
render visible gradual validator emptying on catchup
2019-12-02 18:24:30 +02:00
90212eed2a
avoid producing blocks/attestations when out of sync
...
this is a temporary measure until we figure something better out - as it
stands, we'll advance with empty slots and crash because all validators
are out.
2019-12-02 15:26:42 +00:00
2a728d9468
fix stack overflow in isAncestor recursion
2019-11-28 17:36:07 +02:00
c98a0d28ae
add workaround for stack overflow on block add
2019-11-28 17:36:07 +02:00
8f2e523d26
remove a few hints and warnings ( #603 )
2019-11-28 13:50:19 +01:00
63f49eff76
document slot better
2019-11-27 15:14:20 +01:00
e6ae9977b2
clarify slot time
2019-11-27 14:59:54 +01:00
8c3ea1cabf
Handle missing blocks better in block_pool.getBlockRange
2019-11-27 13:45:34 +02:00
897176761d
even more tracing for testnet1 [skip ci]
2019-11-27 11:21:45 +02:00
6f650ca144
avoid pointless stream usage for main basic type in SSZ objects ( #596 )
...
* avoid pointless stream usage for uint64 in SSZ objects
2019-11-26 18:22:36 +00:00
fa22ba22b9
PeerPool initial commit.
2019-11-26 17:16:55 +00:00
1099548775
Restore the number of simulation nodes to 4; More block pool tracing [skip ci]
2019-11-26 19:02:56 +02:00
bde20436e8
~50% speedup by fast-pathing Eth2Digest merkle hashing
2019-11-26 15:23:27 +00:00
843c461af6
Remove some debugging output
2019-11-26 02:47:41 +02:00
8b89bbe391
Fix off-by-one error in syncing
2019-11-26 02:45:25 +02:00
1d8bfd8c0d
Allow overriding the bootstrap node in run_node.sh
2019-11-26 02:45:25 +02:00
8de4d38e4e
More tracing
2019-11-26 02:45:25 +02:00
ff3da4e152
more network traffic tracing
2019-11-26 02:45:25 +02:00
957645d752
Fix the bulds with json logging enabled
2019-11-26 02:45:25 +02:00
acd490916f
Attempt to fix the failing tests in CI
2019-11-26 02:45:25 +02:00
258f6f6334
detailed tracing in block_pool.getBlockRange
2019-11-26 02:45:25 +02:00
4c2ded25a6
Add detailed tracing for blocks by range requests
2019-11-26 02:45:25 +02:00
777b3f4e29
State/block pruning
2019-11-26 02:45:25 +02:00
76d3e74b02
fix head update message
2019-11-25 18:50:45 +01:00
a82869c03d
add validators even if they're not in startup state
2019-11-25 18:31:22 +02:00
1494bcc262
replace links to Apache and MIT licenses with HTTPS versions ( #592 )
2019-11-25 16:30:02 +01:00
904283e33e
make mount(...) public again
2019-11-25 14:48:59 +00:00
b82328b148
convert hash_tree_roots_prefix(...) to an iterator
2019-11-25 14:48:59 +00:00
c3d2634b97
re-export beginRecord(...)
2019-11-25 14:48:59 +00:00
f6de87b80e
remove O(n^2) eth1 deposit processing and scaffolding comparing it with O(n) deposit processing; re-enable now-viable-to-run genesis state initialization tests with around 16,384 validators
2019-11-25 14:48:59 +00:00
fa2a703a17
switch more funcs and procs from global to module scope; create scaffolding for non-O(n^2) eth1 deposit processing with assertions for equivalent functionality; fix a few more shellcheck warnings
2019-11-25 14:48:59 +00:00
fd4de5de0f
start untangling beaconnode ( #589 )
...
* Move BeaconNode type to its own file (fewer imports)
* disentangle sync protocol/request manager
* fix some old nimisms
* de-fear some logs
* simplify eth1 data production
* add stack tracing to release builds
* drop release compile flag for testnet
2019-11-25 15:36:25 +01:00
2e875ea17e
Better connection error handling in MainchainMonitor
2019-11-25 13:45:53 +02:00
a8de94ad05
add validator_leaving logging at debug chronicles level for all call paths to initiate_validator_exit(...)
2019-11-25 09:08:15 +00:00
8d9fdb0afd
miscellanous cleanups and removing a few funcs/procs from unnecessary global scopes
2019-11-25 09:08:15 +00:00
1938379bcd
Automated beacon constant checks ( #583 )
...
* Fix SSZ bitlist deserialization super silly bug
* Add an automated sanity checks of the beacon chain constants
* Remove SSZ consensus skipping procs [skip ci]
* Add phase 1 domains
* Fix mainnet constants
* Add missing phase 1 constants on minimal (they are not needed somehow on mainnet)
* Rebase artifact: constants were defined twice
2019-11-22 20:56:39 +01:00
edfd65fd5d
stop download 0.9.1 test vectors; finish 0.9.2 update, primarily via fixing preset constants; remove a couple 0.19.6 shims
2019-11-22 16:41:43 +00:00
f5b8931fad
switch assert(...) to doAssert(...) and minor cleanup
2019-11-22 16:39:05 +00:00
41fa377638
mark all non-changed 0.9.1 items as 0.9.2 ( #576 )
2019-11-22 09:29:04 +01:00
85f2596604
re-enable all_tests.nim mainnet tests
2019-11-21 19:40:35 +02:00
7c6d87051a
simplify validator api ( #573 )
...
* avoid passing whole state to validator api (easier when it goes
out-of-process)
* clean up some cruft
2019-11-21 10:57:59 +01:00
c0f009908c
re-enable test_interop based on zcli with 0.9.1 specs and update initialize_beacon_state_from_eth1(...) to 0.9.1 ( #569 )
...
* re-enable test_interop based on zcli with 0.9.1 specs and update initialize_beacon_state_from_eth1(...) to 0.9.1
* switch many procs to funcs
* fix import os.nim instead; ospaths is deprecated [Deprecated] warnings
2019-11-21 09:15:10 +00:00
bb0979f232
Ssz fixes ( #566 )
...
* SSZ signature from EF are always opaque blobs (security issue - https://github.com/status-im/nim-beacon-chain/issues/555 )
Enable
- Attestation
- Beaconstate (minimal only)
- Deposit
- DepositData
- ProposerSlashing
Updates #518
* mv debug_ssz to helpers
* Small reorg of the list types
* Fix IndexedAttestation, AttesterSlashing and BeaconBlock
* Deactivate on mainnet: AttesterSlashing, BeaconBlockBody, IndexedAttestation, Attestation, BeaconBlock
* Fix Validators on minimal and mainnet
2019-11-19 12:04:51 +01:00
2749cb14a6
convert mostly-uncompiled verify_merkle_branch(...) calls to newer is_valid_merkle_branch(...) name; re-enable several lines of deposit testing code and outline roadmap for completion
2019-11-18 17:35:58 +00:00
d8590bbffc
fix several warnings and hints
2019-11-18 17:35:58 +00:00
827956b5b3
remove a pre-Nim 0.20.x workaround
2019-11-18 17:35:58 +00:00
6f87c8fd89
verify that state_sim is justifying and finalizing; fix 3 more warnings; rename crosslink_committee_cache to beacon_committee_cache; fix O(n^2) usage of get_base_reward(...)
2019-11-18 17:35:58 +00:00
c7c439ac61
use bounded List[] SSZ type for more hashing consistency with spec
2019-11-18 09:35:17 +01:00
14712bbbdc
random warning fixes
2019-11-15 12:05:18 +01:00
3f958d3529
Merge branch 'master' into bat
2019-11-14 19:37:47 +00:00
7e70d16da9
remove BeaconStateNew and associated testing scaffolding/infrastructure
2019-11-14 20:03:08 +01:00
96dcb1cf95
Remove shard-relating code
2019-11-14 19:48:12 +01:00
c08698bffe
scaffolding to remove last vestiges of get_committee_count(...), SHARD_COUNT, and rest of that 0.8.x infrastructure; this demonstrates equivalence between two, before discarding old code
2019-11-14 18:37:51 +01:00
b4850fbb06
remove XDeclaredButNotUsed spam
2019-11-14 15:58:31 +00:00
df1d00f13a
remove UnusedImport spam ( #549 )
...
* remove UnusedImport spam
* re-add random import to beacon_node
2019-11-14 11:47:55 +01:00
3dcc00779a
replace deprecated toSet(...) with toHashSet(...); replace implicit with more explicit default constructor for readability
2019-11-13 13:49:38 +00:00
5a54c823d8
update to 0.9.1: don't try to run removed tests; re-add 1.5 tests (one only in minimal); remove bls_verify_multiple(...) and AttestationDataAndCustodyBit; and update process_attester_slashing(...), get_indexed_attestation(...), and is_valid_indexed_attestation(...)
2019-11-13 13:49:38 +00:00
f40675509a
Make all testnet env file values optional [skip CI]
...
Also removes some usages of SHARD_COUNT
2019-11-12 23:43:38 +00:00
5a93e50b5e
Sync-related fixes:
...
* off-by-one error in the returned range of blocks
* larger request time-outs to deal with non-responsive servers
* fix an unhandled exception when we fail to deliver a response chunk
2019-11-12 23:43:38 +00:00
6e8a518077
Fix getPersistentNetIdentity() do not use daemon anymore.
...
Fix change PeerInfo to MultiAddress.
2019-11-12 23:43:38 +00:00
1f352bf440
fix trace compilation
2019-11-12 16:35:12 +01:00
fb5d9edb7c
keep types consistent
2019-11-12 14:49:26 +00:00
d5ce142511
fix network sim finalization; remove get_attestation_data_slot(...); remove 2 more get_crosslink_committee(...) calls
2019-11-12 14:49:26 +00:00
07f0bd9378
Log the executable version at start-up [skip ci]
2019-11-12 00:05:59 +00:00
47940928a6
Reduce compilation differences between client and server nodes
2019-11-11 23:30:21 +00:00
ac5aabd569
Use the latest confutils
2019-11-11 23:29:36 +00:00
ed9cb274a2
Restore a change mysteriously lost during rebasing
2019-11-11 23:29:36 +00:00
f5e9b9a922
Allow running local nodes without attached validators
...
The number of user nodes is now specified with `USER_NODES`.
To make the instructions more stable, the "numeric id" of the user
nodes will be starting from 0 (so you can always use `run_node.sh 0`
to start a user node).
If you specify a node index above the total number of nodes, you'll
launch a node without any validators attached (this is useful for
testing the sync for example).
2019-11-11 23:29:36 +00:00
22591deced
Safer testnet restarts; Working CLI queries for inspecting the genesis states
...
When the connect_to_testnet script is invoked it will first verify that
the genesis file of the testnet hasn't changed. If it has changed, any
previously created database associated with the testnet will be erased.
To facilitate this, the genesis file of each network is written to the
data folder of the beacon node. The beacon node will refuse to start if
it detects a discrepancy between the data folder and any state snapshot
specified on the command-line.
Since the testnet sharing spec requires us to use SSZ snapshots, the Json
support is now phased out. To help with the transition and to preserve the
functionality of the multinet scripts, the beacon node now supports a CLI
query command that can extract any data from the genesis state. This is
based on new developments in the SSZ navigators.
2019-11-11 23:29:36 +00:00
a644839b79
Dynamic SSZ navigator
2019-11-11 23:29:36 +00:00
d457dfee81
switch all but 4 remaining callers to get_crosslink_committee(...) to get_beacon_committee(...)
2019-11-11 11:46:03 +00:00
568fa1dcb9
mark functions, constants, and data structures unchanged by 0.9.1 as such
2019-11-11 10:25:57 +00:00
949d735155
fix remaining test 0.9.0 test fixtures and switch back to non-transitiontest setup; remove get_committee_count(...); keep SHARD_COUNT consistent with MAX_COMMITTEES_PER_SLOT
2019-11-11 10:25:57 +00:00
cb4a86756b
update get_seed(...) and get_beacon_proposer_index(...) to 0.9.0, implement compute_proposer_index(...), and render 3 more test fixtures working ( #532 )
...
* update get_seed(...) and get_beacon_proposer_index(...) to 0.9.0, implement compute_proposer_index(...), and render 3 more test fixtures working
* rm stray Crosslink reference which prevented static SSZ tests from building
* remove references to removed tests in attestations test fixture; add minimal-preset block sanity test, plus all but one of mainnet tests for block sanity to transition fixtures
2019-11-10 01:03:41 +01:00
c1a63035b9
beacon_node: "--version" option [skip ci]
...
fixes #466
2019-11-09 17:43:42 +00:00
e984b2c932
mark is_valid_merkle_branch(...), process_justification_and_finalization(...), and process_rewards_and_penalties(...) as 0.9.0; update check_attestation(...) to 0.9.0; add 11 working test fixtures, having updated SSZ fixture directory to 0.9.0
2019-11-08 13:23:08 +00:00
275fb22c00
flip targeted spec version and ssz test fixtures to 0.9.0; almost completely update BeaconState to 0.9.0; update minimal and mainnet preset constants to 0.9.0; update process_proposer_slashing(...), get_attestation_deltas(...), and get_matching_head_attestations(...) to 0.9.0; mark process_final_updates(...) as 0.9.0
2019-11-08 13:23:08 +00:00
3bb95f571f
remove remaining Crosslink and CompactCommittee vestiges
2019-11-08 13:23:08 +00:00
61c2cf9415
rm get_compact_committees_root(...), Transfer, and references to 0.9-removed BeaconState.{active_index_roots,compact_committees_roots; temporarily disable genesis interop test pending 0.9 BeaconState
2019-11-08 13:23:08 +00:00
68654848cb
update get_attesting_indices(...) to 0.9.0; remove Crosslink from AttestationData to update AttestationData to 0.9.0; rm get_winning_crosslink_and_attesting_indices(...) and get_crosslink_deltas(...)
2019-11-08 13:23:08 +00:00
cb5454c4eb
double-check that one can back-infer shard/epoch from slot/committee-index, in preparation for removing crosslink from AttestationData
2019-11-08 13:23:08 +00:00
13e662c8dd
remove scaffolding and make get_crosslink_committee(...) a purer wrapper around get_beacon_committee(...)
2019-11-08 13:23:08 +00:00
c2ebe482a5
temporarily disable SSZ tests, which fail when trying to read AttestationData or structures which embed it; implemenet get_committee_count_at_slot(...) and get_beacon_committee(...); express get_crosslink_committee(...) in terms of get_beacon_committee(...) and ensure that results are identical
2019-11-08 13:23:08 +00:00
6a1d287652
beacon_node: print name, version and Git revision [skip ci] ( #527 )
2019-11-08 10:33:16 +00:00
97878566b8
Add peers monitoring.
...
Add broadcasters monitoring.
Resolve broadcasters to ids/addresses.
Add ability to switch between FloodSub and GossipSub.
2019-11-08 01:19:35 +02:00
568e669b1c
Fixed deposit/contract
2019-11-07 17:23:06 +00:00
5f6d60abce
remove a lot of XDeclaredButNotUsed spam from SSZ
2019-11-07 15:22:04 +00:00
a1f5f3512b
add sanity check for SIGFPE crashes ( #524 )
2019-11-06 15:50:12 +00:00
0073555752
transition deposit operation fixtures to 0.9.0 ( #515 )
...
* transition deposit operations fixture to 0.9.0
* mark slash_validator(...) as 0.9.0
* switch remaining non-ref objects to ref objects to maybe avoid crashes in CI
* remove unused helpers/debug_state imports
2019-11-06 15:02:06 +00:00
9b39c792d0
Revert f79f9deeb3 a0fbf5464a 94a9c51d8a ( #523 )
2019-11-06 16:56:54 +02:00
f79f9deeb3
Set wasDialed.
...
Add more logging information.
2019-11-06 16:41:24 +02:00
a0fbf5464a
Add logscope.
...
Add more information to logs.
2019-11-06 16:41:24 +02:00
94a9c51d8a
Initial commit.
2019-11-06 16:41:23 +02:00
e2b3f0dadb
announcedAddresses: fix logic error
2019-11-05 23:56:10 +01:00
03f57aab43
bump vendor/nim-libp2p
2019-11-05 23:31:01 +01:00
a417edb5ff
sync_protocol.nim: better error message [skip ci]
2019-11-05 16:02:26 +01:00
14374504cf
Finalization experiements
...
* Switched to FloodSub
* Testnet0 switched to the minimal preset. All validators deployed on the master node.
2019-11-05 03:13:16 +02:00
63e621c27d
initial 0.9.0 spec sync ( #509 )
...
* rename compute_epoch_of_slot(...) to compute_epoch_at_slot(...)
* remove some unnecessary imports; remove some crosslink-related code and tests; complete renaming of compute_epoch_of_slot(...) to compute_epoch_at_slot(...)
* rm more transfer-related code and tests; rm more unnecessary strutils imports
* rm remaining unused imports
* remove useless get_empty_per_epoch_cache(...)/compute_start_slot_of_epoch(...) calls
* rename compute_start_slot_of_epoch(...) to compute_start_slot_at_epoch(...)
* rename ACTIVATION_EXIT_DELAY to MAX_SEED_LOOKAHEAD
* update domain types to 0.9.0
* mark AttesterSlashing, IndexedAttestation, AttestationDataAndCustodyBit, DepositData, BeaconBlockHeader, Fork, integer_squareroot(...), and process_voluntary_exit(...) as 0.9.0
* mark increase_balance(...), decrease_balance(...), get_block_root(...), CheckPoint, Deposit, PendingAttestation, HistoricalBatch, is_active_validator(...), and is_slashable_attestation_data(...) as 0.9.0
* mark compute_activation_exit_epoch(...), bls_verify(...), Validator, get_active_validator_indices(...), get_current_epoch(...), get_total_active_balance(...), and get_previous_epoch(...) as 0.9.0
* mark get_block_root_at_slot(...), ProposerSlashing, get_domain(...), VoluntaryExit, mainnet preset Gwei values, minimal preset max operations, process_block_header(...), and is_slashable_validator(...) as 0.9.0
* mark makeWithdrawalCredentials(...), get_validator_churn_limit(...), get_total_balance(...), is_valid_indexed_attestation(...), bls_aggregate_pubkeys(...), initial genesis value/constants, Attestation, get_randao_mix(...), mainnet preset max operations per block constants, minimal preset Gwei values and time parameters, process_eth1_data(...), get_shuffled_seq(...), compute_committee(...), and process_slots(...) as 0.9.0; partially update get_indexed_attestation(...) to 0.9.0 by removing crosslink refs and associated tests
* mark initiate_validator_exit(...), process_registry_updates(...), BeaconBlock, Eth1Data, compute_domain(...), process_randao(...), process_attester_slashing(...), get_base_reward(...), and process_slot(...) as 0.9.0
2019-10-30 19:41:19 +00:00
abbe4075fa
Fixed deposit contract deployment
2019-10-30 17:23:34 +02:00
72c42838cb
Fix a typo in start.sh; Display the full slot number in the statusbar [skip ci]
2019-10-29 21:48:32 +02:00
6664f1689f
Use SSZ genesis files
...
Multi-client testing requires more portable formats, and SSZ is
much better specified than our flavour of Json.
Tools like ncli and zcli can be now used to inspect the contents
of the SSZ files.
2019-10-29 19:16:32 +02:00
1ef9f458ac
Remove hard-coded variables from the manage_testnet_hosts script
2019-10-29 19:16:32 +02:00
831b562435
Make the use of dynamic Chronicles outputs more optional
2019-10-29 19:16:32 +02:00
f1ea0cec32
Add support for testnets with mixed quickstart/random deposits
2019-10-29 19:16:32 +02:00
136a11f681
Fix the build when the Chronicles dynamic output is not used
...
close #504
2019-10-29 03:43:52 +02:00
f3252a8391
Fix the error 'output device not set for a chonicles dynamic sink'
2019-10-29 03:05:43 +02:00
734ab64da8
Unix-style command-line params for the 'deposit_contract' binary
2019-10-29 02:20:47 +02:00
ba0037738b
Removed all code related to the old network metadata files
...
Also switched to a more "standard" naming convention for the
command-line parameters.
2019-10-29 01:04:52 +02:00
9d3889cbab
WIP Goerli testnet
2019-10-28 15:51:17 +02:00
43b70c0330
Restore the ability to run tests/simulation/start.sh manually
2019-10-28 15:28:45 +02:00
fb220ee600
Preparations for introducing the native libp2p back-end
2019-10-28 15:00:25 +02:00
dfe3a6f0fb
Switch to Nim v1.0.2
2019-10-28 15:00:25 +02:00
a6f65cd37e
Add lower-level metrics for the number of gossipsub messages sent/received
2019-10-26 16:37:36 +03:00
a9fcaf16a6
stop double-counting attestation-topic attestations ( #501 )
2019-10-25 14:00:55 +00:00
363f918f7b
remove obsolete docs (this is covered in honest validator guide)
2019-10-25 13:55:19 +02:00
ee5d1c1467
minimize imports, specially for spec - cuts 2/3 of ncli build time ( #500 )
...
* minimize imports, specially for spec - cuts 2/3 of ncli build time
* ptr_arith->ptrops
2019-10-25 12:59:56 +02:00
700e7d921b
update to beacon chain phase 0 spec version 0.8.4; no substantive changes ( #494 )
2019-10-24 13:36:36 +00:00
c9d2815480
implement metrics to count send/received blocks/attestations, to detect network loss
2019-10-24 11:48:56 +03:00
3a2fc249a2
simulation: metric visualisation
2019-10-23 20:57:59 +02:00
021661180b
Use the latest nim-eth
2019-10-23 19:37:06 +03:00
e8206a7489
fix datadir
2019-10-22 23:18:45 +02:00
bdb70ebe2c
log data dir at startup ( fixes #229 )
2019-10-22 22:53:58 +02:00
43f353e665
implement beacon_reorgs_total metric ( #491 )
2019-10-22 13:57:34 +02:00
3da4c02bb3
implement beacon_current_live_validators and beacon_previous_live_validators metrics
2019-10-21 20:58:08 +09:00
360afe48a3
fix two races when producing block
...
there be more dragons around
2019-10-08 23:52:50 +09:00
b7f9d9e4be
fix BlsValue inits
2019-10-08 23:52:50 +09:00
c23b011c77
Cosmetic improvements to the status bar; Attempt to fix the CI
2019-10-07 23:56:34 +09:00
f72a58595f
Initial version of status bar
2019-10-07 23:56:34 +09:00
d3f88929da
Integrate nim-prompt
2019-10-07 23:56:34 +09:00
4c0b2a9a32
implement beacon_pending_deposits, beacon_processed_deposits_total, beacon_previous_validators, and beacon_current_validators metrics ( #478 )
...
* implement additional beacon_current_validators and beacon_previous_validators metrics
* tentatively implement beacon_pending_deposits additional metric
* implement beacon_processed_deposits_total additional metric
2019-10-06 04:31:50 +00:00
1a62c122d8
Finish remaining required interop metrics ( #477 )
...
* implement beacon_finalized_root, beacon_current_justified_root, and beacon_previous_justified_root interop metrics
2019-10-03 18:16:25 +00:00
255980c9f6
fix issue #367 and remove too-small range type usage for ValidatorIndex
2019-10-03 16:41:25 +03:00
2122bb44c9
implement beacon_finalized_epoch, beacon_current_justified_epoch, and beacon_previous_justified_epoch ( #476 )
2019-10-03 10:36:31 +00:00
2b7b7b1471
Deposit contract script additions ( #455 )
...
* Deposit contract script additions
* Cleanup/cosmetics
2019-10-03 09:21:28 +00:00
f111a6a444
fix attestation being added twice to block ( fixes #361 )
2019-10-02 12:27:51 +03:00
b8ddb776ca
fix attestation selection when calculating rewards and penalties
...
Previously, the we'd use the first source attestation regardless if it
matches the filter or not leading to the wrong minimum being used
2019-10-02 12:17:02 +03:00
3e3ed79874
sign the right attestation data
2019-10-02 12:11:47 +03:00
806836714a
Add an accidentally forgotten fix
2019-10-01 17:50:13 +03:00
13bde5aee3
Add gossipsub messages monitoring tool. ( #458 )
...
* Add gossipsub messages monitoring tool.
* Add support of bootstrap nodes file.
* Move topic constants to spec/network.nim.
* Add ability to monitor custom topics.
2019-10-01 15:52:28 +02:00
48d22d53dc
Ensure that we use the interop deposit signatures ( #467 )
...
* Ensure that we use the interop deposit signatures
* Add all interop keys to the test
2019-10-01 15:44:38 +02:00
66f03f491f
log raw incoming gossip data
2019-09-28 21:20:09 +02:00
66984c44ce
Another innocent fix from the interop branch
2019-09-27 23:29:58 +03:00
a336285922
Fix a potential OOB error in SSZ deserialization
2019-09-27 23:29:58 +03:00
c39d4f1817
Fix an overflow in the justification bits processing
2019-09-27 23:29:58 +03:00
1555efd9d8
Implement the latest modification of the spec
2019-09-27 19:10:37 +03:00
37043f0d91
Handle gracefully a pre-mature closing of a libp2p stream by another peer
2019-09-27 19:10:24 +03:00
b5fad0c9e8
Add more diagnostic for crashes during SSZ serialization
2019-09-27 19:07:22 +03:00
2bbe2cb23c
Implement the outputBootstrapNodes option (taken from the interop branch)
2019-09-27 19:05:17 +03:00
b56c96a4fd
Support downloading SSZ genesis files with curl
2019-09-27 18:59:28 +03:00
5152c42c8e
Don't crash hard on P2P daemon errors during the initial connection
2019-09-27 18:58:51 +03:00
0eaa433e84
Automated scripts for resetting the Status testnets
...
For detailed instructions, please see
https://github.com/status-im/nimbus-private/blob/master/testnets-maintenance.md
2019-09-26 18:58:51 +03:00
90b20fab52
Domain is now array[8, byte] instead of uint64
2019-09-26 17:53:59 +03:00
a7a1f78499
Fix TRACE chronicles_log_level ( #451 )
2019-09-23 17:00:10 +02:00
b100ceef56
Add detailed finalization and justification debug logs ( #449 )
...
* Add detailed finalization and justification debug logs
* log was wrongfully reporting rule 123 instead of rule 12
2019-09-23 15:48:26 +02:00
0b68f3dc63
[Interop branch] Log improvements - part 1 ( #439 )
...
* use service/category/process for blockpool logs
Only track fork choice logs in block pool (vs beacon_node)
Reduce verbosity on usual event in block pool
* rework beacon node logs
* log for attestations in blockpool
* log - att pool improvement
* use logScope and topics cf review and discussion
* use 7 letters for beacon_node
[log] report peers at slot start + fix bracket prefix [Block pool] Attestation sent
2019-09-23 11:35:41 +02:00
42a469603d
simplify startup, describe a few startup tricks
2019-09-11 20:29:57 -04:00
65ff8f2886
remove networkId (unused)
2019-09-11 20:29:57 -04:00
ab2cce3951
add quickStart option that avoids network metadata
2019-09-11 20:29:57 -04:00
c619b9557a
Validator pool update to use BLS domain
2019-09-11 20:29:57 -04:00
2aee749ead
Save a genesis SSZ file
2019-09-11 20:29:57 -04:00
988a13b872
Official operations - deposits unit test ( #408 )
...
* [Test] Official operations - deposits unit test
* Allow ignoring deposits with invalid signature
* We need stacktraces to debug windows 64 issue https://github.com/status-im/nim-beacon-chain/pull/408#issuecomment-529236359
* fix naming of unit test proc
* Revert "We need stacktraces to debug windows 64 issue https://github.com/status-im/nim-beacon-chain/pull/408#issuecomment-529236359 "
This reverts commit 04b8b05162#435
* proposer slashing started to crash as well on win-64 #435
2019-09-11 21:10:54 +00:00
3dc2b87e6a
Transfer - split process_transfer/processTransfers + tests + fixes ( #422 )
...
* Prepare test suite for transfers
* split API process_transfer / processTransfers
* Add range checks on transfer
* Fix invalid transfer conditions
* don't test on windows 64-bit #435
2019-09-11 20:29:00 +00:00
8676bbf388
Add proposer slashing tests ( #431 )
...
* Add proposer slashing tests
* typo in import
2019-09-11 07:50:07 +00:00
6be2e24a8f
Attester slashing - split process_attester_slashing/processAttesterSlashings + tests ( #424 )
...
* attester slashing tests - pending #415
* split process_attester_slashing/processAttesterSlashings
* Add logs to attester_slashing
* deactivate bls tests for now (https://github.com/status-im/nim-beacon-chain/issues/429 ) and cherry-pick from 60f2437dd2
2019-09-10 18:03:06 -04:00
f72de67f63
Proposer slashing is 0.8.3 ( #425 )
...
* minimal refactor of proposer slashings to 0.8.3; no semantic difference
* actually mark spec
2019-09-10 11:29:46 -04:00
f583135a39
The --stateSnapshot option now accepts ssz files as well
2019-09-10 10:13:49 -04:00
e470bbb52e
don't sign libp2p messages
2019-09-10 10:13:02 -04:00
c3adac44f2
Use Secp256k1 keys in accordance to the interop spec
2019-09-10 10:11:56 -04:00
cdff79ec6d
More sync fixes
...
* Fix IncompleteData issues brought by the new spec-compliant stream closing
* Fix logic errors in the sync algorithms
2019-09-10 09:49:54 -04:00
886b92319f
Implement the response size limits
2019-09-10 09:49:54 -04:00
86fc9a1f9e
fix nil access to mainchainMonitor
2019-09-10 09:49:54 -04:00
a83aa83644
Working BeaconSync
...
Changes:
* Do not send separate network packets for response codes and msg
len prefixes
* Close streams according to the spec
* Implement more timeouts according to the spec
* Make hello requests during syncing to update our knowledge of
the head block of the other peer.
2019-09-10 09:49:54 -04:00
4a54fb4103
Cleaned up obsolete BeaconSync code; Added some open questions regarding fetchAncestorBlocks
2019-09-10 09:49:54 -04:00
9dec05f9c9
Sending chunked responses
2019-09-10 09:49:54 -04:00
b120a60493
Reading chunked responses
2019-09-10 09:49:54 -04:00
2bbfa8c877
Changes related to the new ETH interop spec
...
* Hello is no longer a handshake message
(all handshakes related code was deleted for clarity)
* Deal with the single-parameter inlining defined in the new spec
2019-09-10 09:49:54 -04:00
81b47f35d1
Voluntary exit - split single + multiple exits proc & tests ( #421 )
...
* add test suite for voluntary exit
* update API to process_voluntary_exit
* Add range check of validator_index for voluntary exits
* Revert to dual single + multiple voluntary exits API + enable in test suite
* no cache or mocking needed
2019-09-10 00:14:03 +00:00
061b6e0ddf
Test block headers ( #418 )
...
* Block headers tests
* Skip invalid_parent_root test due to https://github.com/status-im/nim-beacon-chain/issues/407
* Fix bls_verify with invalid sig. Activate block header tests
2019-09-09 14:40:59 -04:00
d4c480ff5f
Eth1 validators ( #393 )
2019-09-09 18:59:02 +03:00
a4b4c89539
remove incorrect exit condition in get_attestation_details(...) ( #416 )
...
* remove incorrect exit condition in get_attestation_details(...)
* enable historical batch unit test, which now passes
2019-09-09 09:10:03 -04:00
3f446e6383
Attestations EF tests + Proper Real/Opaque BlsValue deserialization ( #410 )
...
* Add attestation unit test
* process_attestation doesn't throw exceptions
* Allow SSZ deserialization of both real and invalid signatures
* Add new process_attestation checks - pass all process_attestation tests
* Add sanity check for #361
* Fix SSZ testing after fromBytes/fromSSZBytes changes
2019-09-08 23:33:24 -04:00
5f58af2112
fix ssz list, protocol names ( #405 )
2019-09-08 16:54:31 +02:00
bb0e9de09d
[WIP] Sync which using latest network specification. ( #390 )
...
* Fixed getBeaconBlocks() and getRecentBeaconBlocks() to use BlockPool, not db.
* Got the sync_protocol to compiling state; Removed all obsolete RPC calls
2019-09-08 15:08:44 +02:00
82b9e008d6
Fix genesis blockheader zero signature (supercedes #395 ) ( #400 )
2019-09-07 20:56:24 -04:00
93cdb43f1e
Integrate nim-metrics and add some metrics from the ETH2 spec ( #394 )
2019-09-07 19:48:05 +02:00
0c174036a5
update get_attesting_indices(...) to 0.8.3; mark IndexedAttestation, Attestation, PendingAttestation, and get_randao_mix(...) as 0.8.3; rm duplicate/dead code get_unslashed_attesting_indices(...) ( #391 )
2019-09-06 21:58:38 +02:00
e3bd4410d8
Revert "Eth1 validators" ( #392 )
...
This reverts commit bb8955bdbc
2019-09-06 13:00:56 +03:00
bb8955bdbc
Eth1 validators
2019-09-06 02:38:38 +02:00
f882c92a42
fix network sim ( #389 )
...
* fix network sim
* mark BeaconState, state list/vector lengths, misc values, get_base_reward(...), verifyStateRoot(...), and process_slot(...) as 0.8.3; update minimal/mainnet config initial values to 0.8.3 by removing GENESIS_FORK_VERSION
2019-09-05 21:52:34 +02:00
31db5d3a62
Deserialize serialized default bls values ( #388 )
...
Ugly workaround to quick-fix broken network/interop sim
2019-09-05 14:27:28 +00:00
7ebf685fa3
Work-around for #373 ( #385 )
2019-09-05 10:27:26 +00:00
ad240953ed
Fix #378 , int to bytes32, LATEST_RANDAO_MIXES, get_seed, get_crosslink_committee, get_compact_committee_root ( #380 )
2019-09-04 13:57:18 +00:00
b9265e15f1
remove some superfluous/pointless spec version markers ( #377 )
2019-09-04 09:25:27 +00:00
c11f37e550
V0.8.3 tests part 3 - sanity checks for slots and blocks ( #375 )
...
* Add sanity check for slot processing (also impacted by https://github.com/status-im/nim-beacon-chain/issues/373 )
* use reportDiff also for all state tests vs EF
* initial sanity checks for blocks - workaround zero signature in block headers: https://github.com/status-im/nim-beacon-chain/issues/374
* Remove generic object variant compare commented code
* Add the one block state transition sanity checks
* generalize blocks test to multiple blocks
* simplify slots test runner
* Add official epoch transitions, sanity blocks, sanity slots to the test suite
* Fix index out-of-bounds in initiate_validator_exit - enable proposer slashings unittest
2019-09-03 18:02:21 +00:00
297e9079d4
V0.8.3 tests part2 - BLS + Shuffling + State transition epoch ( #372 )
...
* Update BLS fixtures to 0.8.3
* Bump fixtures with shuffling with minimal preset
* Update shuffling tests
* parseTest generic over file format (Json or SSZ)
* Initial crosslink parsing commit for debugging Nim crash
* Workaround https://github.com/status-im/nim-beacon-chain/issues/369
* Crosslink test works for minimal - https://github.com/status-im/nim-beacon-chain/issues/369 is back on mainnet
* Use ref objects to workaround https://github.com/status-im/nim-beacon-chain/issues/369
* Generalize state transition epoch test to all epoch tests
* Fix slashing (potential uint64 overflow in previous spec)
* Add a state debugging macro to deeply inspect the wrong fields
* make reportDiff visible
* Improve the debug state macro for containers
2019-09-03 03:12:09 +00:00
6d798c821f
log json errors when loading deposits
2019-09-02 22:14:18 +03:00
9cfbdb5e16
more interop fixes
...
* fix eth1 interop block hash
* update initialize_beacon_state_from_eth1 to 0.8.3
2019-09-02 22:14:18 +03:00
7b73b40bab
interop updates
...
* add interop launcher scripts
* stick validator_keygen into beacon_node
* fix lmd ghost slot number on missing block
* use mocked eth1data when producing blocks
* use bls public key method for withdrawal credentials
* fix deposit domain
* prefer lowercase for a bunch of toHex
* build simulation binary in data folder to avoid data types confusion
2019-09-02 22:14:18 +03:00
ca4f29caca
v0.8.1 tests refactor ( #326 )
...
* Introduce new mocking proc to replace:
- makeFakeValidatorPrivKey
- hackPrivKey
- getNextBeaconProposerIndex
- addBlock
- makeBlock
* Add comments on datastructure unsynced with the spec
* Add merkle tree constructor and initial mocking for deposits (missing merkle proofs)
* [Mock] Implement sparse merkle tree and merkle proof builder
* [Mocking] Genesis deposits
* Add compact_committees_roots init + mock genesis state
* [Tests] Add first deposit test using the new mocking procedures
* [Tests -deposits] add at and over 32 ETH deposit tests
* [Tests - deposits] Add test for validator top-up
* [Tests -deposits] Mention the TODO to test for invalid conditions
* [Tests] Add stub to test "is_valid_genesis_state"
* [Merkle proofs] Implement round-trip checks
* Deactivate roundtrips test
* SSZ - use EF convention for hash_tree_root / hashTreeRoot
* [Tests - Attestation] Attestation mocking + initial test
* Add mocking + 3 new tests for valid attestations + mention future invalid attestation tests
* Add crosslinks test (1 failing to attestations in block being duplicated in state transition)
* Single attestation crosslink test - workaround https://github.com/status-im/nim-beacon-chain/issues/361
* Add test for failed crosslink penalty
* Rebase fixes + add refactored tests to test suite
* justif-finalization helpers first batch
* Add 234 finalization tests
* Fix justif test, Rule I 234 finalization does not happen with sufficient support.
(Also unittest check template does not fail properly in some cases)
* Add tests for all finalization rules
* Properly delete nim-byteutils following c91727e7e5 (diff-7c3613dba5171cb6027c67835dd3b9d4)
2019-08-28 12:07:00 +00:00
a7998f5c3e
Update datatypes.nim
2019-08-27 15:03:00 +02:00
5254ec0e7f
Add assert message
...
Tripped me up during build, error was unnecessarily unspecific.
2019-08-27 14:59:57 +02:00
8665efbbd1
bump beacon chain versions to 0.8.3, which has no relevant changes in this regard ( #358 )
2019-08-26 11:09:47 +02:00
cc0429a643
slightly update/rename verify_merkle_branch(...) to 0.8.2 is_valid_merkle_branch(...); mark check_attestation(...), get_active_validator_indices(...), get_seed(...), and BeaconBlockBody as 0.8.2; update compute_domain(...) 0.8.2 by reversing field order ( #356 )
2019-08-26 07:57:09 +00:00
ad55889707
Fix SSZ typo fieldCaseDisciminator (declared in nim-serialization)
2019-08-24 16:52:58 +02:00
c47e3903be
rm some less-useful debug and tracing noise ( #355 )
2019-08-23 11:39:23 +02:00
5f7fb03cf2
fix SszChunkMerkelizer 32bit failure
2019-08-22 20:31:13 +03:00
912563648e
Fix the json build; Don't long the non-attesting indices in the testnets
2019-08-21 14:21:08 +03:00
180e8ed02b
Fix a build issue after rebasing
2019-08-20 16:42:15 +03:00
f477eb6877
Add a `sszList` helper for writing tests involving SSZ lists
2019-08-20 16:34:36 +03:00
74f630eb28
Better start-up logic when the beacon node is launched before the genesis time
2019-08-20 16:34:33 +03:00
78f7a4a505
restore network sim finalization
...
* relax attestation validation when attestation is incoming but make it
more strict when adding to block
* share attestation validation logic between attestation pool and state
transition
* remove a bunch of redundant logging
* fix potential underflow in attestation delay checking
* fix committee used for attestation shard selection when attesting
* fix attestation data construction
2019-08-19 21:05:54 +03:00
225465578c
fix startup time casts, log fixes
2019-08-19 21:05:54 +03:00
f5db2dd7b3
Fix the build with the latest Chronos
2019-08-15 20:43:06 +02:00
2fca9465e7
Fix the build with RLPx
2019-08-15 20:43:05 +02:00
e639cd95c7
humaneXNum -> shortLog
2019-08-15 18:01:55 +02:00
4daeebbf7e
Fix the build when json logging is enabled
2019-08-14 17:38:39 +02:00
3e587d4667
Justification/finalization amelioration using testnet1 shard count and epoch length ( #331 )
...
* working justification, 1 node, 64 validators
* closer to tn1 params: 256 validators
* more debugging output; switch to minimum test case
* working justification and finalization in local network simulation
* fix currently incorrect state transition/attestation test assumption
2019-08-14 08:56:32 +00:00
6704749eb0
mark unchanged 0.8.1 as 0.8.2 spec aspects ( #336 )
2019-08-09 14:08:00 +02:00
e8ca67fc9a
Updated web3 api usage
2019-08-07 15:48:02 +03:00
a897ab9c70
Attempt to make the test suite green
2019-08-07 06:09:26 +03:00
5ce50b3aca
Implement the latest networking spec
...
https://github.com/ethereum/eth2.0-specs/pull/1328
2019-08-07 05:22:28 +03:00
398ea55801
Implement the latest SSZ specification and integrate the official SSZ test suite
2019-08-05 03:18:48 +03:00
46c9e99754
Cleanup web3 api usage
2019-07-31 16:39:26 +03:00
24cbc0710f
Make web3 way of getting genesis optional
2019-07-31 16:39:26 +03:00
68c4cbf078
Updated deposit contract
2019-07-31 16:39:26 +03:00
zah
tersec
Jacek Sieka
Mamy Ratsimbazafy
Ștefan Talpalaru
cheatfate
Joao Gabriel Carvalho
kdeme
Dmitriy Ryajov
Yuriy Glukhov
Yuriy Glukhov
Mamy Ratsimbazafy
Bruno Škvorc
andri lim