76c12d493e
Add check for late attestation sent messages in logtrace tool.
2020-07-02 10:36:04 +03:00
26b7202af3
Fix #1266
2020-07-01 22:01:50 +03:00
f3e92762e3
add tests for unviable blocks ( #1271 )
...
* add tests for unviable blocks
also enable finalization tests in all test configs - they're plenty fast
now
also fix newClone for non-rvo cases. sigh.
* fixes
2020-07-01 19:00:14 +02:00
66c230ffd1
check that parent of added block is sufficiently recent ( #1269 )
...
Otherwise, we might introduce a fork into the DAG that is no longer
viable, creating trouble for both sync and fork choice
2020-07-01 17:21:21 +02:00
ef2f037571
bump libp2p ( #1267 )
2020-07-01 13:41:40 +02:00
c19321e578
Fix the 'maxDelay' FieldError problem during the initial deposit making when joining a testnet
2020-07-01 12:13:56 +03:00
fe20c36ba5
switch several beacon_node procs to funcs ( #1262 )
...
* switch several beacon_node procs to funcs
2020-06-30 13:53:57 +00:00
e898525b16
More version in --version and less version in --help ( #1260 )
...
Long version and copyright banners is probably not what the user is
after when typing `--help`
2020-06-30 14:23:52 +02:00
d09e9f1aaf
remove non-snappy support from inspector; switch some procs to funcs ( #1261 )
...
* remove non-snappy support from inspector; switch some procs to funcs
* use mapIt instead of explicit for loop
2020-06-30 11:17:49 +02:00
b4db2ad693
remove v0.11.3 support; add block_sim to CI ( #1253 )
...
* remove v0.11.3 support; add block_sim to CI
* rm stray PERSISTENT_COMMITTEE_PERIOD
* remove TopicFilter.InteropAttestations
* bump two comment-spec-refs to v0.12.1
2020-06-29 18:08:58 +00:00
302cef5e90
Attach all local validators before starting the networking
2020-06-29 18:07:41 +03:00
510e8110ff
typo
2020-06-29 15:00:16 +02:00
61fc535f8c
print networking info on startup
2020-06-29 14:01:18 +02:00
047f354e9b
Don't wait for genesis to start network ( #1249 )
2020-06-29 07:34:48 +02:00
8140b4458c
Working local sim with WAIT_GENESIS=yes
2020-06-29 02:18:48 +03:00
9cd8a6c730
Working local sim (without waiting genesis)
2020-06-29 02:18:48 +03:00
96ac81c89f
Better UX; Don't delete testnet data folders
2020-06-29 02:18:48 +03:00
b9e653f7fd
Working genesis detection for Altona
2020-06-29 02:18:48 +03:00
31e31bb30c
Switch to monitoring of Blocks; More accurate genesis detection and faster Eth1 syncing
2020-06-29 02:18:48 +03:00
816779733e
use the eth2 message id for gossip (in logging too) ( #1246 )
...
* use the eth2 message id for gossip (in logging too)
* bump
* add spec link
2020-06-28 22:06:50 +02:00
ea57852359
count attestations from blocks while syncing ( #1244 )
...
* count attestations from blocks while syncing
* check for resolved old attestations
2020-06-28 19:32:11 +02:00
eeccaaf16d
stop gossipping non-snappy ( #1240 )
...
* stop gossipping non-snappy
Also simplify subscription and actually handle decoding errors
* log weird states too
2020-06-27 12:16:43 +02:00
fc3a18039d
typos
2020-06-26 15:51:20 +02:00
9b05581695
typo
2020-06-26 14:36:21 +02:00
322a12fed7
Fix the Eth1 deposit contract monitoring on Witti
2020-06-26 02:33:39 +03:00
578ea2013a
implement spev v0.12.1 in initialize_beacon_state_from_eth1 ( #1236 )
2020-06-25 16:24:55 +02:00
fe15d473c9
effectively revert withEpochState ( #1235 )
2020-06-25 14:14:41 +02:00
1301600341
Trusted blocks ( #1227 )
...
* cleanups
* fix ncli state root check flag
* add block dump to ncli_db
* limit ncli_db benchmark length
* tone down finalization logs
* introduce trusted blocks
We only store blocks whose signature we've verified in the database - as
such, there's no need to check it again, and most importantly, no need
to deserialize the signature when loading from database.
50x startup time improvement, 200x block load time improvement.
* fix rewinding when deposits have invalid signature
* speed up ancestor iteration by avoiding copy
* avoid deserializing signatures for trusted data
* load blocks lazily when rewinding (less memory used)
* chronicles workarounds
* document trustedbeaconblock
2020-06-25 12:23:10 +02:00
902093f57c
Revert "Dual headed fork choice [Reloaded] ( #1223 )" ( #1234 )
...
This reverts commit 6836d41ebd
2020-06-25 11:36:03 +02:00
62e4efe34b
Re-wire the sending of deposits by the 'deposits create' command
2020-06-24 23:06:05 +03:00
384e512031
Implement EIP-2386 wallets; Progress towards a CLI for interactive wallet creation
...
For more information:
4494da0966/EIPS/eip-2386.md (specification)
2020-06-24 23:06:05 +03:00
6836d41ebd
Dual headed fork choice [Reloaded] ( #1223 )
...
* Dual headed fork choice
* fix finalizedEpoch not moving
* reduce fork choice verbosity
* Add failing tests due to pruning
* Properly handle duplicate blocks in sync
* test_block_pool also add a test for duplicate blocks
* comments addressing review
2020-06-24 20:24:36 +02:00
f20f077827
Introduce some short-cuts in the Eth1 monitoring for faster syncing
2020-06-24 19:22:52 +03:00
bdd56b626f
Merge pull request #1206 from status-im/readme
...
Update readme and manual
2020-06-24 01:04:25 +02:00
1b3c19dc21
default to v0.12.1 beacon chain spec, keeping witti working ( #1222 )
...
* default to v0.12.1 beacon chain spec, keeping witti working
* a couple of fixes that help for the Onyx testnet
2020-06-23 19:40:44 +00:00
807b920c19
state_transition implements the spec fairly directly ( #1220 )
2020-06-23 13:54:24 +00:00
a683656238
send and validate with v0.12.1 attestations ( #1213 )
...
* send and validate with v0.12.1 attestations
* use EpochRef instead of empty cache in attestation validation
2020-06-23 10:38:59 +00:00
f60235b3e9
Attestation validator now populates list of missing blocks. ( #1211 )
2020-06-23 11:29:08 +02:00
1d709c09f4
secp: requiresInit ( #1210 )
...
* secp: requiresInit
* bump
2020-06-22 21:40:19 +02:00
a2e28bef27
Further removal of enum support; Bump modules
2020-06-22 20:14:14 +03:00
7211a99086
Smooth out the differences between Ganache and Infura; Working local sim and Altona target
2020-06-22 17:30:04 +03:00
14274587cf
More user-friendly logging during mainchain monitoring
2020-06-22 17:30:04 +03:00
1def383ad1
Reword the Tmux setup to handle all simulation scenarios in more visible way
2020-06-22 17:30:04 +03:00
e9d68e2f7b
Add simulation mode that bootstraps from an Eth1 ganache instance
2020-06-22 17:30:04 +03:00
62a7e7fede
fix is_valid_indexed_attestation() to check for too-high attestation indices
2020-06-22 14:15:51 +00:00
47eaaa7696
Fix connection workers race. ( #1204 )
2020-06-21 18:49:48 +02:00
a661ecbae1
bump libp2p ( #1209 )
2020-06-21 18:45:28 +02:00
7e0e4dc327
don't crash on unknown disconnection reason, fix disconnection reason enum ( #1208 )
2020-06-20 09:24:33 +02:00
7b4e129316
re-add minimal constant checking; organize presets by spec version ( #1203 )
...
* re-add minimal preset constant checking; organize presets to better support multiple spec versions
* bump spec ref
* increase Azure timeout to 90 minutes to accomodate Nim compiler building
2020-06-20 09:12:45 +02:00
fd35b61ecb
fix typo
2020-06-19 23:00:18 +08:00
4ecbc655ea
switch 11 beaconstate.nim spec refs from v0.11.x to v0.12.1
2020-06-19 11:54:37 +00:00
72dfe7f578
- updated the validator shell script after the keystore changes
...
- better logging & retrying requests on the VC side if the BN fails for some reason
- VC now fetches the attestation duties 1 epoch in advance - in the future it will tell the BN to subscribe to the appropriate attestation topics in advance based on that info
- a bunch of other code cleanup & fixes such as better naming for consoles when using multitail, etc.
reviewed in PR #1184 - proper review of the API & VC are pending
2020-06-19 12:21:22 +03:00
dc1a565b3f
support v0.12.1 attestation topics in beacon node/inspector subscribing ( #1187 )
...
* support v0.12.1 attestation topics in beacon node and inspector subscribing
* bump is_valid_merkle_branch() spec ref
2020-06-18 15:10:25 +02:00
4436c85ff7
Forward sync refactoring. ( #1191 )
...
* Forward sync refactoring.
Rename Quarantine.pending to Quarantine.orphans.
Removing "old" fields.
* Fix test's FetchRecord.
* Fix `checkResponse` to not allow duplicates in response.
2020-06-18 12:03:36 +02:00
db870fead4
update 20 beacon chain protocol spec refs
2020-06-18 08:39:28 +00:00
e813111b3b
peers rpc call
...
simple way to display nbc peer table
2020-06-18 07:29:20 +00:00
ee9f4a2e3f
remove skipMerkleValidation and skipBlockParentRootValidation ( #1197 )
2020-06-18 07:56:47 +02:00
ffca27b45f
update 24 v0.11.x spec refs to v0.12.1
2020-06-17 12:11:03 +00:00
8fbbd59885
metric names ( #1188 )
...
* fix metric names to not clash with native libp2p metrics
* run testnet node with rpc enabled by default
2020-06-17 13:04:24 +02:00
5b6ade043c
remove unused import
2020-06-17 09:25:54 +00:00
ec85a8bdbf
update a dozen unchanged spec refs to v0.12.1
2020-06-17 09:25:54 +00:00
49e9167b28
clean up dump feature
...
* don't write blocks that get added to database
* don't write states
* write to folders
* add state dumping feature to `ncli_db` to get any known state from the
database
2020-06-16 13:44:37 +00:00
a25bc025d1
Start discovery after starting libp2p switch
2020-06-16 13:33:46 +00:00
5c25d23ef1
eth2hash -> eth2digest
...
hash in nim is the insecure hash-map helper - might as well use `digest`
consistently to mark the difference
2020-06-16 13:30:21 +00:00
60176b8cc1
Revert "Dual headed fork choice ( #1163 )" ( #1181 )
...
This reverts commit 090f06614a
2020-06-16 09:46:00 +02:00
89e4819ce9
collect signature production and verificaiton in one place ( #1179 )
...
* collect signature production and verificaiton in one place
Signatures are made over data and domain - here we collect all such
activities in one place.
Also:
* security: fix cast-before-range-check
* log block/attestation verification consistently
* run block verification based on `getProposer` in its own history
* clean up some unused stuff
* import
* missing raises
2020-06-16 07:45:04 +02:00
9335533503
bump submodules
2020-06-16 04:27:20 +00:00
090f06614a
Dual headed fork choice ( #1163 )
...
* Dual headed fork choice
* fix finalizedEpoch not moving
* reduce fork choice verbosity
2020-06-16 00:40:16 +02:00
96f26c447c
Replace zero-point rewind with rewind to latest finalized epoch's first slot. ( #1176 )
...
* Replace zero-point rewind with rewind to latest finalized epoch's first slot.
* Fix tests.
* Add missing penalty for MissingParent
Fix comments.
2020-06-15 21:41:26 +02:00
8a2c796e83
switch 12 unchanged spec references from 0.11.x to 0.12.1; line-wrap and remove pointless-to-counterproductive "return"
2020-06-15 10:10:31 +00:00
50c5d47250
Add maximum number of workers (peers used) by SyncManager (default: 10) ( #1172 )
...
Refactor and simplification of `sync` procedure.
Fix aggressive looping on excessive recurring failures.
2020-06-14 11:45:53 +02:00
360ebd705f
db: compress with snappy
...
* 3gb vs 12gb for 4000 epochs of witti
* 3-4x sync blocks/sec performance improvement on my FDE SSD drive
* generate less quirky code for primitive types
2020-06-14 11:33:00 +03:00
1d1e90adf4
Update 36 spec refs from 0.11.x to 0.12.1
2020-06-12 19:41:03 +00:00
78b767f645
avoid genericAssign for beacon node types ( #1166 )
...
* avoid genericAssign for beacon node types
ok, I got fed up of this function messing up cpu measurements - it's so
ridiculously slow, it's sad.
before, while syncing:
```
40,65% beacon_node_shared_witti_0 [.]
genericAssignAux__U5DxFPRpHCCZDKWQzM9adaw
9,02% libc-2.31.so [.] __memmove_avx_unaligned_erms
7,07% beacon_node_shared_witti_0 [.] BIG_384_58_monty
5,19% beacon_node_shared_witti_0 [.] BIG_384_58_mul
2,72% beacon_node_shared_witti_0 [.] memcpy@plt
1,18% [kernel] [k] rb_next
1,17% beacon_node_shared_witti_0 [.] genericReset
1,06% [kernel] [k] map_private_extent_buffer
```
after:
```
24,88% beacon_node_shared_witti_0 [.] BIG_384_58_monty
20,29% beacon_node_shared_witti_0 [.] BIG_384_58_mul
3,15% beacon_node_shared_witti_0 [.] BIG_384_58_norm
2,93% beacon_node_shared_witti_0 [.] BIG_384_58_add
2,55% beacon_node_shared_witti_0 [.] BIG_384_58_sqr
1,64% beacon_node_shared_witti_0 [.] BIG_384_58_mod
1,63% beacon_node_shared_witti_0 [.]
sha256Transform__BJNBQtWr9bJwzqbyfKXd38Q
1,48% beacon_node_shared_witti_0 [.] FP_BLS381_add
1,39% beacon_node_shared_witti_0 [.] BIG_384_58_sub
1,33% beacon_node_shared_witti_0 [.] BIG_384_58_dnorm
1,14% beacon_node_shared_witti_0 [.] FP2_BLS381_mul
1,05% beacon_node_shared_witti_0 [.] BIG_384_58_cmove
1,05% beacon_node_shared_witti_0 [.]
get_shuffled_seq__4uncAHNsSG3Pndo5H11U9aQ
```
* better field iteration
2020-06-12 21:10:22 +02:00
42832cefa8
Small fixes ( #1165 )
...
* random fixes
* create dump dir on startup
* don't crash on failure to write dump
* fix a few `uint64` instances being used when indexing arrays - this
should be a compile error but isn't due to compiler bugs
* fix standalone test_block_pool compilation
* add signed block processing in ncli
* reuse cache entry instead of allocating a new one
* allow for small clock disparities when validating blocks
2020-06-12 18:43:20 +02:00
c8f24ae3b8
Remove three skipMerkleValidation usages ( #1164 )
...
* remove three skipMerkleValidation usages
* remove a couple obsolete comments/TODOs
2020-06-12 18:03:46 +02:00
68a8b7d969
Filter discovery nodes on forkId ( #1162 )
2020-06-12 16:14:18 +02:00
9363169098
Cosmetic improvement for the statusbar
2020-06-11 17:40:08 +03:00
cf6a869e9e
Address some TODO items; Handle start-up before genesis more properly
2020-06-11 17:40:08 +03:00
c773e10c1a
Attempt to reduce the risk of dropped network connections during the loading of KeyStores
2020-06-11 17:40:08 +03:00
25821331c4
More greppable code for the onPeerConnected operation
2020-06-11 17:40:08 +03:00
811ba9aacd
Fix SSZ issues on 32-bit platforms
2020-06-11 17:40:08 +03:00
fdaf419e41
Address review comments
2020-06-11 17:40:08 +03:00
6e88a07b51
Fix the validator client build
2020-06-11 17:40:08 +03:00
2acda1c115
Provide a default value for secretsDir (similar to validatorsDir)
2020-06-11 17:40:08 +03:00
a75c632f7a
Fixed launch_local_testnet; Renamed validator_keygen to keystore_directories
2020-06-11 17:40:08 +03:00
a8113cf2bc
Restore the local sim to a working state
2020-06-11 17:40:08 +03:00
17343442ea
Implement more of the KeyStore spec and integrate it in the beacon node
2020-06-11 17:40:08 +03:00
1fc9413c48
Fix #1153 . ( #1160 )
...
Add ability for SyncQueue to recover from unexpected MissingParent.
2020-06-11 16:20:53 +02:00
016cc22173
show peer info on connect ( #1155 )
2020-06-11 07:14:26 +02:00
e7febc2e2b
can finalize successfully with external VCs! + some other cleanup
2020-06-10 13:50:50 +03:00
06873abde3
fixed build
2020-06-10 13:50:50 +03:00
3bae40ae91
- extracted the commands to run a VC into a separate run_validator.sh script
...
- each BN gets half of its previous validators as inProcess and the other half goes to the respective VC for that BN - using separate data dirs where the keys are copied
- also removed a few command line options which are no longer necessary
- block proposals originating from a VC are propagated from one BN to the rest properly
- other cleanup & moving code back to since it is no longer used elsewhere
2020-06-10 13:50:50 +03:00
ce897fe83f
[Split fork choice PR] Derisk-ed attestation checks changes ( #1154 )
...
* Derisked attestation pool improvements
* tune down frequent logs
* VoteTracker logging
2020-06-10 08:58:12 +02:00
a9f73ac8fb
poke
2020-06-09 18:39:05 +00:00
8f7541959a
allow compile-time switching between v0.11.3 and v0.12.1
2020-06-09 18:39:05 +00:00
36f15a3688
complete re-implmentation of reasonable asymptotic-complexity algorithms from 0.11.3
2020-06-09 18:39:05 +00:00
35f67cec60
remove the scaffolding get_empty_per_epoch_cache() calls and the pointless construction and return/discarding of zero-filled arrays
2020-06-09 18:39:05 +00:00
5582ecc1f4
remove some debugging code
2020-06-09 18:39:05 +00:00
cc13153fc6
initial 0.12.1 beacon chain spec
2020-06-09 18:39:05 +00:00
1e71388093
Include finalization, head and time (in that order) in standard bar ( #1142 )
...
These are the 3 most important things in the life of a beacon-node -
finalization checkpoint for security, head + time for seeing that we're
synced and working.
The order given is the expected increasing order that things should be
moving in - finalization lags head, and head lags clock - the structure
helps the user remember, but also see the pattern where time is getting
out of sync with head.
A validator would also want to know when the next action is going to be
(ie next attestation / block production) but that's for another day.
2020-06-08 18:04:11 +02:00
040e38529a
Fix #1140 . ( #1143 )
...
SeenTable is now able to hold peers with different timeout values.
2020-06-08 18:02:50 +02:00
a50415a719
temporary workaround for witti attestation dropping ( #1131 )
2020-06-08 09:22:31 +02:00
3ce98d5bca
Add checks for penalties which are not applied immediately. ( #1139 )
...
Change default maxHeadAge value to 1 epoch.
Set zero-point at the SyncQueue's initialization.
Remove annoying logs in runDiscoveryLoop.
2020-06-07 17:36:24 +02:00
ea8f96d284
ncli_db: allow saving states by root ( #1136 )
...
also dump state+block when validation fails
2020-06-06 13:26:19 +02:00
bb698a7e16
lots of peers ( #1130 )
2020-06-05 22:25:01 +02:00
4f1c4687e4
Fix the inspector build
2020-06-05 20:06:24 +03:00
0c78fc39e7
Use the latest LibP2P
2020-06-05 19:34:12 +03:00
32bc4d9096
Use {.push raises.} in spec/datatypes
...
This was an attempt to trigger a previously reported crash, but
everything turned out to be fine.
2020-06-05 19:33:30 +03:00
74dc2fffa6
3x blocksim speedup by using EpochRef in attestation pool addResolved(...)
2020-06-05 13:02:35 +00:00
68b5638da4
allow non-power-of-2 limits in hashlist
...
fixes "make eth2_network_simulation"
a bit sad: no test coverage except against our own tests
2020-06-05 14:51:22 +03:00
3cb7896bab
12x speedup on state sim with 100k validators sans BLS by caching get_beacon_proposer_index(...)
2020-06-04 17:07:51 +00:00
bcbfa736c9
format ErrorMsg messages reasonably ( #1109 )
2020-06-04 08:19:25 +02:00
56ffb696be
reorder ssz ( #1099 )
...
* reorder ssz
* split into hash_trees and ssz_serialization, roughly, for hashing and
IO
* move bitseqs into ssz (from stew)
* clean up imports
* docs, imports
2020-06-03 15:52:02 +02:00
405e9db199
Fix problem of good peers is also logged as timed out.
2020-06-03 13:48:01 +03:00
12e28a1fa9
Add proper concurrent connections.
...
Add SeenTable to avoid continuous attempts to dead peers.
Refactor onSecond.
Block backward sync while forward sync is working.
SyncManager now checks responses according corresponding requests + tests.
SyncManager now watching for not progressing local_head_slot and resets SyncQueue.
2020-06-03 12:53:57 +03:00
07393c8de6
Ssz cache ( #1084 )
...
* wip: cache
* cache lists and arrays of complex objects (5x block processing speed
on ncli_db)
trivial baseline cache that stores tree in flat memory structure
* support array of uint64
* work around type issues
* more type compiler bug workarounds
* cache balances, more type fixes
* index type
* ncli_db: add validation flag, better ux
* int64 fixes
* test fix
* "oops"
```
647.913, 0.000, 647.913, 647.913, 1,
Initialize DB
0.540, 0.402, 0.340, 9.451, 619,
Load block from database
40.268, 0.000, 40.268, 40.268, 1,
Load state from database
0.498, 0.150, 0.343, 0.930, 596,
Apply block
3.548, 11.005, 0.729, 54.022, 23,
Apply epoch block
```
* support all basic types
* cleanups
* a few more cleanups
2020-06-03 07:57:17 +02:00
b7bb62d48b
use shuffled validator cache in more places; cleanups ( #1095 )
2020-06-03 07:42:08 +02:00
1d9a58f1e8
a few more cleanups
2020-06-02 22:10:45 +02:00
06f025b228
Add timeout to switch.connect
2020-06-02 23:06:11 +03:00
7e881a4c09
cleanups
2020-06-02 17:17:07 +02:00
872d7ff493
support all basic types
2020-06-02 11:44:51 +02:00
00acf4f7b2
"oops"
...
```
647.913, 0.000, 647.913, 647.913, 1,
Initialize DB
0.540, 0.402, 0.340, 9.451, 619,
Load block from database
40.268, 0.000, 40.268, 40.268, 1,
Load state from database
0.498, 0.150, 0.343, 0.930, 596,
Apply block
3.548, 11.005, 0.729, 54.022, 23,
Apply epoch block
```
2020-06-01 22:37:26 +02:00
1a6b83a15f
cleanups
2020-06-01 19:45:21 +00:00
405f460f9b
int64 fixes
2020-06-01 17:35:42 +02:00
ef90a45509
Bump testutils
2020-06-01 16:58:28 +03:00
2316ac15c3
index type
2020-06-01 14:52:52 +02:00
fec01829c4
cache balances, more type fixes
2020-06-01 14:52:52 +02:00
be92842944
more type compiler bug workarounds
2020-06-01 14:52:52 +02:00
a0b8b818f3
work around type issues
2020-06-01 14:52:52 +02:00
4fc9a84c57
support array of uint64
2020-06-01 14:52:52 +02:00
f1dcee2749
wip: cache
...
* cache lists and arrays of complex objects (5x block processing speed
on ncli_db)
trivial baseline cache that stores tree in flat memory structure
2020-06-01 14:52:50 +02:00
a327e8581b
switch state transition caching to match EpochRef ( #1089 )
...
* switch state transition caching usage to shuffled active validator indices to match EpochRef
* refactor the EpochRef -> StateCache transformation; elide pointless mapIt
* limit state passed between get_beacon_committee(...) and compute_committee(...)
* tweaks
2020-06-01 09:44:50 +02:00
0bcdabfcdf
Detect another invalid SSZ input found through fuzzing
...
The first offset of an SSZ object should always have a fixed constant
value. Otherwise, some unused bytes may appear between the fixed portion
and the dynamic portion.
Please note that this fix shutds down the minimal forward compatibility
currently supported by the SSZ format (and thus, the expected behavior
must be clarified in the SSZ spec).
2020-05-30 14:47:35 +03:00
a90b0dd197
Merge pull request #1077 from status-im/timeout
...
Eth2Node.stop(): trace msg on timeout
2020-05-29 16:30:13 +02:00
c570abf602
Check iv length for decryption
2020-05-29 16:38:55 +03:00
80ce960afa
Minor improvements
2020-05-29 16:38:55 +03:00
49c083d5b7
Catch all exceptions
2020-05-29 16:38:55 +03:00
14ad100b45
Address comments
2020-05-29 16:38:55 +03:00
8496e20a78
Implement EIP 2335 compliant keystore
...
Closes #1024
2020-05-29 16:38:55 +03:00
e33c8d9067
Bump nim-eth and accompanying discv5 cleanup ( #1081 )
2020-05-29 12:03:29 +02:00
b5f45db5e9
keep cache of per-epoch items in block pool ( #1068 )
...
* plumbing between block pool and state transition functions around active validator indices and committees
* have shared epochrefs followed by blockref tree while allowing for skipped slots
* factor out the epoch info extraction; document how the EpochRef follows forks
2020-05-29 08:10:20 +02:00
061be037d1
ncli_db: database tool
...
includes a benchmark tool for now
2020-05-28 17:43:02 +00:00
0493737d7a
Remove ssz.loadFile
2020-05-28 19:15:16 +03:00
1fd87a2255
Remove SszReader.maxObjectSize
2020-05-28 19:15:16 +03:00
d4fa2c8913
Avoid an unnecessary copy in readSszValue
2020-05-28 19:15:16 +03:00
693bc15919
avoid some RVO bugs
2020-05-28 19:15:16 +03:00
f53b55cbe0
SSZ cleanup
...
* be stricter about SSZ length prefix
* compute zeroHash list at compile time
* remove SSZ schema stuff
* move SSZ navigation to ncli
* cleanup a few leftover openArray uses
2020-05-28 19:15:16 +03:00
cefd525ab3
more work on the BN/VC split
...
- fixed comments from the last review
- getting more data VIA RPC, moved some code back into the BN only
- attestation duties being requested as well
2020-05-28 13:01:42 +03:00
18eca263b1
avoid stack allocations in some tests ( #1079 )
2020-05-28 10:28:14 +02:00
21131e629b
Sync freeze fixes. ( #1072 )
...
* Add ability to reset state of sync manager.
Fix bug when sync got stuck on `zero-point` reset.
Fix bug when sync got stuck when some of the workers waiting for failing one.
* Remove debugging comments and imports.
* Remove not used pendingLock.
2020-05-28 07:02:28 +02:00
273a912ae0
Eth2Node.stop(): trace msg on timeout
2020-05-28 03:14:01 +02:00
1ec7d6e168
Quickfix for toEnode that fails
2020-05-27 13:49:18 +03:00
28128f4d2f
Add a handler for the Goodbye message
...
The lack of body of `goodbye` in sync_protocol.nim was preventing
the respective LibP2P protocol to be mounted and advertised on the
network.
Adding a body fixes that, but I've also made some changes in the
P2P protocol codegen that will prevent the issue from happening
again (no body is now considered the equivalent of having an empty
body).
2020-05-26 22:17:26 +03:00
0d54073ec9
properly work around nim type bug in ssz
...
the cast worked around the bug at compile time by means of casting, but
introduced a runtime error, because the pre-cast type was still being
used during deserialization
2020-05-26 14:12:42 +03:00
0929d90d93
unexport candidate_chains.init; some spec version bumps
2020-05-26 05:06:37 +00:00
b6c9de968f
Fix some build problems and warnings
2020-05-25 20:33:03 +03:00
8760494c72
first batch of work towards the VC/BN split:
...
- we have a new binary which connects via RPC to the respective BN and has an internal clock - waking it up on every slot
- the BN has a new option called --external-validators and currently in order to have the VC binaries to run we need to pass EXTERNAL_VALIDATORS=yes to make
- factored some code out of beacon_node.nim for easier reuse in validator_api.nim and validator_client.nim
- the VC loads its associated private keys from the datadir for its BN
- most of the validator API calls have been implemented as a stub.
- the VC polls its BN at the start of each epoch - getting a list of all active validators for the current epoch - and then continues to request blocks and sign them with its appropriate validators when necessary
2020-05-25 16:23:15 +03:00
626e51a91b
[skip ci] Address core review comments
2020-05-24 19:00:34 +03:00
4a25bec2b5
Quick and dirty fix for the inspector build
2020-05-24 19:00:34 +03:00
833f19e942
Reform the networking layer in order to handle the new stricter SSZ API
2020-05-24 19:00:34 +03:00
a8003e7e38
More complete integration of the List type; Detect more invalid inputs; Enable more tests
2020-05-24 19:00:34 +03:00
accd5fe954
Don't use StackArray in ssz; Drop the support for strings
2020-05-24 19:00:34 +03:00
74e35c464f
halt processing if one of the operation functions fails (failed deposits due to BLS signature issues return as not-failed, so it remains consistant with that
2020-05-24 08:20:13 +00:00
67ba11cc1a
use template to more cleanly implement for_ops
2020-05-24 08:20:13 +00:00
95ee0218db
switch too-strict/against-spec operations processing to use spec-based process_operations
2020-05-24 08:20:13 +00:00
f06df1cea6
remove some copies
...
* in makeBeaconBlock - use rollback instead
* in tests - this helps state_sim give more accurate data and makes it
30% faster
* fix some usages of raw BeaconState
2020-05-22 17:15:35 +00:00
681b399e2a
avoid memory alloc when padding ( #1058 )
...
also avoid stack state copy in test
2020-05-22 10:31:19 +02:00
80b8416305
skip skipped constant sanity checks also from markdown reports' perspectives ( #1053 )
...
* update more spec refs in beacon_chain/spec/presets; skip skipped constant sanity checks also from markdown reports' perspectives
* mark skipped as skipped in markdown
2020-05-21 19:56:09 +02:00
7fbb8c0bc2
return block result details ( #1049 )
2020-05-21 19:08:31 +02:00
b2193f1b8f
Eth2Node.stop(): 5s timeout
2020-05-21 00:06:01 +02:00
a38eddcaac
remove ssz stint support ( #1046 )
2020-05-20 19:05:22 +02:00
b9817867f5
audit & update spec references for some slashing and rewards and penalty functions; check and update all remaining v0.11.0 spec references to v0.11.3 [skip ci]
2020-05-20 14:57:08 +00:00
23daa966be
better deserialization log
2020-05-20 15:41:02 +02:00
30f84224a4
create dumpdir in beaconnode binary
2020-05-20 11:03:24 +00:00
3fa2f70853
update all remaining beacon chain spec references from v0.11.1 and v0.11.2 to v0.11.3
2020-05-20 08:48:18 +00:00
418888f1d0
use ethkeys to parse enr key
2020-05-20 07:35:34 +02:00
383b22795c
bump submodules ( #1043 )
2020-05-20 06:57:39 +02:00
c4462af4ab
beacon_node: graceful shutdown ( #1033 )
...
* beacon_node: graceful shutdown
* separate BeaconNodeStatus and BeaconNode instances
2020-05-19 20:57:35 +02:00
6c941b1ff7
spec v0.11.3 update
2020-05-19 17:16:55 +00:00
c014f0b301
Split quarantine ( #1038 )
...
* split blockpool into hotDB and Quarantine
* Rename hotdb -> dag/candidate chains
2020-05-19 16:18:07 +02:00
a99977b772
Progress towards #991 ; Enable the distinct ssz.List type
2020-05-19 15:53:03 +03:00
ea95021073
Fix sync issues. ( #1035 )
...
* Fix sync issues.
* Add documentation about zero-point.
Add more comments about syncing loops.
Change to 4 blocks per request.
2020-05-19 14:08:50 +02:00
4359147efc
fix snappy debug message
2020-05-19 09:23:17 +02:00
8432932c11
update to spec v0.11.2 to keep compatible with Schlesi ( #1036 )
...
* update to spec v0.11.2 to keep compatible with Schlesi
* update spec/state_transition_epoch spec references to v0.11.2
* bump other spec refs
2020-05-18 23:05:27 +00:00
0649d47df0
use proper transport flags
2020-05-18 21:51:03 +00:00
a1689f2aaf
error when snappy frame is short
2020-05-18 21:15:04 +00:00
6be7d64e8c
bump libp2p ( #1031 )
2020-05-18 10:11:21 +02:00
24a17f5814
Fix an RPC error in Lighthouse triggered by the getMetadata message
2020-05-16 09:56:13 +03:00
74db0f3c8d
fix some XDeclaredButNotUsed hints ( #1027 )
2020-05-15 14:41:00 +02:00
1916e1d2da
Revive nbench ( #1022 )
...
* Fix nbench compilation with HashedBeaconState
* Add nbench to tooling
* use newClone - fix 265e01e404 (r425198575)
2020-05-15 00:54:10 +02:00
2ddc507e5b
update datatypes v0.11.1 spec references to v0.11.2
2020-05-14 16:33:11 +00:00
2d691b2e14
bump spec ref versions
2020-05-14 16:41:46 +03:00
2db99545cd
allow inspector tool to log interop attestations
2020-05-14 16:41:46 +03:00
57519bebac
remove some unused imports, add tests for pubsub topics, and subscribe to interop attestations
2020-05-14 16:41:46 +03:00
3c98f18d47
document snappy decompression assumptions
2020-05-14 16:41:19 +03:00
a605c7244e
simplify libp2p snappy
...
* handle a few more exceptions gracefully (in libp2p also)
* unify libp2p varint parsing
* decompress directly into seq
* avoid seq slice
* stop oversized snappy processing earlier (lowers risk)
2020-05-14 16:41:19 +03:00
926d1c546e
updated news, also no longer allowing event handlers to raise anything other than a Defect in the Web3 API
2020-05-14 14:10:26 +03:00
be806e6801
API fixes - minimal changes to HTTP RPC for Eth2Stats support ( #1017 )
...
* add api for eth2stats
* fix chain head rpc
2020-05-14 11:18:08 +02:00
75c1c6a95c
Enable Snappy by default (using LibP2P steams for now)
...
This refactors the newly added Snappy streaming back-ends trying to
make them more similar and to reduce the code duplication to a minimum.
2020-05-13 12:18:42 +03:00
cheatfate
Zahary Karadjov
Jacek Sieka
tersec
Mamy Ratsimbazafy
Ștefan Talpalaru
李婷婷
Viktor Kirilov
kdeme
Zed
Dmitriy Ryajov
Diederik Loerakker