281853eee8
rename options and internal structures to doppelgangerFoo and remove probing
2021-01-30 00:17:54 +02:00
40a5d44887
Fix selection of bootstrap nodes from metadata ( #2273 )
...
Also removes again the doubling of max peers
2021-01-29 08:56:02 +01:00
1117993a24
Libp2p connection limits ( #2272 )
...
* max peers gets set as connection limits
* pass max connections
2021-01-28 07:31:29 +01:00
4de9875cdf
Revert "pass max peers to libp2p ( #2265 )" ( #2270 )
...
This reverts commit 64e4d74f87
2021-01-26 17:53:52 +01:00
aa6e93a0cd
Remove time.humaneStr and associated code
2021-01-26 18:46:33 +02:00
43c64d32f8
increase attestation/aggregate queue sizes
...
when there are many validators, many aggregates and attestations arrive
every slot - increase the queue size a bit - also do batches on each
idle loop iteration since it's fairly quick
2021-01-26 14:29:47 +02:00
1bdbf099cc
use IntSet rather than HashSet[ValidatorIndex] ( #2267 )
...
* use IntSet rather than HashSet[ValidatorIndex]
* add bounds check before uint64 -> int conversion
* use intsets in block transitions
* remove superfluous Nim issue explanation/reference
2021-01-26 12:52:00 +01:00
64e4d74f87
pass max peers to libp2p ( #2265 )
2021-01-26 10:35:22 +01:00
70a03658e3
Block validation flow v2 + Batch (serial) sig verification ( #2250 )
...
* bump nim-blscurve
* Outline the block validation flow
* introduce the SigVerified types, pass the tests
* Split clearance/quarantine to prepare for batch crypto verif
* Add a batch signature collector
* Make clearance use SigVerified block and split verification between crypto and state transition
* Always use signedBeaconBlock for the onBlockAdded callback
* RANDAO signing_root is the epoch instead of the full block
* Support skipping BLS for testing
* Fix compilation of the validator client
* Try to fix strange errors MacOS and Jenkins (Clang, unknown type name br_hmac_drbg_context in stdlib_assertions.nim.c)
* address https://github.com/status-im/nimbus-eth2/pull/2250#discussion_r561819858
* address https://github.com/status-im/nimbus-eth2/pull/2250#discussion_r561828025
* onBlockAdded callback should use TrustedSignedBeaconBlock https://github.com/status-im/nimbus-eth2/pull/2250#discussion_r561837261
* address https://github.com/status-im/nimbus-eth2/pull/2250#discussion_r561828946
* Use the application RNG: https://github.com/status-im/nimbus-eth2/pull/2250#discussion_r561815336
* Improve codegen of conversion zero-cost)
* Quick fixes with loadWithCache after #2259 (TODO: graceful error since pubkey validations is now done first in signatures_batch)
* Graceful handle rogue pubkeys and signatures now that those are lazy-loaded
2021-01-25 20:45:48 +02:00
5ca10d3de2
avoid copying keys for trusted signatures
...
this removes `is_valid_indexed_attestion` from performance benchmarks
when replaying blocks
2021-01-25 19:48:02 +02:00
8f6ce4f88d
shorten idle timeout
...
this introduces the change more gently, to avoid adverse effects - the
timeout value can subsequently be tuned based on further
experimentation.
2021-01-25 19:44:05 +02:00
7d74d3bfbc
only subscribe to subnets when aggregating ( #2254 )
...
Only subscribe to subnets when aggregating
2021-01-25 19:39:56 +02:00
8c48d44788
remove superfluous/overly aggressive, timing-dependent assertion ( #2264 )
2021-01-25 17:52:55 +01:00
5713a3ce4c
performance fixes ( #2259 )
...
* performance fixes
* don't mark tree cache as dirty on read-only List accesses
* store only blob in memory for keys and signatures, parse blob lazily
* compare public keys by blob instead of parsing / converting to raw
* compare Eth2Digest using non-constant-time comparison
* avoid some unnecessary validator copying
This branch will in particular speed up deposit processing which has
been slowing down block replay.
Pre (mainnet, 1600 blocks):
```
All time are ms
Average, StdDev, Min, Max, Samples, Test
Validation is turned off meaning that no BLS operations are performed
3450.269, 0.000, 3450.269, 3450.269, 1, Initialize DB
0.417, 0.822, 0.036, 21.098, 1400, Load block from database
16.521, 0.000, 16.521, 16.521, 1, Load state from database
27.906, 50.846, 8.104, 1507.633, 1350, Apply block
52.617, 37.029, 20.640, 135.938, 50, Apply epoch block
```
Post:
```
3502.715, 0.000, 3502.715, 3502.715, 1, Initialize DB
0.080, 0.560, 0.035, 21.015, 1400, Load block from database
17.595, 0.000, 17.595, 17.595, 1, Load state from database
15.706, 11.028, 8.300, 107.537, 1350, Apply block
33.217, 12.622, 17.331, 60.580, 50, Apply epoch block
```
* more perf fixes
* load EpochRef cache into StateCache more aggressively
* point out security concern with public key cache
* reuse proposer index from state when processing block
* avoid genericAssign in a few more places
* don't parse key when signature is unparseable
* fix `==` overload for Eth2Digest
* preallocate validator list when getting active validators
* speed up proposer index calculation a little bit
* reuse cache when replaying blocks in ncli_db
* avoid a few more copying loops
```
Average, StdDev, Min, Max, Samples, Test
Validation is turned off meaning that no BLS operations are performed
3279.158, 0.000, 3279.158, 3279.158, 1, Initialize DB
0.072, 0.357, 0.035, 13.400, 1400, Load block from database
17.295, 0.000, 17.295, 17.295, 1, Load state from database
5.918, 9.896, 0.198, 98.028, 1350, Apply block
15.888, 10.951, 7.902, 39.535, 50, Apply epoch block
0.000, 0.000, 0.000, 0.000, 0, Database block store
```
* clear full balance cache before processing rewards and penalties
```
All time are ms
Average, StdDev, Min, Max, Samples, Test
Validation is turned off meaning that no BLS operations are performed
3947.901, 0.000, 3947.901, 3947.901, 1, Initialize DB
0.124, 0.506, 0.026, 202.370, 363345, Load block from database
97.614, 0.000, 97.614, 97.614, 1, Load state from database
0.186, 0.188, 0.012, 99.561, 357262, Advance slot, non-epoch
14.161, 5.966, 1.099, 395.511, 11524, Advance slot, epoch
1.372, 4.170, 0.017, 276.401, 363345, Apply block, no slot processing
0.000, 0.000, 0.000, 0.000, 0, Database block store
```
2021-01-25 13:04:18 +01:00
7571e74dbd
Fix #2252 (consistent typing for the 'delay' log property)
2021-01-22 15:09:21 +02:00
960666d1ed
Remove std/random again
2021-01-21 19:39:04 +02:00
718feef802
Fix unstable after #2244 ( #2255 )
2021-01-21 18:27:24 +01:00
69d6ffd990
Remove watchTask().
2021-01-21 16:22:01 +02:00
a16f5afcd5
pre-emptive duplicate validator detection heuristic
2021-01-21 16:03:02 +02:00
55ecb61c3a
cycle attestation subnets every slot ( #2240 )
...
Cycle attestation subnets every slot
2021-01-19 19:44:03 +02:00
921fe5a68f
initial infrastructure for state diffs ( #2087 )
...
Initial infrastructure for state diffs
2021-01-18 22:34:41 +02:00
c0e11cfba6
shorten idle timeout
2021-01-18 22:27:34 +02:00
76f15302a7
better timesharing in eth2 processor
...
* use `idleAsync` to more evenly divide cpu attention when syncing in
particular - this gives networking better latency
* more strict exception handling in eth2_processor
2021-01-18 22:27:34 +02:00
6fabefa76f
Fix discv5 loop in case of no nodes ( #2243 )
...
* Fix discovery loop in case of no peers in routing table
* local testnet: Stop searching when amount of peers in testnet is reached
2021-01-18 14:13:26 +01:00
0fce8ad0d7
Revert "only checkpoint every four slots ( #2236 )" ( #2242 )
...
This reverts commit 7da16f4908
2021-01-18 11:02:56 +01:00
c8c819359c
More clear error message when a validator exit was rejected
2021-01-15 19:40:05 +02:00
7da16f4908
only checkpoint every four slots ( #2236 )
...
* only checkpoint every four slots
* only checkpoint every 16 slots
* every 8 slots
* every 4 slots; 8 seems probably okay, but be a bit conservative
2021-01-15 05:23:54 +00:00
295e3c9c73
Topics validation and direct peers ( #2237 )
...
* pick the right libp2p branch
* add topics validation
2021-01-15 04:17:06 +00:00
fa75c477cd
only initially subscribe to relevant attestation subnets ( #2231 )
2021-01-14 09:43:21 +01:00
66d8f317cd
Use async queryRandom instead of inefficient randomNodes to discover nodes ( #2211 )
2021-01-14 08:58:13 +01:00
0fad1b6b26
don't special-case zero-validator subnet cycling ( #2230 )
2021-01-12 17:17:43 +01:00
dde973e2d4
allow always-on subscription to all attestation subnets when gossiping ( #2225 )
...
* allow always-on subscription to all attestation subnets when gossiping
* in subscribe-all-subnets mode, consider all subnets to be stability subnets for ENR purposes
2021-01-12 13:43:15 +01:00
a3a651b565
always enable topic and aggreate metric topics ( #2229 )
2021-01-12 04:27:09 +01:00
b99a6f3dfd
Warn on Eth1 chain not synced ( #2221 )
2021-01-11 10:23:09 +01:00
87955f2d37
v1.0.6
2021-01-10 12:23:07 +02:00
d803f008c0
v1.0.5 (corrected)
2021-01-10 12:02:55 +02:00
bbdd16f81c
increase attestation pool lookback window ( #2215 )
2021-01-07 14:52:02 +01:00
338428cbd7
Add Eth1 deposits simulation to block_sim
2021-01-04 13:22:00 +02:00
ed24f60f70
remove async from sub/unsub ( #2197 )
...
* remove await/async from sub/unsub
* fix unsubscribe wrong key (missed _snappy)
* use the right libp2p commit hash
* remove unused async
* fix inspector
* fix subnet calculation in RPC and insert broadcast attestations into node's pool
* unify codepaths to ensure only mostly-checked-to-be-valid attestations enter the pool, even from node's own broadcasts
* update attestation pool tests for new validateAttestation param
Co-authored-by: Dustin Brody <tersec@users.noreply.github.com>
2020-12-24 09:48:52 +01:00
97c4f7c5c0
fix subnet calculation in RPC and insert broadcast attestations into node's pool ( #2207 )
...
* fix subnet calculation in RPC and insert broadcast attestations into node's pool
* unify codepaths to ensure only mostly-checked-to-be-valid attestations enter the pool, even from node's own broadcasts
* update attestation pool tests for new validateAttestation param
2020-12-23 13:59:04 +01:00
afbaa36ef7
make subnet cycling more robust; use one stability subnet/validator; explicitly represent gossip enabled/disabled ( #2201 )
...
* make subnet cycling more robust; use one stability subnet/validator; explicitly represent gossip enabled/disabled
* fix asymmetry in _snappy being used for subscriptions but not unsubscriptions
* remove redundant comment
* minimal RPC and VC support for infoming BN of subnets
* create and verify slot signatures in RPC interface and VC
* loosen old slot check
* because Slot + uint64 works but uint64 + Slot doesn't
* document assumptions for head state use; don't clear stability subnets; guard against VC not having checked an epoch ahead, fixing a crash; clarify unsigned comparison
* revert unsub fix
2020-12-22 10:05:36 +01:00
6c8f630170
Revert "have each validator randomly pick a stability subnet, per spec ( #2194 )"
...
This reverts commit 048a67d525
2020-12-18 23:04:31 +01:00
0f8a3a5ae8
checkpoint database at end of each slot ( #2195 )
...
* checkpoint database at end of each slot
To avoid spending time on synchronizing with the file system while doing
processing, the manual checkpointing mode turns off fsync during
processing and instead checkpoints the database when the slot has ended.
From an sqlite perspecitve, in WAL mode this guaranees database
consistency but may lead to data loss which is fine - anything missing
from the beacon chain database can be recovered on the next startup.
* log sync status and delay in slot start message
* bump
2020-12-18 22:01:24 +01:00
452042b17b
msgid formatting, libp2p bump ( #2198 )
...
* msgid formatting, libp2p bump
* fix libp2p commit
2020-12-18 18:45:27 +00:00
048a67d525
have each validator randomly pick a stability subnet, per spec ( #2194 )
2020-12-18 15:46:07 +01:00
8cc7effe52
Fix ENR attnets update to only hold persistent subnets ( #2193 )
...
* Fix ENR attnets update to only hold persistent subnets
* Use only stability subnet in metadata and enr
2020-12-18 09:50:29 +01:00
7d95e86c50
Merge branch 'stable' into devel
2020-12-16 22:22:21 +02:00
f06e6d46a2
v1.0.4
2020-12-16 22:20:45 +02:00
5d8cdb88c6
update validator metrics on startup
2020-12-16 20:44:48 +02:00
de779c7812
update validator metrics on startup
2020-12-16 19:42:19 +02:00
fea2b712f0
cache not needed to validate exits ( #2188 )
2020-12-16 15:36:02 +01:00
7d5edb4353
use new stew helpers for assignment ( #2172 )
...
* bump libp2p (reduces libp2p gossip memory usage to ~1/3)
* use "generic" assign version
2020-12-16 09:37:22 +01:00
c56677867b
Remove some accidentally left debugging changes
2020-12-16 01:09:19 +02:00
8ebf9c30b0
More complete reset of the web3 provider on each failure; Fix #2184
2020-12-16 00:21:11 +02:00
d59fc8ff5b
readd os import, sometimes used
2020-12-15 16:34:56 +01:00
91786686d5
don't repeat already-included attestations ( #2061 )
...
Don't repeat already-included attestations
Also removes the superfluous (and badly scaling) attestation-cache-eviction
2020-12-15 17:16:10 +02:00
4e191a06ac
use stew/leb128
...
* 3 varint parsers -> 1
* 1/3 memory usage / allocations when writing stuff to libp2p
2020-12-15 17:06:15 +02:00
9211b1ca03
import fixes
2020-12-15 16:19:46 +02:00
8d1443f03c
detect already-aggregate-voted condition before attestation pool; add is_aggregator tests ( #2170 )
...
* detect already-aggregate-voted condition before attestation pool; add is_aggregator tests
* replace pair of attestation-per-epoch tracking lists with single list and remove Option use
* fix attestation condition
* use safer type conversions; add more is_aggregator tests
2020-12-14 20:58:32 +00:00
9daf6be73c
graceful exit on SIGTERM ( #2178 )
...
Much easier than convincing all users to change the default signal in
their service definition file to SIGINT.
2020-12-14 16:45:14 +00:00
c91091197f
Lower gossipFactor since we default to 160 peers ( #2169 )
...
And it might potentially send a bit more IHAVE messages then wanted.
2020-12-11 12:15:34 +01:00
bc977799f6
Log warning when running without metrics support
2020-12-10 17:22:29 +02:00
91741326cc
v1.0.3
2020-12-10 02:56:02 +02:00
57fdd87a24
Log Eth1 request failures more precisely
2020-12-10 02:54:58 +02:00
7979fb79d3
Add some useful Eth1 monitor metrics
2020-12-10 02:54:58 +02:00
983b3c9fbf
Add a 'we3 test' command for verifying the compatibility of a web3 provider
2020-12-10 02:54:58 +02:00
0ec90b26a5
Update ENR record with metadata attnets at each attestation subnet cycle ( #2148 )
2020-12-09 10:13:51 +01:00
8b8b25ddac
always check whether gossip should be enabled in onslotstart ( #2162 )
2020-12-08 18:11:54 +01:00
f10f29d829
avoid some futures and copies in processing pipeline ( #2157 )
...
`addLastNoWait` does the same thing with less task scheduling and
copying
2020-12-08 09:59:40 +01:00
3b06e0f657
directly construct cstring in err() expressions
2020-12-07 22:24:06 +02:00
72d00e33b8
always wait for 2/3 into slot for aggregate attestations ( #2158 )
2020-12-07 20:32:34 +01:00
81c25ca4cd
Disconnect peers on status handshake timeout. ( #2149 )
2020-12-07 19:47:07 +01:00
46c2740097
Documentation for Validators API. ( #2147 )
...
* Recover proper validator API call and remove incorrect one.
Add more examples to API documentation.
2020-12-07 14:51:14 +02:00
32a18769e6
remove waitFor in attestation subnet cycling
2020-12-07 14:48:04 +02:00
26ea76bbdf
don't lag aggregated attestations by a slot ( #2150 )
...
* don't lag aggregated attestations by a slot
* don't use aggregation topic at all
* use aggregates again, but with aggressively low ATTESTATION_PROPAGATION_SLOT_RANGE; seems to hold on to LH 1.0 nodes
* clean up scaffolding and double ATTESTATION_PROPAGATION_SLOT_RANGE to 16
* increase ATTESTATION_PROPAGATION_SLOT_RANGE to 24
* increase ATTESTATION_PROPAGATION_SLOT_RANGE to 28 and isolate in only used function due to customization; remove TRAILING_DISTANCE machinery
2020-12-07 12:56:49 +01:00
7363bf3c7c
Fix a logical typo in beacon_api/validator.getStatus
2020-12-03 21:24:01 +02:00
d302c1d8ee
v1.0.2
2020-12-03 19:17:32 +02:00
f4a3a36731
More specific error message when block validation fails
2020-12-03 11:51:42 +02:00
be107df7f1
status bar: actually display it every second, after updating its data
2020-12-03 11:41:40 +02:00
42dd59852b
Fix compilation problem.
2020-12-03 11:40:32 +02:00
0904ee5609
get_v1_validator_attestation_data() implementation.
2020-12-03 11:40:32 +02:00
f6285d8381
Fix proposeSignedBlock() become sync.
2020-12-03 11:40:08 +02:00
088b001388
Fix get_v1_beacon_states_stateId_committees_epoch() to use optional arguments properly.
...
Optimize get_v1_beacon_pool_attestations() a bit.
2020-12-03 11:40:08 +02:00
21ef0f3a57
Fixes for get_v1_beacon_states_stateId_validators() and get_v1_beacon_states_stateId_validators_validatorId().
2020-12-03 11:40:08 +02:00
9afafb54f5
get_v1_beacon_states_stateId_validator_balances() implementation.
2020-12-03 11:40:08 +02:00
5dade7b441
post_v1_beacon_blocks() implementation.
2020-12-03 11:40:08 +02:00
5f392893c0
Change approach for get_v1_beacon_pool_attestations() to use hexadecimal strings.
2020-12-03 11:40:08 +02:00
9e7f8b37c7
get_v1_beacon_pool_attestations() implementation.
2020-12-03 11:40:08 +02:00
7e4ff7a740
Implementation of post_v1_beacon_pool_attester_slashings() and post_v1_beacon_pool_proposer_slashings().
...
Remove doAssert.
2020-12-03 11:40:08 +02:00
6cae25701b
Implementation of beacon_pool_attester_slashings(), beacon_pool_proposer_slashings() and beacon_pool_voluntary_exits().
2020-12-03 11:40:08 +02:00
027d2547cd
Fix a block proposal issue caused by incorrect merkle proofs
...
The key change here is that `addChunksAndGenMerkleProofs` is called
with all pending deposits instead of just the deposits included in
the block. The later was effectively producing merkle proofs against
a different root.
2020-12-03 11:25:52 +02:00
43662be3f8
v1.0.1
2020-12-02 14:31:13 +02:00
d5e3712609
log errors in more detail when block production fails ( #2135 )
...
* log errors in more detail when block production fails
* pass through block header error
* make everything cstring
2020-12-02 13:23:10 +01:00
94c66f15a9
Wanted peers log message fix ( #2114 )
...
* Edit Peer count low wanted peers log
* remove prometheus folder
* remove prometheus.yml
* Add current peers to low peer count log
* change to 25% peer count notice, 12.5% warning
Co-authored-by: kdeme <kim.demey@gmail.com>
2020-12-02 10:47:23 +01:00
92655f936a
Add backoff for the deposit logs requests as well; More debug logs
2020-12-02 01:43:54 +02:00
7225a6d6ed
Retry all web3 requests up to 3 times with exponential backoff
2020-12-02 01:43:54 +02:00
f3b8c777a7
Strip whitespace.
2020-12-02 01:43:36 +02:00
4feb0a308e
Fix #2125 (ETH status bar display); Bump LibP2P
2020-12-02 00:03:59 +02:00
3e4b49462b
detect excessively long graffiti strings
2020-12-01 15:39:46 +02:00
68c91d1d1b
don't wait until after the first slot to enable gossip
2020-12-01 15:39:03 +02:00
2fd71a9aac
Reduce the rate of requesting deposits to lower the risk of triggering the Infura rate limits
2020-12-01 15:38:50 +02:00
4eaf29875a
Less risk for Eth1-induced delays in block proposal
2020-12-01 15:38:50 +02:00
38f7558e50
Work around a strange codegen issue to fix local sim in CI; Bump LibP2P
2020-12-01 15:38:00 +02:00
3bdda3dd46
Hotfix: use the mainnet bootstrap nodes without specifying --network=mainnet explicitly
2020-12-01 10:44:30 +02:00
4328576e18
Hotfix: 'deposits import' was ignoring its arguments in Linux builds
2020-12-01 00:59:57 +02:00
8327240458
v1.0.0-stateofus
2020-11-29 23:50:13 +02:00
ac9bdde543
Don't rely on a metric value for the ETH display in the status bar
2020-11-29 23:35:39 +02:00
cabb07a186
Apply suggestions from code review
...
Co-authored-by: Sacha Saint-Leger <sacha@status.im>
2020-11-29 23:08:07 +02:00
3c0dfc2fbe
Implement the 'deposits exit' command; Remove 'deposits create'
2020-11-29 23:08:07 +02:00
a2364ce1bc
add getGossipSubPeers RPC ( #2107 )
2020-11-29 20:07:20 +01:00
ae19ab72c0
Implement #2067
2020-11-29 18:27:26 +02:00
c3bfe15a35
increase default max peers ( #2106 )
...
* increase default max peers
also avoid reconnection when opening stream as this might induce
a loop
* Use dial without addresses
* dial back max peers a little
2020-11-29 14:43:41 +01:00
7731109320
Remove getSpecPreset() because of crash and add missing calls into api.md
2020-11-29 11:01:55 +02:00
bf2673abc4
Restore the ETH display in the status bar
2020-11-28 20:53:51 +02:00
8685eb7042
add validator balance metrics
2020-11-28 16:22:09 +02:00
db030eb944
Setup agent/proto version identifiers in libp2p. ( #2079 )
...
* Supply `nim-libp2p` with `agent-string` and `proto-string` as configured parameters.
* Remove protoString and rng check.
* Fix compilation problem.
2020-11-28 08:00:36 +01:00
e7f2735271
fix broken metrics during replay ( #2090 )
...
* move metrics out of state transition
* add validator count metric
* remove expensive beacon_current_validators, beacon_previous_validators
metrics (they should be reimplemented with cache), add cheap
beacon_active_validators to approximate
* remove unused validator count metrics
* tidy imports/defects
2020-11-27 23:16:13 +01:00
2421d338c1
node.network.metadata.attnets is only secondary source of truth ( #2089 )
2020-11-27 15:54:13 +01:00
d16e127daf
Peer stuff ( #2084 )
...
* Revert "Revert "Full "node" RPC calls implementation and fixes to peer lifetime states. (#2065 )" (#2082 )"
This reverts commit 7cc3dc8027
2020-11-26 20:23:45 +01:00
9b9aa93cd4
Seenttl by spec ( #2083 )
...
* add rpc call to get chronos futures at runtime
* add seenTTL gossip parameter
Co-authored-by: Jacek Sieka <jacek@status.im>
2020-11-26 13:08:22 +01:00
687cbaf94c
Adjust number of sync workers from 20 to 10. ( #2077 )
...
Adjust watch task min-pause-time to 1.minute.
Slowed down pause-time recovery by factor 3/4 instead of 1/2.
2020-11-26 09:19:27 +01:00
7cc3dc8027
Revert "Full "node" RPC calls implementation and fixes to peer lifetime states. ( #2065 )" ( #2082 )
...
This reverts commit d041287a4f
2020-11-26 09:05:23 +01:00
d041287a4f
Full "node" RPC calls implementation and fixes to peer lifetime states. ( #2065 )
...
* Initial commit.
* Fix log lines and compilation error.
* Add get_v1_node_peers() implementation.
* Fix peer's lifetime states.
* Use the most recent multiaddress.
* Fix assign NewPeerScore again.
Fix compilation error with last seen address.
Fix Peer upgraded log line place.
* syncing, health, peer_count, peer_id and fixes for identity.
* Fix compilation problems.
* Move object declaration to callsigs.
Fix identity addresses fields.
* Finish node RPC calls.
* Avoid leak of lifetime future.
* Bump chronos.
* Fix json generator problem.
2020-11-26 08:09:59 +01:00
e69b5ff473
Add a record create and print command
2020-11-25 18:32:59 +02:00
3a13750734
Try to obtain deposit contract address from config.
...
Attempt to fix json generation.
2020-11-25 18:30:44 +02:00
68f4ad64a4
Disable exception if depositAddress is not available.
2020-11-25 18:30:44 +02:00
af3862da48
Make depositAddress public in eth1_monitor.
...
Fix representation of config.
Add deposit_contract implementation.
2020-11-25 18:30:44 +02:00
8eafbb4e09
Add config_spec implementation.
2020-11-25 18:30:44 +02:00
3594fa2a22
Version 1.0.0-rc1
2020-11-25 03:13:58 +02:00
b9e4fef616
Check that the selected data dir is compatible with the selected network
2020-11-25 03:13:58 +02:00
e1e4871287
fix time formatting and pre-genesis ops
2020-11-25 01:51:46 +02:00
151d116f02
Fix off-by-one error in Eth1 pruning
2020-11-25 01:51:17 +02:00
a995cdd3d9
Bugfix: fix an incorrect balance increase during genesis state generation
2020-11-24 23:30:26 +02:00
594ef713a0
Increase the web3 timeouts
2020-11-24 23:28:20 +02:00
372c9b798c
Fix the corrupted database state on Pyrmont nodes; Add mainnet genesis ( #2056 )
...
* Handle some web3 timeouts better
* Add support for developer .env files
* Eth1 improvements; Mainnet genesis state
Notable changes:
* The deposits table have been removed from the database. The client
will no longer process all deposits on start-up.
* The network metadata now includes a "state snapshot" of the deposit
contract. This allows the client to skip syncing deposits made prior
to the snapshot (i.e. genesis). Suitable metadata added for Pyrmont
and Mainnet.
* The Eth1 monitor won't be started unless there are validators attached
to the node.
* The genesis detection code is now optional and disabled by default
* Bugfix: The client should not produce blocks that will fail validation
when it hasn't downloaded the latest deposits yet
* Bugfix: Work around the database corruption affecting Pyrmont nodes
* Remove metadata for Toledo and Medalla
2020-11-24 22:21:47 +01:00
040093a945
medalla -> pyrmont ( #2062 )
2020-11-23 17:46:51 +01:00
6f476ca380
Gossip11 params ( #2047 )
...
* add rpc call to get chronos futures at runtime
* add eth2 spec gossip parameters
* bump libp2p
* fix url, remove 1.0
Co-authored-by: Jacek Sieka <jacek@status.im>
2020-11-23 10:57:03 +01:00
672915e170
work around long pyrmont startup time ( #2060 )
...
* also fixes unnecessary copy/memory alloc when loading DbSeq entries
2020-11-21 18:53:40 +01:00
00aedddf2a
Version 0.6.6
2020-11-20 22:31:03 +02:00
dbcc0686ff
delay pruning of cache for finalized epoch ( fixes #2049 )
2020-11-20 20:57:50 +02:00
316a19af5f
Address review comments
2020-11-20 17:13:51 +02:00
d232f16b40
Add more eth1-related logging
2020-11-20 17:13:51 +02:00
e22248bca1
Tentative fix for the Pyrmont Eth1 voting issue
2020-11-20 17:13:51 +02:00
3c4cf95d0e
remove v0.12.3 and medalla support ( #2038 )
2020-11-20 14:49:49 +01:00
54c388b7b4
close slashing protection database ( #2050 )
2020-11-20 14:23:55 +01:00
1d7fb2ed0c
remove {.inline.} pragmas ( #2033 )
...
* remove {.inline.} pragmas
* re-add inline on bitseqs functions and tweak inlining threshold
* remove macOS/LLVM inlining setting; revert non-init/module-local/tests inline pragma removal
2020-11-20 11:00:22 +01:00
883e18da81
Hotfix: don't crash on web3 provider errors during initialization
2020-11-20 10:26:47 +02:00
771c1d092a
hotfix fork choice score application ( #2041 )
...
Depending on the order of nodes in fork choice, it seems that the break
here could cause some scores not to be applied correctly
2020-11-19 15:11:08 +01:00
e370e80aee
Add more Pyrmont bootstrap nodes
2020-11-18 14:40:45 +02:00
6b6e9b4d77
v0.6.4 Script and instructions for joining Pyrmont; WIP page in the book
2020-11-18 00:27:22 +02:00
11e1a9e8e8
A hacky work-around for a web3 issue that may cause the client to go into a loop of failing requests
2020-11-18 00:27:21 +02:00
ebfacf597c
Review and fix some usages of Future.cancel; Bump Chronos
2020-11-18 00:27:21 +02:00
9c5cef346b
set file and dir permissions
2020-11-17 23:28:26 +02:00
4479c0a9f1
fix some libp2p channel hangs ( #2032 )
...
* fix some libp2p channel hangs
* make sure no concurrent reads are issues by awaiting cancellations
* bumps with fixes
* merge bump
2020-11-17 16:07:05 +01:00
9e716b32bd
address some XDeclaredButNotUsed hints ( #2028 )
2020-11-17 11:14:53 +01:00
a6b188bfd4
misc fixes ( #2027 )
...
* log when database is loading (to avoid confusion)
* generate network keys later during startup
* fix quarantine not scheduling chain of parents for download and
increase size to one epoch
* log validator count, enr and peerid more clearly on startup
2020-11-16 20:15:43 +01:00
21c4ce8fd4
remove superfluous TODOs/not-really-TODOs, type conversion, imports ( #2025 )
2020-11-16 17:10:51 +01:00
19707e89c2
Change random network key log line and include PeerID.
2020-11-16 17:41:23 +02:00
5b011b65ae
add rpc call to get chronos futures at runtime
2020-11-16 12:31:39 +02:00
e2f161dbf7
fix attestation sending schedules to avoid timing attack ( #1995 )
2020-11-16 10:44:18 +01:00
b022dc4d1f
Use O(n) algorithm in initialize_beacon_state_from_eth1; Avoid unnecessary merkle proofs generation
2020-11-15 21:40:40 +02:00
8012102704
Bugfix: the client can miss the genesis event in the absence of new deposits
2020-11-15 21:40:40 +02:00
9f28a464fb
[skip ci] Update the version number
2020-11-14 23:26:46 +02:00
d02d8f8d51
Drop UseDiscv51 flag and only support discovery v5.1
2020-11-14 19:12:30 +02:00
80ca7a2d9f
Implement #1768
2020-11-12 22:29:43 +02:00
17d35e1fd9
Allow the node to start when it fails to initialize the Eth1 monitor
...
* Avoid hangs when wss:// is specified for a non-secure HTTP server
* Produce an ERROR when the web3 provider is unsupported, but still launch the node
2020-11-12 22:29:43 +02:00
5e45e7429e
Rewrite all HTTP(S) web3 URLs to WebSocket URls
2020-11-12 22:29:43 +02:00
87c92ea05f
Address review comments.
...
Remove `-8.0` bucket because `-4.0` is a limit.
2020-11-12 21:52:01 +02:00
dbb058682c
Add beacon_attestation_sent_delay metric.
2020-11-12 21:52:01 +02:00
8ad45de65b
Add makefile targets for Pyrmont
2020-11-12 21:51:15 +02:00
b9e122a60c
address some TODOs ( #2005 )
2020-11-12 19:24:07 +00:00
e035b7d0c9
Fix status rpc request to use RESP_TIMEOUT. ( #2002 )
2020-11-12 15:30:12 +00:00
754d65c159
non-spec aggregate validation check now in spec; update genesis times ( #2001 )
2020-11-12 15:29:32 +00:00
a0621d52f6
bump remaining rc.0 spec ref ( #2003 )
2020-11-12 13:58:41 +00:00
f642f71457
Calculate how much time syncing takes, and show it at statusbar.
2020-11-12 14:16:12 +02:00
332e248d91
rpc: setLogLevel ( #1991 )
...
* rpc: setLogLevel
also change default rpc port to match makefile and manual
* set topic-level formats too
and make feature less secret
2020-11-12 11:46:02 +01:00
43c6c5a0b3
Gossip message id should decompress data ( #1998 )
...
* also fix missing return on empty message
2020-11-12 11:45:28 +01:00
5644cfae8f
increase max db object size ( fixes #1996 )
2020-11-12 08:42:45 +01:00
c5710d97fc
default to gossipsub 1.1 ( #1992 )
2020-11-11 13:30:18 +01:00
389c11743a
Review TODO items and self-assign the most important ones
2020-11-10 20:41:04 +02:00
6e40ca5e15
Use separate cache for getting epochref
...
...else tmpState gets overwritten when producing blocks and requesting
epochRef for finalized state.
2020-11-10 17:40:32 +02:00
ea4d94c65c
Add guard task to monitor synchronization worker Future. ( #1972 )
...
* Add guard task to monitor synchronization worker Future.
* Change log events from debug to warning level.
2020-11-10 14:47:26 +01:00
7eaae89263
keep AllTests-mainnet.md consistent; ensure don't send overly large messages aren't sent ( #1973 )
2020-11-09 18:11:09 +00:00
a010ef2061
update tests from v1.0.0-rc.0 to v1.0.0 ( #1976 )
2020-11-09 17:44:18 +00:00
bd1047b715
0.6.0 release fixes
...
* Updated README
* No double v in nimbus_beacon_node --version
* No md5 checksums
2020-11-09 17:09:49 +02:00
271df8b604
bump 1.0.0rc-0 spec refs to 1.0.0 ( #1974 )
2020-11-09 14:18:55 +00:00
61a3209c24
remove version quotes
2020-11-09 13:37:58 +01:00
94e9ce3c1f
Add metadata for the toledo network
2020-11-09 11:38:52 +02:00
4b603d7f5a
Change the default log level to INFO
2020-11-09 11:38:52 +02:00
e9b9cd75ee
Rename binaries; Mimic the original repo layout in the distribution
2020-11-09 11:38:52 +02:00
bf58915500
release fixes ( #1966 )
2020-11-07 08:46:53 +01:00
d2476b643a
bump version ( #1964 )
...
* bump version
* update version format to "standard" style
* remove zinken/attacknet (both networks deprecated)
* add mainnet warning
2020-11-07 08:45:55 +01:00
fb6ce5c804
Enable discv5.1 for general beacon_node and inspector builds
2020-11-07 01:27:02 +02:00
ac1072b4bb
Add ./run-medalla-beacon-node script
2020-11-07 01:25:02 +02:00
4a710252d8
Check the web3 provider for network compatibility
2020-11-07 01:25:02 +02:00
24f8b7d483
[skip ci] Clean up some accidentally commited code
2020-11-06 11:53:44 +02:00
a8a66fe3f6
Fix #1784 ; Handle Infura HTTPS URLs
2020-11-06 11:15:32 +02:00
f596a24c4c
Mainnet deposit contract monitoring
2020-11-06 11:15:32 +02:00
95f5f76180
Datatype cleanup ( #1953 )
...
* clear up spec todo
* test fix
* remove unnecessary toSszType
* type
* one more
2020-11-04 21:52:47 +00:00
fc7885b27e
Store block summary in database
...
This introcudes a cache for block summaries, useful for instantiating
the block dag on startup, bringing medalla startup times down from
minutes to seconds.
This is something of a temporary band-aid that would be obsoleted by a
finalized block store.
2020-11-04 11:28:55 +02:00
Dustin Brody
Kim De Mey
Dmitriy Ryajov
Zahary Karadjov
Jacek Sieka
Mamy Ratsimbazafy
cheatfate
Giovanni Petrantoni
Ștefan Talpalaru
Sacha Saint-Leger