816779733e
use the eth2 message id for gossip (in logging too) ( #1246 )
...
* use the eth2 message id for gossip (in logging too)
* bump
* add spec link
2020-06-28 22:06:50 +02:00
eeccaaf16d
stop gossipping non-snappy ( #1240 )
...
* stop gossipping non-snappy
Also simplify subscription and actually handle decoding errors
* log weird states too
2020-06-27 12:16:43 +02:00
1301600341
Trusted blocks ( #1227 )
...
* cleanups
* fix ncli state root check flag
* add block dump to ncli_db
* limit ncli_db benchmark length
* tone down finalization logs
* introduce trusted blocks
We only store blocks whose signature we've verified in the database - as
such, there's no need to check it again, and most importantly, no need
to deserialize the signature when loading from database.
50x startup time improvement, 200x block load time improvement.
* fix rewinding when deposits have invalid signature
* speed up ancestor iteration by avoiding copy
* avoid deserializing signatures for trusted data
* load blocks lazily when rewinding (less memory used)
* chronicles workarounds
* document trustedbeaconblock
2020-06-25 12:23:10 +02:00
1d709c09f4
secp: requiresInit ( #1210 )
...
* secp: requiresInit
* bump
2020-06-22 21:40:19 +02:00
14274587cf
More user-friendly logging during mainchain monitoring
2020-06-22 17:30:04 +03:00
47eaaa7696
Fix connection workers race. ( #1204 )
2020-06-21 18:49:48 +02:00
a661ecbae1
bump libp2p ( #1209 )
2020-06-21 18:45:28 +02:00
7e0e4dc327
don't crash on unknown disconnection reason, fix disconnection reason enum ( #1208 )
2020-06-20 09:24:33 +02:00
e813111b3b
peers rpc call
...
simple way to display nbc peer table
2020-06-18 07:29:20 +00:00
8fbbd59885
metric names ( #1188 )
...
* fix metric names to not clash with native libp2p metrics
* run testnet node with rpc enabled by default
2020-06-17 13:04:24 +02:00
a25bc025d1
Start discovery after starting libp2p switch
2020-06-16 13:33:46 +00:00
68a8b7d969
Filter discovery nodes on forkId ( #1162 )
2020-06-12 16:14:18 +02:00
cf6a869e9e
Address some TODO items; Handle start-up before genesis more properly
2020-06-11 17:40:08 +03:00
c773e10c1a
Attempt to reduce the risk of dropped network connections during the loading of KeyStores
2020-06-11 17:40:08 +03:00
25821331c4
More greppable code for the onPeerConnected operation
2020-06-11 17:40:08 +03:00
016cc22173
show peer info on connect ( #1155 )
2020-06-11 07:14:26 +02:00
040e38529a
Fix #1140 . ( #1143 )
...
SeenTable is now able to hold peers with different timeout values.
2020-06-08 18:02:50 +02:00
3ce98d5bca
Add checks for penalties which are not applied immediately. ( #1139 )
...
Change default maxHeadAge value to 1 epoch.
Set zero-point at the SyncQueue's initialization.
Remove annoying logs in runDiscoveryLoop.
2020-06-07 17:36:24 +02:00
0c78fc39e7
Use the latest LibP2P
2020-06-05 19:34:12 +03:00
bcbfa736c9
format ErrorMsg messages reasonably ( #1109 )
2020-06-04 08:19:25 +02:00
56ffb696be
reorder ssz ( #1099 )
...
* reorder ssz
* split into hash_trees and ssz_serialization, roughly, for hashing and
IO
* move bitseqs into ssz (from stew)
* clean up imports
* docs, imports
2020-06-03 15:52:02 +02:00
405e9db199
Fix problem of good peers is also logged as timed out.
2020-06-03 13:48:01 +03:00
12e28a1fa9
Add proper concurrent connections.
...
Add SeenTable to avoid continuous attempts to dead peers.
Refactor onSecond.
Block backward sync while forward sync is working.
SyncManager now checks responses according corresponding requests + tests.
SyncManager now watching for not progressing local_head_slot and resets SyncQueue.
2020-06-03 12:53:57 +03:00
06f025b228
Add timeout to switch.connect
2020-06-02 23:06:11 +03:00
a90b0dd197
Merge pull request #1077 from status-im/timeout
...
Eth2Node.stop(): trace msg on timeout
2020-05-29 16:30:13 +02:00
e33c8d9067
Bump nim-eth and accompanying discv5 cleanup ( #1081 )
2020-05-29 12:03:29 +02:00
21131e629b
Sync freeze fixes. ( #1072 )
...
* Add ability to reset state of sync manager.
Fix bug when sync got stuck on `zero-point` reset.
Fix bug when sync got stuck when some of the workers waiting for failing one.
* Remove debugging comments and imports.
* Remove not used pendingLock.
2020-05-28 07:02:28 +02:00
273a912ae0
Eth2Node.stop(): trace msg on timeout
2020-05-28 03:14:01 +02:00
28128f4d2f
Add a handler for the Goodbye message
...
The lack of body of `goodbye` in sync_protocol.nim was preventing
the respective LibP2P protocol to be mounted and advertised on the
network.
Adding a body fixes that, but I've also made some changes in the
P2P protocol codegen that will prevent the issue from happening
again (no body is now considered the equivalent of having an empty
body).
2020-05-26 22:17:26 +03:00
833f19e942
Reform the networking layer in order to handle the new stricter SSZ API
2020-05-24 19:00:34 +03:00
accd5fe954
Don't use StackArray in ssz; Drop the support for strings
2020-05-24 19:00:34 +03:00
b2193f1b8f
Eth2Node.stop(): 5s timeout
2020-05-21 00:06:01 +02:00
a38eddcaac
remove ssz stint support ( #1046 )
2020-05-20 19:05:22 +02:00
383b22795c
bump submodules ( #1043 )
2020-05-20 06:57:39 +02:00
c4462af4ab
beacon_node: graceful shutdown ( #1033 )
...
* beacon_node: graceful shutdown
* separate BeaconNodeStatus and BeaconNode instances
2020-05-19 20:57:35 +02:00
0649d47df0
use proper transport flags
2020-05-18 21:51:03 +00:00
6be7d64e8c
bump libp2p ( #1031 )
2020-05-18 10:11:21 +02:00
24a17f5814
Fix an RPC error in Lighthouse triggered by the getMetadata message
2020-05-16 09:56:13 +03:00
74db0f3c8d
fix some XDeclaredButNotUsed hints ( #1027 )
2020-05-15 14:41:00 +02:00
75c1c6a95c
Enable Snappy by default (using LibP2P steams for now)
...
This refactors the newly added Snappy streaming back-ends trying to
make them more similar and to reduce the code duplication to a minimum.
2020-05-13 12:18:42 +03:00
f055fad08a
Make the Snappy FastStreams integration optional by duplicating it for LibP2P streams
2020-05-13 12:18:42 +03:00
15f0153441
Cosmetic improvements
2020-05-13 12:18:42 +03:00
9538b60704
Integrate the async Snappy implementation
2020-05-13 12:18:42 +03:00
a739d7e8d6
Adapt SSZ to the latest FastStreams API
2020-05-13 12:18:42 +03:00
da0b1a4993
Fix status handling. ( #1008 )
...
* Fix status handling.
Add log map of received blocks.
* Fix review comments.
Fix UnusedImport in sync_protocol.nim
2020-05-13 08:37:58 +02:00
592d6f65c3
bump ( #1001 )
2020-05-09 16:47:14 +02:00
fc9d6bc1b3
enable SO_REUSEADDR in libp2p transports
2020-05-08 21:50:20 +02:00
3ffd0d7216
Fix gossip messages not delivered. ( #983 )
2020-05-06 15:42:59 +00:00
7237a370ba
Implement https://github.com/status-im/nim-beacon-chain/issues/872
...
Please see the newly added 'schlesi-dev' Makefile target.
It demonstrates how the log level can be specified for individual topics.
Additionally, when connecting to testnets like 'schlesi' there will be
two additional log files produced in the working directory:
* json-log.txt
* text-log.txt (in the textblocks format)
2020-04-28 13:49:30 +03:00
dcc70c5259
resolved final comment from review
2020-04-27 22:10:35 +03:00
8ef28c905d
fixed commets from review
2020-04-27 22:10:35 +03:00
5ecba6df49
broadcasting and listening to the '_snappy' topics as well
2020-04-27 22:10:35 +03:00
740b76d152
Spec-compliant implementation of Eth1 monitoring; Eth1-enabled local sim
...
BEWARE! This commit will trigger a stack overflow during local sim
2020-04-26 13:04:53 +03:00
be89a3c54d
Add "drop by score" ability to PeerPool. ( #917 )
...
* Add "drop by score" ability to PeerPool.
Add tests.
Fix syncmanager queue to start from most fresh data.
* Fix endless cycle at the end of syncing process.
2020-04-23 17:31:00 +02:00
3d42da90a8
Syncing. ( #909 )
2020-04-20 16:59:18 +02:00
8b6c51e78d
secp: convenience api ( #897 )
2020-04-17 15:29:49 +02:00
a4830976ab
hotfix: fix the selecting of the syncing protocol handlers
2020-04-16 15:01:19 +03:00
672f690bf6
Implement most of the v0.11.1 networking changes
2020-04-16 01:01:18 +03:00
22e5f8165e
Don't use `defer` in eth2_network to avoid https://github.com/nim-lang/Nim/issues/13899
2020-04-16 01:01:18 +03:00
f34fd46e3a
Add snappy and protobuf-serialization; Use the latest FastStreams API
2020-04-16 01:01:18 +03:00
31bf8fa408
remove all but one UnusedImport warning ( #881 )
...
* remove all but one UnusedImport warning
* bump a few more spec version references from v0.10.1 to v0.11.1
* more v0.10.1 spec reference updates/removals
* yet more v0.10.1 spec reference updates
2020-04-10 16:06:24 +02:00
04cf6d30eb
vendor: bump nim-eth + fallout ( #861 )
2020-04-05 11:50:31 +02:00
d180724d41
Bump eth ( #857 )
...
* vendor: bump stew
* vendor: bump nim-eth
* vendor: bump web3 too
2020-04-03 11:12:38 +02:00
fc2fff249b
Discv5: Don't pass ip address when external ip is not known
2020-04-02 00:52:34 +03:00
cd388bc9bb
extended validation ( #812 )
...
* initial extended validation setup
* flesh out all TODO items for attestation and beaconblock verification
* fix finalization and add chronicles debugging messages
* directly use blockPool.headState rather than pointlessly updating it and document this constraint
* fix logic relating to first-attestation checking; support validating blocks across multiple forks
2020-03-31 18:39:02 +00:00
97abe77398
close unused PeerInfo instance
...
Should not be needed from the GC's point of view, but needed when
gathering Future.state statistics, due to `PeerInfo.lifefut`.
2020-03-30 00:23:01 +02:00
46e395c647
Switch to GossipSub
2020-03-25 23:32:05 +02:00
86a3bea1ec
Use the latest Chronos and Libp2p
2020-03-24 22:14:40 +02:00
b80a5b90df
Adjustments to store bootnode enrs in discovery object + bump nim-eth
2020-03-24 22:14:40 +02:00
f2434139e9
Hotfix: Don't report failure to connect to bootstrap node due to the initial sync taking more than 30 seconds
2020-03-23 22:29:50 +02:00
d63e4870e6
Fix Stream EOF problem.
2020-03-23 22:21:27 +02:00
46a3009c63
Restore the address file feature (and use it for synchronization in local sim)
2020-03-23 14:59:33 +02:00
4623aa81ec
Clean up some obsolete code
2020-03-23 14:59:33 +02:00
d5e4e640b4
Merge libp2p_backend into eth2_network
2020-03-23 14:59:33 +02:00
0c018cb68a
Mechanically remove all mentions of the daemon from the code
2020-03-23 14:59:33 +02:00
d2b7ee27de
The RPC service listens on localhost by default
2020-03-22 19:00:09 +02:00
19847bbd20
Remove some warnings
2020-03-22 19:00:09 +02:00
d802fa593c
Add pubsub message logging.
...
Initial commit of logtrace tool.
2020-03-11 17:26:30 +00:00
ab1a08084b
One more attempt to fix compilation error.
2020-02-28 14:44:41 +02:00
dd316e04d1
Fix one more compilation error.
2020-02-28 14:44:41 +02:00
547c8a44d0
Replace Table[PeerID, Peer] with PeerPool.
...
Add `score` Peer.
2020-02-28 14:44:41 +02:00
fa0f3b4468
Use the specified extip address in the advertised ENR records
2020-02-22 20:54:15 +02:00
08915ed597
bump libp2p and increase bootstrap timeout
2020-02-21 12:03:19 -06:00
880b981a0a
Don't wait for 10 seconds when connecting to the network
2020-02-19 12:45:34 +02:00
55886ff0ac
More proper fix replacing hotfix 052a6ac3bc
...
nim-eth was bumped to take advantage of a fixed `==` for public eth keys
2020-02-19 11:59:38 +02:00
3b9e9fefa8
Make the persistent network keys compatible with the Go daemon
...
The daemon requires its key file to be encoded as ProtoBuf value
with a proper `key scheme` discriminator.
2020-02-19 10:58:10 +02:00
1b1cd915db
Support ENR boot records with the Go daemon
2020-02-19 10:26:32 +02:00
052a6ac3bc
Hotfix: disable the bootstrap node connectivity check
...
This used to behave properly before the rebase, but currently
it forces the bootstrap node to exit, because it ends up being
launched with an ENR list telling it to connect to itself.
The root cause will be investigated in a follow-up PR.
2020-02-18 20:42:25 +02:00
57811dce89
Don't log unwanted lines in beacon_node --help
2020-02-18 12:53:49 +02:00
b2d5aba749
Advertise the TCP port of the bootstrap node properly
2020-02-18 12:53:49 +02:00
2c814db750
Temporary switch to supporting only ENR bootstrap addresses
...
Turns out the DiscV5 code relies heavily on the presence of ENR
records at the moment, so we cannot drive it with ENodes. @kdeme
is working on refactoring that will relax these requirements.
2020-02-18 12:53:49 +02:00
7f395e554a
WIP Working local network sim with discovery
...
* The bootstrap_nodes.txt file in the node's data dir is now optional
* Log more data on start-up
* Use the latest ENR APIs
* Fix simulation build errors
2020-02-18 12:53:49 +02:00
ee7c2c9dff
Unify the bootstrap nodes handling code
...
We no longer discriminate between ENR, MultiAddress or ENode
bootstrap records (all of them are remapped to ENodes).
The discovery loop will stochastically try to reconnect to
accidentally disconnected nodes.
2020-02-18 12:53:49 +02:00
b39f36b49b
use floodsub instead of gossipsub
2020-02-05 17:20:04 +01:00
270c25c8b8
drop rlpx support ( #679 )
2020-01-24 09:32:52 +01:00
52878405b7
Integrate Discovery V5 and support ENR bootstrap records
2020-01-21 01:26:57 +02:00
7e356b3fa6
Restore compilation with trace-level logging; Fixes #642
2020-01-21 01:26:57 +02:00
10e6d4842f
Local sim finalizes with native LibP2P
2019-12-10 15:02:16 +02:00
889031453f
The beacon node can be compiled with the LibP2P native back-end
...
This hasn't been tested yet even in local sim.
2019-12-10 15:02:16 +02:00
1d8bfd8c0d
Allow overriding the bootstrap node in run_node.sh
2019-11-26 02:45:25 +02:00
Jacek Sieka
Zahary Karadjov
Eugene Kabanov
kdeme
Ștefan Talpalaru
Dmitriy Ryajov
tersec
Viktor Kirilov