880acd9dc1
Merge branch 'master' into gossip-one-one
2020-07-28 12:06:16 +09:00
f7fdf31365
Pubsub lifetime ( #284 )
...
* lifecycle hooks
* tests
* move trace after closed check
* restore 1 second heartbeat
* await close event
* fix tests
* print direction string
* more trace logging
* add pubsub monitor
* add log scope
* adjust idle timeout
* add exc.msg to trace
2020-07-27 13:33:51 -06:00
f73cf36afb
add a handleConnect in subscribeTopic
2020-07-22 11:00:02 +09:00
f122ec9dbf
fix grafted defect
2020-07-22 10:19:53 +09:00
aded78f259
don't delete while iterating in score update
2020-07-21 13:37:06 +09:00
b61f1da9a8
fixes
2020-07-21 11:47:46 +09:00
884d05cbc2
score wip
2020-07-21 11:25:14 +09:00
0776cc77e7
Merge branch 'master' into gossip-one-one
2020-07-21 11:02:02 +09:00
3b088f8980
Fix some unsubscribe issues and add unsubscribeAll helper ( #282 )
...
* Fix some unsub issues and add unsuball helper
* batch sendprune in unsubscribe methods
* add unsubscribeAll for floodsub
2020-07-20 10:16:13 -06:00
afe17ca2c1
score wip
2020-07-20 18:20:22 +09:00
b8a519884e
tables troubleshooting
2020-07-20 16:20:49 +09:00
d9fa9e2e84
wip
2020-07-19 12:37:45 +09:00
6af7909378
fix internal gossip tests
2020-07-18 21:00:44 +09:00
13c87a76c0
pubsubpeer, chronicles explicit override
2020-07-18 18:09:40 +09:00
17ac11f2b0
fix logging issue
2020-07-18 18:02:39 +09:00
88ace2c5dd
Merge branch 'master' into gossip-one-one
2020-07-18 12:08:25 +09:00
94196fee71
Connections and pubsub peers cleanup ( #279 )
...
* better peer tracking and cleanup
* check if peer and conn is nil
* test name
* make timeout more agressive
* rename method for better clarity
2020-07-17 13:46:24 -06:00
0348773ec9
Connection manager ( #277 )
...
* splitting out connection management
* wip
* wip conn mngr tests
* set peerinfo in contructor
* comments and documentation
* tests
* wip
* add `None` to detect untagged connections
* use `PeerID` to index connections
* fix tests
* remove useless equality
2020-07-17 09:36:48 -06:00
6b23cae3d4
wip
2020-07-17 18:01:30 +09:00
0d60a2f1c6
Merge branch 'master' into gossip-one-one
2020-07-17 17:10:49 +09:00
9e3f70896a
wip updateScores
2020-07-17 14:03:25 +09:00
170685f9c6
gossipsub fixes ( #276 )
...
* graft up to D peers
* fix logging so it's clear who is grafting/pruning who
* clear fanout when grafting
2020-07-16 21:26:57 +02:00
6f638259ee
grafted and pruned procs
2020-07-16 22:32:43 +09:00
19d3d57d4c
small sugar
2020-07-16 21:59:33 +09:00
b0fa68022a
Merge branch 'master' into gossip-one-one
2020-07-16 21:59:03 +09:00
b3aad9e1ef
cleanups/wip
2020-07-16 21:53:45 +09:00
c76152f2c1
Simplify send ( #271 )
...
* PubSubPeer.send single message
* gossipsub: simplify send further
2020-07-16 12:06:57 +02:00
f708874170
finishup with params
2020-07-16 16:55:59 +09:00
0e2ff309df
parameters wip
2020-07-16 13:23:11 +09:00
66e5f41c38
Merge branch 'master' into gossip-one-one
2020-07-16 11:44:11 +09:00
f35b8999b3
some light cleanup for pub/gossip sub ( #273 )
...
* move peer table out to its own file
* move peer table
* cleanup `==` and add one to peerinfo
* add peertable
* missed equality check
2020-07-15 13:18:55 -06:00
b9759c0536
Merge branch 'master' into gossip-one-one
2020-07-15 23:22:59 +09:00
255d9d0324
wip parameters
2020-07-15 17:44:23 +09:00
b832668768
Minprotobuf refactoring 2 ( #269 )
...
* Protobuf refactoring stage II.
* Remove NoError.
* Change trace level for invalid message.
2020-07-15 10:25:39 +02:00
6eb651d43a
control prune updates (pb)
2020-07-15 17:07:17 +09:00
543ebdbdf5
support interop testing
2020-07-15 13:03:10 +09:00
d7bab37119
Fix gossip messages seqno according to spec ( #253 )
...
* Fix gossip messages seqno according to spec
* Add peers back to gossipsub table, slow down heartbeat
* Revert "Add peers back to gossipsub table, slow down heartbeat"
This reverts commit 01e2e62172
2020-07-14 21:51:33 -06:00
8078fec0f0
Merge branch 'master' into gossip-one-one
2020-07-15 08:47:43 +09:00
92623eea53
gossipsub11 -> gossipsub
2020-07-15 08:27:58 +09:00
b8b0a2b4bc
CI: build binaries with TRACE & JSON logs ( #268 )
...
Also: remove unused imports.
2020-07-14 02:02:16 +02:00
c6c2d99907
one more log fix
2020-07-13 20:19:20 +02:00
76853f064a
json logging again
2020-07-13 19:59:49 +02:00
6620b7a00b
more comment fixes
2020-07-13 19:30:18 +02:00
0d4c74b33a
comment log that can't be json-serialized
2020-07-13 18:36:49 +02:00
061c54d3c6
logging fixes
2020-07-13 17:26:05 +02:00
87e58c1c8d
metrics: one more pubsub peers fix
2020-07-13 16:16:46 +02:00
c7895ccc52
metrics: fix pubsub_peers add metric
2020-07-13 16:15:27 +02:00
fcda0f6ce1
PubSubPeer tables refactor ( #263 )
...
* refactor peer tables
* tests fixing
* override PubSubPeer equality
* fix pubsubpeer comparison
2020-07-13 15:32:38 +02:00
efb952f18b
[WIP] Minprotobuf refactoring ( #259 )
...
* Minprotobuf initial commit
* Fix noise.
* Add signed integers support.
Add checks for field number value.
Remove some casts.
* Fix compile errors.
* Fix comments and constants.
2020-07-13 14:43:07 +02:00
bec9a0658f
Cleanup rpc handler ( #261 )
...
* more cleanup
* fix tests
* merging master
* remove `withLock` as it conflicts with stdlib
* wip
* more fanout ttl
Co-authored-by: Giovanni Petrantoni <giovanni@fragcolor.xyz>
2020-07-09 17:54:16 -06:00
4c815d75e7
More gossip cleanup ( #257 )
...
* more cleanup
* correct pubsub peer count
* close the stream first
* handle cancelation
* fix tests
* fix fanout ttl
* merging master
* remove `withLock` as it conflicts with stdlib
* fix trace build
Co-authored-by: Giovanni Petrantoni <giovanni@fragcolor.xyz>
2020-07-09 14:21:47 -06:00
c720e042fc
clean up mesh handling logic ( #260 )
...
* gossipsub is a function of subscription messages only
* graft/prune work with mesh, get filled up from gossipsub
* fix race conditions with await
* fix exception unsafety when grafting/pruning
* fix allowing up to DHi peers in mesh on incoming graft
* fix metrics in several places
2020-07-09 11:16:46 -06:00
4e12d0d97a
nil check peer before disconnect
2020-07-09 17:20:45 +09:00
f9e0a1f069
CI fix handleDisconnect (pubsub)
2020-07-09 13:56:59 +09:00
9b8b159abb
Remove other spurious getStacktrace in pubsub traces
2020-07-09 13:19:34 +09:00
4bcb567d47
fix gossip tests
2020-07-09 12:34:36 +09:00
4698f41a91
Remove stacktrace logging from pubsub connect
2020-07-09 12:23:03 +09:00
fec507e755
Add peers back to gossipsub table, slow down heartbeat ( #256 )
...
* Add peers back to gossipsub table, slow down heartbeat
* exclude on unsub from mesh and fanout
2020-07-08 11:06:26 -06:00
f2e7035a17
fix gossip 11 upstream
2020-07-08 19:22:02 +09:00
853250918c
wip
2020-07-08 15:45:11 +09:00
be98a478b4
Fix merge oops
2020-07-08 12:58:39 +09:00
a7d90214ea
Merge branch 'gossip-one-one' of github.com:status-im/nim-libp2p into gossip-one-one
2020-07-08 11:52:54 +09:00
0fbc0ec4b2
fix multistream 1.1 multi proto
2020-07-08 11:52:44 +09:00
38422ff4cb
Merge branch 'master' into gossip-one-one
2020-07-08 11:39:33 +09:00
a52763cc6d
fix publishing ( #250 )
...
* use var semantics to optimize table access
* wip... lvalues don't work properly sadly...
* big publish refactor, replenish and balance
* fix internal tests
* use g.peers for fanout (todo: don't include flood peers)
* exclude non gossip from fanout
* internal test fixes
* fix flood tests
* fix test's trypublish
* test interop fixes
* make sure to not remove peers from gossip table
* restore old replenishFanout
* cleanups
* Cleanup resources (#246 )
* consolidate reading in lpstream
* remove debug echo
* tune log level
* add channel cleanup and cancelation handling
* cancelation handling
* cancelation handling
* cancelation handling
* cancelation handling
* cleanup and cancelation handling
* cancelation handling
* cancelation
* tests
* rename isConnected to connected
* remove testing trace
* comment out debug stacktraces
* explicit raises
* restore trace vs debug in gossip
* improve fanout replenish behavior further
* cleanup stale peers more eaguerly
* synchronize connection cleanup and small refactor
* close client first and call parent second
* disconnect failed peers on publish
* check for publish result
* fix tests
* fix tests
* always call close
Co-authored-by: Giovanni Petrantoni <giovanni@fragcolor.xyz>
2020-07-07 18:33:05 -06:00
57e6a95b9c
Merge branch 'publish-backporting' into gossip-one-one
2020-07-07 21:54:07 +09:00
73cefce798
remove assertion in publish
2020-07-07 19:42:36 +09:00
69a92aebe6
merge 1.0
2020-07-04 20:53:40 +09:00
2f39cf6f42
Merge branch 'publish-backporting' into gossip-one-one
2020-07-04 19:37:31 +09:00
479c83c1df
with sugar
2020-07-04 19:36:15 +09:00
5e0870d4a4
minor fixes
2020-07-04 14:22:58 +09:00
aed8dcadaf
actually lock the heartbeat
2020-07-04 14:09:42 +09:00
ad7db1ca26
add more heartbeat locking to prevent races
2020-07-04 14:04:44 +09:00
466f3c9171
add back topics in peers, re-enable flood publish
2020-07-04 12:15:35 +09:00
be0375f840
fix up merge
2020-07-04 11:51:09 +09:00
afb5cb88f9
Merge remote-tracking branch 'origin/publish-backporting' into gossip-one-one
2020-07-04 11:42:16 +09:00
8d0709ce5d
merge new pubsubpeer, copy 1.1 to new module
2020-07-04 11:29:37 +09:00
0d0309a601
better diagnostics
2020-07-03 09:28:20 +09:00
27d22d534d
simplify rebalanceMesh (following spec) and make it finally reach D_high
2020-07-02 23:07:17 +09:00
5e4934bcce
Merge branch 'master' into publish-backporting
2020-07-02 17:44:23 +09:00
4f5c97e27c
remove topics from pubsubpeer (was unused)
2020-07-01 17:44:26 +09:00
d9e0ca6091
getGossipPeers fixes
2020-07-01 17:26:42 +09:00
a976c22dae
triage publish nil peers (issue is on master too but just hidden behind a if/in)
2020-07-01 16:54:28 +09:00
ec00c7fc50
Peer resultification and defect only ( #245 )
...
* Peer resultification and defect only
* Fixing some tests
* test fixes
* Rename peer into peerid
* better result error message in identify
* further merge fixes
2020-07-01 08:25:09 +02:00
f49e59cb4e
improve fanout replenish behavior further
2020-06-30 11:36:47 +09:00
509d84f03d
restore trace vs debug in gossip
2020-06-30 11:28:45 +09:00
9d33390239
restore utility module import
2020-06-30 00:17:58 +09:00
c788a6a3c0
Cleanup resources ( #246 )
...
* consolidate reading in lpstream
* remove debug echo
* tune log level
* add channel cleanup and cancelation handling
* cancelation handling
* cancelation handling
* cancelation handling
* cancelation handling
* cleanup and cancelation handling
* cancelation handling
* cancelation
* tests
* rename isConnected to connected
* remove testing trace
* comment out debug stacktraces
* explicit raises
2020-06-29 09:15:31 -06:00
680dcfd9cb
cleanups
2020-06-30 00:10:11 +09:00
3a657135dc
Merge branch 'master' into publish-backporting
2020-06-29 22:02:58 +09:00
3dd28adc9f
restore old replenishFanout
2020-06-29 10:46:59 +09:00
2356f6ab68
make sure to not remove peers from gossip table
2020-06-29 10:45:06 +09:00
aa6756dfe0
allow message id provider to be specified ( #243 )
...
* don't send public key in message when not signing (information leak)
* don't run rebalance if there are peers in gossip (see #242 )
* don't crash randomly on bad peer id from remote
2020-06-28 09:56:38 -06:00
b7382eaf25
exclude non gossip from fanout
2020-06-28 10:55:44 +09:00
8e2c9301a0
use g.peers for fanout (todo: don't include flood peers)
2020-06-28 10:53:43 +09:00
ccb323ad0f
big publish refactor, replenish and balance
2020-06-27 20:24:29 +09:00
dc3c568dc0
wip... lvalues don't work properly sadly...
2020-06-27 14:59:48 +09:00
1a2f336eb5
use var semantics to optimize table access
2020-06-27 13:35:07 +09:00
ab8d7cc968
make sure to waitsub in sparse test
2020-06-26 16:24:56 +09:00
03801fcc52
small fixes, publish still half broken
2020-06-26 16:06:08 +09:00
Giovanni Petrantoni
Dmitriy Ryajov
Giovanni Petrantoni
Jacek Sieka
Eugene Kabanov
Ștefan Talpalaru