7a369dd1bf
GossipSub: Limit flood publishing ( #911 )
...
Co-authored-by: Diego <diego@status.im>
2023-07-31 11:13:51 +02:00
b784167805
GossipSub: IDontWant ( #934 )
2023-07-28 10:58:05 +02:00
440461b24b
GS: improve handleIHave ( #922 )
2023-07-11 12:17:50 +02:00
c45f9705ab
Gossipsub scoring improvements ( #909 )
2023-07-04 00:27:45 +02:00
66f9dc9167
Remove all `Result.get()`s & `Option` -> `Opt` ( #902 )
...
Co-authored-by: Ludovic Chenut <ludovic@status.im>
Co-authored-by: Diego <diego@status.im>
2023-06-28 16:44:58 +02:00
1c4d0832ce
Add GossipSub ping ( #912 )
2023-06-21 10:40:10 +02:00
a65b7b028f
GossipSub: remove peer if we can't establish sendConn ( #886 )
2023-06-14 17:23:39 +02:00
67711478ce
Consider dns as public address ( #913 )
2023-06-13 17:58:41 +02:00
3725f6a95b
chore: add basic metrics for rendezvous ( #905 )
2023-06-07 15:45:06 +02:00
3640b4dd89
Autonat and HP changes ( #899 )
2023-06-07 15:26:58 +02:00
c76d1e18ef
Remove nim 1.2 support ( #907 )
2023-06-07 11:12:49 +00:00
6050cdef7e
Refinement of Hole Punching Service ( #892 )
2023-05-25 15:47:00 +02:00
225accd11b
Less warnings ( #813 )
...
Co-authored-by: Diego <diego@status.im>
2023-05-18 10:24:17 +02:00
a1eb53b181
Fix gossipsub dOut handling ( #883 )
2023-04-26 13:44:45 +02:00
a5666789b0
Hole Punching ( #806 )
...
Co-authored-by: Tanguy <tanguy@status.im>
2023-04-18 12:50:21 +02:00
b7726bf68f
Dcutr ( #824 )
...
Co-authored-by: Tanguy <tanguy@status.im>
2023-04-14 16:23:19 +02:00
0041ed4cf8
Transport hole punching ( #873 )
...
Co-authored-by: Tanguy <tanguy@status.im>
2023-04-06 15:23:35 +02:00
4aa615c44c
GossipSub: TimedEntry & shortAgent fixes ( #858 )
2023-04-03 11:05:01 +02:00
6b61ce8c91
GossipSub: Better IWANT handling ( #875 )
2023-04-03 10:56:20 +02:00
af5299f26c
Create an ObservedAddrManager and add an AddressMapper in AutonatService and AutoRelayService ( #871 )
...
Co-authored-by: Tanguy <tanguy@status.im>
2023-03-24 15:42:49 +00:00
bac754e2ad
Various gossipsub fixes ( #827 )
2023-03-21 17:13:25 +01:00
8d5ea43e2b
Upgrade flow refactoring ( #807 )
2023-03-08 12:30:19 +01:00
e573238705
reexport public types ( #872 )
2023-03-06 15:36:10 +00:00
ddeb7b3bd4
Handle when peers ask each other at the same time ( #865 )
2023-02-21 17:49:41 +01:00
444b837923
Autonat doesn't ask an incoming peer ( #857 )
2023-02-09 17:40:04 +01:00
f89bd0c77c
Autonat dials dns addrs ( #856 )
2023-02-09 16:53:46 +01:00
e68186373b
Dialing addrs concurrently in autonat ( #855 )
2023-02-07 18:51:17 +01:00
0e28d3b828
Add the peerId to the transport.dial ( #842 )
2023-01-31 12:46:10 +01:00
ca19f8fdbf
Autonat service: handle connections limits ( #846 )
...
Co-authored-by: diegomrsantos <diego@status.im>
2023-01-24 17:04:42 +01:00
c11772c94e
Happy new year! ( #847 )
2023-01-20 15:47:40 +01:00
166c0d1c87
Fix PubSub subscribe on connection race condition ( #809 )
2023-01-10 13:33:14 +01:00
9f658c151e
Autonat refactoring ( #834 )
2023-01-06 11:14:38 +01:00
676786b00e
Add Autonat timeout ( #829 )
...
Co-authored-by: Ludovic Chenut <ludovic@status.im>
2022-12-22 19:29:31 +00:00
d521c57b82
Handle dial error correctly ( #830 )
2022-12-22 17:33:59 +01:00
67ef25fae0
Autonat service ( #814 )
...
Co-authored-by: Tanguy <tanguy@status.im>
2022-12-16 11:32:00 +00:00
64cbbe1e0a
Limit number of streams per protocol per peer ( #811 )
2022-12-01 12:20:40 +01:00
1711c204ea
Fix: big messages in pubsub ( #808 )
2022-11-24 16:43:45 +00:00
6ab6ab48ef
Fix after gcsafe requirements change and other issues on devel ( #795 )
2022-11-05 02:04:05 +01:00
f95eda8bf6
Add libp2p label to chronicles log topics ( #794 )
2022-11-04 11:19:27 +01:00
c39c1cbf68
Fix daily CI ( #790 )
2022-10-29 23:26:44 +02:00
b4f96721af
Add a tutorial for the discovery manager ( #787 )
...
Co-authored-by: Tanguy <tanguy@status.im>
2022-10-29 10:12:12 +00:00
dc13ff81d3
Revert "Temporarily remove failing test ( #788 )" & fix tests ( #789 )
...
Co-authored-by: Ludovic Chenut <ludovic@status.im>
2022-10-26 11:07:31 +02:00
4b105c6abd
GossipSub tutorial ( #784 )
2022-10-21 17:00:36 +02:00
32233d36c8
Discovery interface ( #783 )
...
Co-authored-by: Tanguy <tanguy@status.im>
2022-10-03 22:00:00 +00:00
1c99aca054
RendezVous Protocol ( #751 )
2022-09-30 10:41:04 +02:00
4f18dd30e9
Handle trying to write empty byte seq ( #780 )
2022-09-29 20:02:10 +02:00
a56c3bc296
Make observedAddr optional ( #772 )
...
Co-authored-by: Tanguy <tanguy@status.im>
2022-09-22 21:55:59 +02:00
5e7e009445
Move relay & autonat to connectivity folder ( #769 )
2022-09-15 09:43:40 +02:00
abbeaab684
Keep connection alive when peer doesn't support pubsub ( #754 )
2022-09-06 13:20:42 +02:00
dfbfbe6eb6
allow connection to a peer with unknown PeerId ( #756 )
...
Co-authored-by: Tanguy <tanguy@status.im>
2022-09-05 14:31:14 +02:00
3ffc03ed16
Gossipsub: Rebalance mesh immediately when peer sub/unsub ( #719 )
2022-09-02 10:24:54 +02:00
2332813873
Autonat protocol ( #739 )
2022-08-23 17:49:07 +02:00
2fbe82bf9d
make it more Nim 1.4+ compatible ( #742 )
2022-08-03 13:33:19 +02:00
34c2fb8787
Circuit relay v2 ( #717 )
2022-08-01 14:31:22 +02:00
1e598a0239
topicIDs -> topicIds; PubsubPeerEvent -> PubSubPeerEvent; messageIDs -> messageIds ( #748 )
2022-07-27 17:14:05 +00:00
4ca1c2d7ed
--styleCheck:error ( #743 )
...
* --styleCheck:error
* PeerID -> PeerId
* other libp2p styleCheck changes
* MessageID -> messageId; topicID -> topicId
2022-07-27 11:47:50 +00:00
533e39ef94
Yamux ( #704 )
...
Co-authored-by: Ludovic Chenut <ludovic@status.im>
2022-07-04 15:19:21 +02:00
d0523fdc9d
Documentation ( #716 )
2022-07-01 20:19:57 +02:00
0ece5eaf12
Start/stop protocols ( #730 )
...
Starting/stopping a switch now starts/stops all protocols mounted on that switch
2022-06-30 11:21:33 +02:00
e6440c43c2
lower log level of no-peers message ( #735 )
...
the number of peers sent to is returned from the function - the caller
can log this, if need be
2022-06-30 09:57:07 +02:00
597abddba7
don't increase seqno when anonymizing ( #734 )
2022-06-30 09:56:49 +02:00
5d7024f2e0
Handle more cancellations ( #733 )
...
* Mplex: handle write cancellation
* LpChannel: Don't close connection on EOF
2022-06-24 11:11:23 +02:00
a7e335e1bb
Remove Br prefix from BearSSL ( #728 )
...
ref status-im/nim-bearssl#27
2022-06-16 10:08:52 +02:00
7323ecc9c4
Optimize rebalanceMesh ( #708 )
2022-05-25 12:59:33 +02:00
60becadcf9
Peer store refacto ( #700 )
...
There is now a global PeerStore structure (instead of having one for libp2p, one for waku, etc)
The user can create custom books for new types easily
Also add a pruning system to remove dead peers
2022-05-25 12:12:57 +02:00
d4ff1c88e9
Less warnings ( #710 )
2022-05-24 15:10:57 +02:00
13503f3799
Circuit relay v1 ( #670 )
...
Circuit relay v1
2022-05-18 10:19:37 +02:00
991549f391
Gossipsub scoring fixes ( #709 )
...
* Use decayInterval as a scoring heartbeat period
* Take mesh delivery window into account
2022-05-11 10:38:43 +02:00
32ca1898d9
Gossipsub: Put Peer Exchange behind a flag ( #715 )
...
Add a flag to enable Peer Exchange in Gossipsub (disabled by default)
2022-05-10 10:39:43 +02:00
9ba5c069c8
Update SPR when the PeerInfo changes ( #711 )
2022-04-13 09:35:28 +02:00
c97befb387
Add tests for gossipsub direct peers ( #707 )
2022-04-12 14:03:31 +00:00
9973b9466d
expose more libp2p performance and queuing metrics ( #678 )
...
* gossipsub: adding duplicate arrival metrics
Adding counters for received deduplicated messages and for
duplicates recognized by the seen cache. Note that duplicates that
are not recognized (arrive after seenTTL) are not counted as
duplicates here either.
* gossipsub: adding mcache (message cache for responding IWANT) stats
It is generally assumed that IWANT messages arrive when mcache still
has the message. These stats are to verify this assumption.
* libp2p: adding internal TX queuing stats
Messages are queued in TX before getting written on the stream,
but we have no statistics about these queues. This patch adds
some queue length and queuing time related statistics.
* adding Grafana libp2p dashboard
Adding Grafana dashboard with newly exposed metrics.
* enable libp2p_mplex_metrics in nimble test
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2022-04-06 16:00:24 +02:00
c7504d2446
Gossipsub peer exchange ( #647 )
...
* Signed envelopes and routing records
* Send signed peer record as part of identify (#649 )
* Add SPR from identify to new peer book (#657 )
* Send & receive gossipsub PX
* Add Signed Payload
Co-authored-by: Hanno Cornelius <68783915+jm-clius@users.noreply.github.com>
2022-03-14 09:39:30 +01:00
44a7260f07
fixes from #688 ( #697 )
...
* tests: invert message logic on expect from #688
* fix: export pubsub_errors for backward compatibility
2022-02-24 17:32:20 +01:00
fd59cbc7a9
Fix shuffle of #638
2022-02-21 17:00:18 +01:00
bc318084f4
GS: Publish to fanout when mesh unhealthy ( #638 )
...
* Send to fanout when mesh unhealthy
* don't use fanout when floodPublish
2022-02-21 16:22:08 +01:00
3b718baa97
feat: allow msgIdProvider to fail ( #688 )
...
* feat: allow msgIdProvider to fail
Closes : #642 .
Changes the return type of the msgIdProvider to `Result[MessageID, string]` so that message id generation can fail.
String error type was chosen as this `msgIdProvider` mainly because the failed message id generation drops the message and logs the error provided. Because `msgIdProvider` can be externally provided by library consumers, an enum didn’t make sense and a object seemed to be overkill. Exceptions could have been used as well, however, in this case, Result ergonomics were warranted and prevented wrapping quite a large block of code in try/except.
The `defaultMsgIdProvider` function previously allowed message id generation to fail silently for use in the tests: when seqno or source peerid were not valid, the message id generated was based on a hash of the message data and topic ids. The silent failing was moved to the `defaultMsgIdProvider` used only in the tests so that it could not fail silently in applications.
Unit tests were added for the `defaultMsgIdProvider`.
* Change MsgIdProvider error type to ValidationResult
2022-02-21 16:04:17 +01:00
00e1f9342f
Fix identify log for json_sink ( #690 )
2022-02-01 18:35:48 +01:00
c18830ad33
Score correctly on mesh peer unsub ( #644 )
...
* Score correctly on mesh peer unsub
* remove from mesh before removing from gossipsub
2022-01-15 12:47:41 +01:00
1a97d0a2f5
Validate pubsub subscriptions ( #627 )
...
* Check topic before subscribing
* Block subscribe to invalid topics
2022-01-14 12:40:30 -06:00
f3dee6865c
Chronos strict exception tracking ( #652 )
...
* Enable chronos strict exception tracking ( -d:chronosStrictException )
2022-01-05 16:27:33 +01:00
fb0d10b6fd
Gossipsub: process messages concurrently ( #680 )
...
* Gossip sub: process messages concurrently
* Retries for flaky test
2021-12-27 11:17:00 +01:00
df566e69db
Fixes for style check ( #676 )
2021-12-16 11:05:20 +01:00
c49932b55a
fast path for writes ( #659 )
...
avoids several copies of the various message buffers being kept alive
for the lifetime of the future
2021-12-14 10:55:17 +01:00
47a35e26d7
Typo: s/unsubcribeBackoff/unsubscribeBackoff ( #675 )
2021-12-14 10:50:57 +01:00
6893bd9dbb
Customizable gossipsub backoff on unsubscribe ( #665 )
...
* Customizable gossipsub backoff on unsubscribe
* change default to 5s
2021-12-02 14:47:40 +00:00
6f779c47c8
Gossipsub: don't send to peers seen during validation ( #648 )
...
* Gossipsub: don't send to peers seen during validation
* Less error prone code
* add metric
* Fix metric
* remove dangling code test
* address comments
* don't allocate memory
2021-11-14 09:08:05 +01:00
5885e03680
Add maxMessageSize option to pubsub ( #634 )
...
* Add maxMessageSize option to pubsub
* Switched default to 1mb
2021-10-25 12:58:38 +02:00
846baf3853
Various cleanups part 1 ( #632 )
...
* raise -> raise exc
* replace stdlib random with bearssl
* object init -> new
* Remove deprecated procs
* getMandatoryField
2021-10-25 10:26:32 +02:00
1b2cdd6aec
Merge branch 'master' into unstable
2021-09-09 13:22:45 +02:00
d02735dc46
Remove peer info ( #610 )
...
Peer Info is now for local peer data only.
For other peers info, use the peer store.
Previous reference to peer info are replaced with the peerid
2021-09-08 11:07:46 +02:00
8cddfde837
Rename getKey -> getPublicKey ( #621 )
...
* rename getKey to getPublicKey
* use publicKey directly in gossipsub
* update error messages
2021-09-02 12:03:40 +02:00
8ea90037e5
Fix gossipsub incoming graft backoff ( #616 )
...
* Fix gossipsub incoming graft backoff
* Improve debug messages
* clamp to 24h
2021-09-01 08:41:11 +02:00
bed00ec43c
Identify Push ( #587 )
...
* start of identifypush
* better pushidentify
* push identify test
* fix: make peerid optional
2021-06-14 11:08:47 -06:00
bd2e9a0462
Fix trackers tests ( #588 )
...
* Fix checkTracker typo
* fix testswich tests
* use tracker consts
2021-06-14 10:26:11 +02:00
9e2b464e14
Cleanup testinterop imports ( #589 )
...
* cleanup exports/imports, specially for testinterop
* export pubsub
2021-06-11 16:34:40 -06:00
93156447ba
Peer Store implement part II ( #586 )
...
* Connect & Peer event handlers now receive a peerinfo
* small peerstore refacto
* implement peerstore in switch
* changed PeerStore to final ref object
* revert libp2p/builders.nim
2021-06-08 18:55:24 +02:00
55a3606ecb
add ping protocol ( #584 )
...
* add ping protocol
* add ping protocol handler
* ping styling
* more ping tests
* switch ping to bearssl rng
* update ping style
* new cancellation test
2021-06-08 18:53:45 +02:00
caac8191d2
Change newXXXX procs to XXXX.new ( #585 )
...
* newBufferStream -> BufferStream.new
* newMultistream -> MultistreamSelect.new
* newSecio -> Secio.new
* newNoise -> Noise.new
* newPlainText -> PlainText.new
* newPubSubPeer -> PubSubPeer.new
* newIdentify -> Identify.new
* newMuxerProvider -> MuxerProvider.new
2021-06-07 09:32:08 +02:00
ce42674d80
avoid memory safety errors with nim 1.4.x
2021-06-02 12:26:01 -06:00
Tanguy
diegomrsantos
Vaclav Pavlin
Jacek Sieka
Ludovic Chenut
Lorenzo Delgado
Miran
tersec
Csaba Kiraly
Eric Mastro
Tanguy
Dmitriy Ryajov