Commit Graph

260 Commits

Author SHA1 Message Date
Anthony Laibe 2ae370ca41 test: Add test/refactor filter option 2021-11-18 13:35:46 +01:00
Richard Ramos c9a9b02e48
test: stop / start discovery (#153) 2021-11-18 08:26:36 -04:00
Richard Ramos 817759c235
feat: discoveryV5 - part2 (#150) 2021-11-17 12:19:42 -04:00
Anthony Laibe 978bedfafa feat: add admin rpc methods 2021-11-17 16:11:02 +01:00
Richard Ramos 6ae4d4fce2
feat: discoveryV5 - part1 (#149) 2021-11-16 10:22:01 -04:00
Anthony Laibe e176975aed test: Add more test for waku node 2021-11-12 14:26:22 +01:00
Richard Ramos 54f647aa4f
test: public_key and resolver (#147) 2021-11-10 21:34:39 -04:00
Richard Ramos 6d04308716
feat: 23/WAKU2-TOPICS (#146) 2021-11-10 10:28:45 -04:00
Anthony Laibe 9f504b1150 test: extend coverage with missing test 2021-11-10 14:55:23 +01:00
Anthony Laibe b81bd6ff30 feat: Add rpc store
Add test for rpc services
2021-11-10 09:22:00 +01:00
Richard Ramos 0c873e3c2d
feat: select peer with lowest ping time and test peer functions (#143)
* feat: select peer with lowest ping time and test peer functions
* fix: do not self-ping
2021-11-09 19:34:04 -04:00
Richard Ramos 9426cd133a
fix: store protocol should have a host regardless if acts as store node or not (#142) 2021-11-09 12:18:57 -04:00
Anthony Laibe 7ff5fcf838 feat: Add relay rpc methods 2021-11-09 13:54:45 +01:00
Richard Ramos 49737780ea refactor: concurrent map and slices for filter 2021-11-08 08:58:14 -04:00
Richard Ramos fcfe3568ab feat: clean up older records in message queue
Fixes #133
2021-11-07 11:16:04 -04:00
Anthony Laibe a1cb371d5a refactor: lightpush options and be more explicit about
the relay node being present or not
2021-11-07 16:15:07 +01:00
Richard Ramos a46881fc27 fix: rebase issues 2021-11-06 12:57:01 -04:00
Richard Ramos 2cbedf47a0 refactor: rename parameter from maxDays to maxDuration 2021-11-06 12:57:01 -04:00
Richard Ramos a7c76d2af1 fix: typo 2021-11-06 12:57:01 -04:00
Richard Ramos 08c5c2303e Use function to calculate duration in days 2021-11-06 12:57:01 -04:00
Richard Ramos 12a1daae74 fix: remove useless parameter 2021-11-06 12:57:01 -04:00
Richard Ramos 6db2f258d8 feat: message retention policy for wakustore
Fixes#69
2021-11-06 12:57:01 -04:00
Richard Ramos 793e7f572f refactor: filter
Moves the filter logic from wakunode2 to waku_filter
2021-11-06 12:45:14 -04:00
Richard Ramos 99248e9931 test: unsubscribe to filter 2021-11-06 12:25:45 -04:00
Richard Ramos c98769b7f2 refactor: use envelopes in the store
Also do some linting and add documentation for some functions
2021-11-06 09:06:53 -04:00
Richard Ramos 0df1a21dba fix: connectedness_test async error 2021-11-05 10:29:40 -04:00
Richard Ramos 2336252efc add size to store message channel 2021-11-05 10:29:40 -04:00
Anthony Laibe 7a34cf6d45 feat: Use correct rpc method name 2021-11-03 13:25:28 +01:00
Anthony Laibe 06a86f45b0 feat: Add first endpoint for rpc server 2021-11-02 15:16:23 +01:00
Richard Ramos 82ec44fcfa fix: lint and failing test 2021-11-02 07:59:10 -04:00
Richard Ramos 6a3a5b08b3 test: replace peer_events example app by a test 2021-11-02 07:59:10 -04:00
Vitaliy Vlasov 268767262b
Iterate through Peerstore in startKeepAlive() (#102) 2021-11-01 13:33:58 -04:00
Anthony Laibe 189724dd1e test: add filter test 2021-11-01 16:38:24 +01:00
Richard Ramos b789d9900e
refactor: relay (#119) 2021-11-01 10:42:55 -04:00
Richard Ramos c0ba800af7
refactor: store and lightpush (#118) 2021-11-01 08:38:03 -04:00
Richard Ramos 98255060f3
refactor: add Next() and create Query and Result structs (#117) 2021-10-31 15:00:38 -04:00
Richard Ramos d150123f21
fix: store and lightpush metrics (#114) 2021-10-30 19:19:03 -04:00
Richard Ramos d94802f739
chose node type when starting filter and make relay optional (#113) 2021-10-30 10:29:34 -04:00
Richard Ramos f2be4a8e7a
test: keep alive (#110) 2021-10-29 11:24:31 -04:00
Richard Ramos b7a7143803
select random peer instead of just the first (#109) 2021-10-28 15:26:25 -04:00
Richard Ramos 8ba64affba
test: resume and time based queries (#108) 2021-10-28 09:03:23 -04:00
Anthony Laibe 9030907960
test: add test for lightpush (#106)
* test: add test for lightpush


Co-authored-by: Richard Ramos <info@richardramos.me>
2021-10-28 14:41:17 +02:00
Richard Ramos 8253e381df
test: store 2021-10-25 15:41:08 -04:00
Anthony Laibe ce49f29c08 test: add test for relay protocol 2021-10-25 21:24:42 +02:00
Anthony Laibe 3bf00b2f37 test: add test for generating requestid 2021-10-25 20:27:01 +02:00
Anthony Laibe 10378a5827 test: Add persistence module test 2021-10-22 09:41:26 +02:00
Richard Ramos 041a5dae67
test: payload encryption (#97) 2021-10-21 11:56:18 -04:00
Richard Ramos 59e4a11b55
test: payload encoding / decoding (#96) 2021-10-21 08:18:14 -04:00
Anthony Laibe 9ad06b6eb8 test: Add time test 2021-10-20 21:51:26 +02:00
Richard Ramos b1284d367d
test: utils (#95) 2021-10-20 14:43:59 -04:00
Richard Ramos 68fe29c56f
test: broadcast (#94) 2021-10-20 14:43:51 -04:00
Anthony Laibe 6f8e86b667 test: add persistence sqlite test 2021-10-20 17:34:03 +02:00
Anthony Laibe 990bbc50dc test: Add metrics unit test 2021-10-20 15:50:53 +02:00
Richard Ramos eadd018ce5
fix: multiaddress format was incorrect when using ws (#90) 2021-10-18 08:38:01 -04:00
Richard Ramos e482075fa9
refactor: peer selection and filter API (#87) 2021-10-18 08:25:55 -04:00
Richard Ramos 5f3df9343c fix: goroutine leak on ping 2021-10-18 07:55:42 -04:00
Anthony Laibe 5744879242 refactor: add leveldb rendezvous persistence 2021-10-18 09:16:57 +02:00
Richard Ramos 654bebdb93
fix: peer metrics 2021-10-16 18:02:48 -04:00
Richard Ramos b661a4b9bc
fix: missing identity 2021-10-15 15:51:24 -04:00
Richard Ramos a956684f48
fix: use same privKey when displaying addresses 2021-10-15 08:39:51 -04:00
Jakub 1c991a94d8
metrics: add /health endpoint for healthchecks (#84)
Because calling `/metrics` for a Consul healhcheck is too heavy
and far too verbose.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-15 12:47:40 +02:00
Richard Ramos c86db00285
feat: add --advertise-address flag 2021-10-14 22:15:02 -04:00
Richard Ramos 8c590851e3
fix: add --show-addresses and allow setting the listening address 2021-10-14 14:36:25 -04:00
Anthony Laibe 54a93a60c5
feat: add ability to regenerate proto files (#76) 2021-10-14 11:03:25 +02:00
Anthony Laibe 2df2289972
feat: Add log level options (#75) 2021-10-13 16:18:10 +02:00
Anthony Laibe 86cf5304b2
fix linter (#73) 2021-10-13 14:48:29 +02:00
Richard Ramos c1bdead94d
revert: utils.GetUnixEpoch() 2021-10-12 09:45:22 -04:00
Richard Ramos dc52ba182a refactor: filter
- Create a channel when a subscription is created
- Add stop function for protocols
2021-10-11 19:02:25 -04:00
Richard Ramos 578b40a44e refactor: extract function to subscribe to topic 2021-10-10 18:53:25 -04:00
Richard Ramos 13aee0b1e0 refactor: change filter function parameters to not use protobuffers 2021-10-10 18:53:25 -04:00
Richard Ramos 8a28978f83
fix: wait until peer is connected to resume history 2021-10-10 11:46:31 -04:00
Richard Ramos 8f87009466
fix: docs 2021-10-10 11:46:23 -04:00
Richard Ramos 4a7779dda1 refactor: remove go-wakurelay-pubsub and update dependencies 2021-10-08 10:46:46 -04:00
Richard Ramos dbd7a1c2d7 WIP: replace go-wakurelay-pubsub by go-libp2p-pubsub 2021-10-08 10:46:46 -04:00
Richard Ramos 761ae88bbd
fix: remove channel for disconnections
Since a subscriber might not be connected always it makes no sense to automatically unsubscribe on disconnet
2021-10-06 15:25:41 -04:00
Richard Ramos 70e301f348
fix: flag names 2021-10-06 14:43:41 -04:00
Richard Ramos 245c01b286 fix: check err on wakunode start 2021-10-06 14:07:46 -04:00
Richard Ramos 1991a54d64 refactor: connectedness
Uses libp2p network notifier to determine when a peer connects or disconnects, as well as using the host network peerstore instead of managing out own separate peer map
2021-10-06 14:07:46 -04:00
Richard Ramos 79e21dbb99 refactor: add peers before starting 2021-10-04 22:16:24 -04:00
Richard Ramos de0b63f4a2 feat: options to generate/specify/load node privatekey 2021-10-04 22:14:38 -04:00
Richard Ramos f82732cd19 refactor: reorganize wakunode flags in groups 2021-10-04 18:39:03 -04:00
Richard Ramos a58db1656d refactor: rendezvous nodes are added to peer store
- No need to specify peerIDs in command line flag
- Rendezvous nodes are selected automatically instead of passing them via waku option
2021-10-01 14:45:25 -04:00
Richard Ramos 034656b2c0 refactor: rename protocol variables 2021-10-01 14:45:25 -04:00
Richard Ramos 954f2a0c56
feat: use leveldb for storing peers and clean up periodically older records from rendezvous server (#56) 2021-10-01 14:37:52 -04:00
Richard Ramos 70efcd72f3
feat: rendezvous (#54) 2021-10-01 13:49:50 -04:00
Richard Ramos 5c9a29524d
feat: add gossipsub peer exchange option to waku node (#53) 2021-10-01 13:43:03 -04:00
Richard Ramos 37a01edce4
fix: add context parameter to peer dial (#59) 2021-10-01 06:32:15 -04:00
Richard Ramos c8a83f04de
feat: add dns-discovery flags to wakunode and chat2 example (#52) 2021-09-30 19:03:19 -04:00
Richard Ramos 9416077adf
fix: use multiaddres instead of strings 2021-09-27 14:16:06 -04:00
Andrea Maria Piana cfcfb52a58
[Fixes: #39] Add DNS discovery (#48)
This commit adds a public method that takes a url and returns a list of
multiaddr.

Once we better understand how to integrate it we can make it so that is
passed as a config when initializing waku, this commit only provides the
basic functionality.
2021-09-27 13:52:56 -04:00
RichΛrd 6c4a74fb9c
fix: check for messages first on filter in case a non null request is being sent (#50)
* fix: check for messages first on filter in case a non null request is being sent
* fix: clean up logs
* fix: peer lock
2021-09-27 08:47:18 -04:00
Vitaliy Vlasov 67ac969a65 Use peerstore instead of network 2021-09-23 17:38:08 +03:00
Vitaliy Vlasov a3c7102a34 Fix keepAlive 2021-09-23 17:38:08 +03:00
Richard Ramos 1cf3de3a3f fix: return 2021-09-23 17:38:08 +03:00
Richard Ramos 4ce04014d1 fix: make resume optional and trigger connect/disconnect when dialing a peer or dropping it 2021-09-23 17:38:08 +03:00
Richard Ramos cf32e10236 expose function to retrieve list of peers and supported protocols 2021-09-23 17:38:08 +03:00
Richard Ramos 4450e6bba0 adds DialbyPeerID 2021-09-23 17:38:08 +03:00
Richard Ramos 11bf973daf chore: change log level to reduce noise 2021-09-23 17:38:08 +03:00
RichΛrd 52b46d6869 emit ConnStatus always to get an update when peers change connectivity (#46)
* emit ConnStatus event always to get an update when peers change
connectivity
* use peers map to determine peer count
2021-09-23 17:38:08 +03:00
RichΛrd 53b3d19948 add peers to ConnStatus (#45)
* add peers to ConnStatus
* return connected peers and supported protocols
2021-09-23 17:38:08 +03:00
Vitaliy Vlasov 24c7a8e4c6 Use keepAlive for Connectedness events 2021-09-23 17:38:08 +03:00
Richard Ramos 51f220a130
refactor: code duplication 2021-08-31 14:19:49 -04:00
Andrea Maria Piana b387da9ab4
Add tests and lint code 2021-08-13 13:56:09 +02:00
Richard Ramos c9d3334f2d
fix: matcher function 2021-07-29 12:35:08 -04:00
Richard Ramos fd49e33a45
fix: timestamp format and bump go-wakurelay-pubsub 2021-07-29 11:03:30 -04:00
RichΛrd 654f3f8cd4
fix: order of fields of History Response protobuf (#35) 2021-07-29 08:43:29 -04:00
RichΛrd c3ac5ef9c5
feat: Add support for multiple protocol IDs (#34) 2021-07-29 08:41:37 -04:00
RichΛrd 748e738d9a
adding lint target and fixing lint issues (#38) 2021-07-29 08:40:54 -04:00
Richard Ramos 73bedde63c
fix: invalid parameter 2021-07-21 14:02:31 -04:00
Richard Ramos a2ff7f3df9
Use sender timestamp for retrieving messages from store 2021-07-11 14:11:38 -04:00
Vitaliy Vlasov 690841d042 Add peer connectivity notifications 2021-06-29 16:35:01 +03:00
RichΛrd 367459f4d7
filter and lightpush showcase (#28) 2021-06-28 10:14:28 -04:00
RichΛrd 48d5a6996b
feat: configure metrics using opencensus (#32)
* feat: configure metrics using opencensus
* add runtime metrics
2021-06-28 09:20:23 -04:00
RichΛrd c44e50677c
feat: use ping protocol to keep conn to peers alive (#27) 2021-06-24 09:02:53 -04:00
Vitaliy Vlasov 0c3f109d9e Add UnsubscribeFilter 2021-06-16 11:39:15 +03:00
RichΛrd ceacac10c3
feat: resume message history (#24) 2021-06-10 09:00:06 -04:00
Vitaliy Vlasov b9f3f562eb
waku2-filter (#23)
* waku2-filter
2021-06-10 08:59:51 -04:00
Richard Ramos 9138d58152
Add option to enable lightpush protocol 2021-04-28 16:23:03 -04:00
Richard Ramos 3d8aae5b81
Lightpush protocol
- Partially implements #20. Requires some tests
- Extracts wakurelay code to separate file
- Extracts request id gen to separate file
- Initial implementation of lightpush protocol
- Adds utils functions to obtain a message hash
- Publish receives a context to send a message
2021-04-28 16:10:44 -04:00
Richard Ramos aee86211d1
Enabling pubsub topic filter in history queries
Fixes #19
2021-04-28 11:11:32 -04:00
Richard Ramos 4a4d0c97ec
docs. pt-2 2021-04-22 16:42:44 -04:00
Richard Ramos 51e0fecb76
docs. pt-1 2021-04-22 14:49:52 -04:00
Richard Ramos f978071043
add websocket support 2021-04-22 09:07:22 -04:00
Richard Ramos 997bc4f2d8
refactor: organize code 2021-04-21 20:09:37 -04:00
Richard Ramos 287a54aca7
add history content filter 2021-04-20 17:46:35 -04:00
Richard Ramos ef67ff356f
support memory only waku store 2021-04-18 20:03:16 -04:00
Richard Ramos 57e36021bb
Use options pattern for starting a waku node 2021-04-18 19:41:42 -04:00
Richard Ramos 183b8f52c1
subscribe to multiple topics 2021-04-15 17:23:07 -04:00
Richard Ramos 7ba8c51bca
use peer.ID instead of string 2021-04-15 13:55:40 -04:00
Richard Ramos ed9ea40668
use broadcaster for subscriptions and minor code reorg 2021-04-14 22:19:31 -04:00
Richard Ramos e1f10d2099
Add options and start/end time to waku_store 2021-04-14 22:17:53 -04:00
Richard Ramos 547be3c951
extract subscription to separate file 2021-04-14 22:17:12 -04:00
Richard Ramos 11b588a46f
Reorg file paths, and initialize peer store 2021-04-13 14:54:06 -04:00
Richard Ramos 1b746cdec8
Persistent peer store 2021-04-13 14:52:57 -04:00
Richard Ramos ad9abe601c
fix: numeric identifiers and index out of bounds issue on store 2021-04-12 13:59:09 -04:00
Richard Ramos f9e7589ffd
generate hashes of messages 2021-04-11 19:43:59 -04:00
Richard Ramos ff8d4ef8a4
change ContentTopic from uint32 to string 2021-04-08 18:07:31 -04:00
Richard Ramos a84b81b400
fix: error handling and proof numeric id 2021-04-08 14:49:03 -04:00
Richard Ramos 9c224c1849
fix: nim-waku interop for store 2021-04-07 17:16:29 -04:00
Richard Ramos f83423facd
update chat2 to use waku_payload encoding/decoding 2021-04-06 19:27:54 -04:00
Richard Ramos e8f7a4d38c
revert: making waku message fields optional 2021-04-06 19:17:52 -04:00
Richard Ramos be168ebe3f
fix: indirect access to content topic 2021-04-06 19:13:17 -04:00
Richard Ramos 0a0542324c
update waku_store protobuffer definition 2021-04-06 19:11:53 -04:00
Richard Ramos 100a26f49c
wakuv1 envelope format 2021-04-06 19:08:16 -04:00
Richard Ramos 65fc98f450
Update waku_message protobuffer definition 2021-04-06 19:07:20 -04:00
Richard Ramos 38b9ec5448
basic2 example 2021-04-04 15:33:21 -04:00
Richard Ramos 3294103e06
fix: index out of bounds when querying stored messages 2021-04-04 14:42:08 -04:00
Richard Ramos 56346c6b1a
fix: mark subscriptions as closed 2021-04-04 13:08:45 -04:00
Richard Ramos c44b40319e
create envelope struct with hash and size of message 2021-04-04 13:08:34 -04:00
Richard Ramos bc32532401
close peer connection and get num of connected peers 2021-04-04 13:08:29 -04:00