e65760ca85
Add basic peersyncing
...
This commit adds basic syncing capabilities with peers if they are both
online.
It updates the work done on MVDS, but I decided to create the code in
status-go instead, since it's very tight to the application (similarly
the code that was the inspiration for mvds, bramble, is all tight
together at the database level).
I reused parts of the protobufs.
The flow is:
1) An OFFER message is sent periodically with a bunch of message-ids and
group-ids.
2) Anyone can REQUEST some of those messages if not present in their
database.
3) The peer will then send over those messages.
It's disabled by default, but I am planning to add a way to set up the
flags.
2024-01-23 12:46:17 +00:00
926f6a3c72
Revert "test: bump go-libp2p"
...
This reverts commit d0ca4447c6
2024-01-18 20:29:33 +00:00
d0ca4447c6
test: bump go-libp2p
2024-01-18 14:28:06 +00:00
a5acffc001
fix: TestFetchRealCommunity with shards fleet ( #4553 )
...
* fix: TestFetchRealCommunity with shards fleet
* fix: DefaultShardPubsubTopic
* chore: print waku query request id
2024-01-16 13:38:41 +03:00
0c474bb42c
feat: use automatic peer selection for filter. ( #4531 )
...
* feat: use automatic peer selection for filter.
* fix: remove sucess peers too.
* chore: remove filter manager state of peer candidates
2024-01-12 15:09:35 +08:00
1ac99c2dcb
chore: bump go-waku ( #4505 )
2024-01-05 16:43:05 -04:00
195982c950
fix_(StoreNodeRequestManager): various fixes and improvements ( #4509 )
2023-12-27 13:53:19 +00:00
b6f2aced08
chore: add dns discovery URL to the list of default nodes and add extra logging for store queries ( #4490 )
...
* chore: add dns discovery url to list of default discv5 nodes
* chore: add logs for store queries
2023-12-20 10:04:00 -04:00
92f0479a0c
chore: fetch contact with `StoreNodeRequestManager` ( #4484 )
2023-12-20 12:49:12 +00:00
e5ce11f067
fix: panic in broadcast when logout ( #4475 )
2023-12-19 11:42:50 -04:00
e3ef8c649a
chore: store node requests manager ( #4446 )
2023-12-15 19:50:12 +00:00
93aeefcb89
refactor(waku2): publish messages on a goroutine ( #4466 )
2023-12-15 08:02:04 -04:00
9be202be50
chore: fix peer exchange and unit testing ( #4381 )
...
* chore: peer exchange local test
* chore: use local enr resolver
* remove light client close peer.
* fix: peer exchange not start when enabled
* chore: remove ws config
* uncomment light client
* use resolver option
* chore: use option param for dns resolver
* chore: fix vendor changes.
* chore: lint
2023-12-07 08:28:08 +08:00
e28eca1c54
Bump waku version ( #4407 )
...
* chore: make vendor
* chore: fix data types
* Update wakuv2/common/message.go
Co-authored-by: richΛrd <info@richardramos.me>
* Update wakuv2/common/message.go
Co-authored-by: richΛrd <info@richardramos.me>
* Update wakuv2/persistence/dbstore.go
Co-authored-by: richΛrd <info@richardramos.me>
* chore: use safe method to get timestamp.
* chore: use proto.Uint64 to convert reference
* chore: manual fix lint issue when import dependency
---------
Co-authored-by: richΛrd <info@richardramos.me>
2023-12-05 12:29:27 +08:00
384543d3a6
Re-send messages with ResendAutomatically=true
2023-11-30 10:46:38 +02:00
e32c5546e1
test: request community from storenode ( #4364 )
...
* feat: request community info from storenode test
* shutdownWaitGroup
* fix requestCommunityInfoFromMailserver timestamp roundin
2023-11-25 23:24:20 +00:00
e9c9bbb7b1
Adding store wakuv2 test ( #4340 )
...
* chore: wip tests
* chore: wakuv2 store test
* chore: cleanup
* chore: cleanup
* chore: avoid using sleep in test
* cleanup
2023-11-24 10:13:26 +00:00
f622265679
chore: fix linter error
2023-11-23 11:16:50 -04:00
9510ad0f5d
fix: specify clusterid as 16 when using sharding fleet so that metadata proto negotiation doesn't fail
2023-11-23 11:16:50 -04:00
40c9ba82a5
fix(wakuv2): store query pubsubTopic
2023-11-22 14:02:50 -04:00
1794b93c16
Always set PubsubTopic in filters
2023-11-18 02:26:34 +02:00
d2578bf0cb
fix: reset context on stop
2023-11-17 13:37:41 -04:00
573a97791e
fix: start idService and add wg.Done to fnApply
2023-11-17 13:37:41 -04:00
89385cfcaf
fix(waku2): use a cancelable context for initial bootnode discovery
2023-11-17 13:37:41 -04:00
f1d31d6339
add message hash to login ( #4315 )
2023-11-15 16:33:23 +02:00
de12ca885c
fix(wakuv2): don't wait for connections to login ( #4293 )
...
- Identify will not block logout
- Use `peer.AddrInfo` instead of multiaddresses
- Modifies some logs to reduce noise
2023-11-10 11:31:59 -04:00
2c954d42cf
feat: replace DefaultPubsubTopic by Shard 32 ( #4161 )
2023-11-09 20:29:15 -04:00
02e4cc6e1f
feat: Send envelopes to telemetry service
...
Issue #12430
2023-11-08 11:34:10 +01:00
9f69c32593
fix(wakuv2): post envelopes previously cached but not processed ( #4246 )
2023-11-02 14:16:59 +00:00
d3558d8e09
Disable waku test
2023-11-01 19:27:53 +00:00
a89a386c82
Increase timeout on waku tests
2023-11-01 15:47:41 +00:00
2a5d3e5490
fix: mitigate flakiness of TestBasicWakuV2
...
fixes : #4105
2023-10-20 20:41:23 +02:00
abac55c778
fix waku2 FilterManager.pingPeers() range variable issue; modify logs
2023-10-17 17:24:33 +03:00
ba5ed725ce
waku2: static shards ( #3944 )
...
- use protected topics for communities
- associate chats to pubsub topics and populate these depending if the chat belongs to a community or not
- mailserver functions should be aware of pubsub topics
- generate private key for pubsub topic protection when creating a community
- add shard cluster and index to communities
- setup shards for existing communities
- distribute pubsubtopic password
- fix: do not send the requests to join and cancel in the protected topic
- fix: undefined shard values for backward compatibility
- refactor: use shard message in protobuffers
2023-10-12 15:21:49 -04:00
9034f0a984
Update waku nodes
2023-10-05 18:20:44 +01:00
356b2f5ca3
Refactor filter health checks; add debugging logs
2023-10-04 00:39:33 +03:00
7d03ae8272
feat: enable filter full node via node config
2023-09-28 21:31:20 -04:00
6f4f57b7a8
Handle nil error on request to join
2023-08-29 13:04:00 +01:00
b3a93fff12
chore: bumped go-waku to recent commit which contains changes for improved peer management
2023-08-29 13:02:19 +01:00
d62a5736a5
fix: return default pubsub topic, and add more logs
2023-08-25 13:34:34 -04:00
d900974519
fix: code review
2023-08-23 13:56:00 -04:00
f9ec588c4e
feat: use protected topics for communities
...
refactor: associate chats to pubsub topics and populate these depending if the chat belongs to a community or not
refactor: add pubsub topic to mailserver batches
chore: ensure default relay messages continue working as they should
refactor: mailserver functions should be aware of pubsub topics
fix: use []byte for communityIDs
2023-08-23 13:56:00 -04:00
b9b86712e7
refactor: use context instead of quit channel in wakuv2/waku.go
2023-08-15 10:15:45 -04:00
df2a5d8e21
Update go waku & Shorten shutdown
2023-07-17 14:44:32 +01:00
c3ae0e98fe
Enable lightclient
2023-07-07 14:49:40 +01:00
e08aad7d73
Send account/settings on login
2023-07-06 17:35:32 +01:00
28229faec0
chore: bump libp2p related dependencies
2023-06-30 14:23:08 -04:00
4a50e17d57
chore(waku2): revert disable light client on status.prod ( #3606 )
2023-06-15 19:44:29 +03:00
860abca690
Perform initial filter subscribe asynchronously ( #3608 )
...
Also properly unsubscribe from filter
2023-06-15 17:42:54 +03:00
4006cb78b3
Update to FilterV2 ( #3392 )
...
* Update to FilterV2
* Use a separate goroutine for each filter subscription
* Add multiple filter sub test
* Fix test (add Stop() call)
2023-06-07 12:02:19 +03:00
3e4fe1e12f
refactor: move circuit relay code to go-waku
2023-05-30 10:49:52 -04:00
32ac1c8d8e
fix: peer exchange service is not required for clients
2023-05-17 18:23:27 +01:00
efb1036429
update go-waku v0.6.0
2023-05-17 18:23:27 +01:00
acad6e4958
chore: bump go-waku
2023-05-09 17:26:29 -04:00
a596bcb11d
fix: open/close of channels
2023-04-19 09:11:28 -04:00
63d9a9b3d5
fix: start go-waku on Start() instead of New()
2023-04-19 09:11:28 -04:00
7c2b5a39b3
Use correct timesource in waku-2
2023-03-31 13:43:19 +01:00
a6d33b9912
chore: bump go-waku to fix mem leak
2023-03-27 10:56:23 -04:00
cbb016ac00
feat: update go-waku to introduce meta field and deterministic hashing
2023-03-13 21:03:34 -04:00
4fd4bea837
fix: use debug level for content topic extraction error
2023-02-24 14:30:34 -04:00
2f49117061
fix: only use discv5 functions if enabled
2023-02-24 14:30:34 -04:00
e8c1421997
use random tcp port for wakuv2
2023-02-24 07:33:10 +08:00
0babdad17b
chore: upgrade go-waku to v0.5 ( #3213 )
...
* chore: upgrade go-waku to v0.5
* chore: add println and logs to check what's being stored in the enr, and preemptively delete the multiaddr field (#3219 )
* feat: add wakuv2 test (#3218 )
2023-02-22 17:58:17 -04:00
e998270856
fix: use uuid instead of peerID for reporting bandwidth ( #3200 )
2023-02-17 09:15:28 -04:00
dea21f440a
Linting and some fixes on contact requests handling
2023-02-08 17:48:09 +00:00
7d72281815
check for nil envelopes
2023-02-08 17:48:09 +00:00
dc4c1a61b1
fix: reset bandwidth stats totals every day, and send message size
2023-02-01 16:43:57 -04:00
ab2ff4eeb1
feat: protocol stats
2023-02-01 16:43:57 -04:00
cccea5f14b
chore(waku2): bump go-waku to notice disconnection from peers faster
2023-01-27 14:17:43 -04:00
3553761cb5
fix: use parent ctx (of 30s instead of 20s) and log requestID in case of failures
2023-01-26 14:13:01 -04:00
ecbd3a70e9
fix: no messages from storenode
2023-01-19 10:11:44 +01:00
657933ec3d
some logs
2023-01-18 11:43:07 -04:00
7de1753549
waku2 - restart discv5 when peers are low and use newer go-waku code to deal with discovery
2023-01-18 11:43:07 -04:00
5a4ca88631
use random udp port rather than fixed value 9000 ( #3093 )
2023-01-17 12:03:19 +08:00
ebacdfc760
fix: decode peerID string into peer.ID
2023-01-16 22:49:52 -04:00
ed9ca8392c
Upgrade linter to 1.50.0
2023-01-13 17:52:03 +00:00
490570c0ec
fix: convert TopicType to stack variable and use recvMessage.Topic instead of extracting content topic from WakuMessage
2023-01-11 13:41:29 -04:00
09723e3b9a
fix: set nameserver via config
2023-01-11 08:37:31 -04:00
0527009f6c
chore: update gowaku
2023-01-10 09:02:37 -04:00
9e80f22de6
fix: temporarily setting RateLimitProof to nil so it matches the WakuMessage protobuffer we are sending
...
See https://github.com/vacp2p/rfc/issues/563
2023-01-10 08:04:46 -04:00
76dce0c8a6
chore: improve the filters did not match log
2023-01-05 13:30:46 -05:00
8593866862
Restart discovery when it fails
...
When discovery fails to be seeded with bootstrap/fallback nodes, it
never recovers.
This commit changes the behavior so that status-go retries fetching
bootnodes, and restarts discovery when that happens.
2022-12-14 20:54:48 +00:00
f98e65258a
Set dns resolver to cloudflare
2022-12-14 20:54:48 +00:00
38a4bbf235
chore: bump go-waku
2022-12-14 20:54:48 +00:00
c7ce9adb5e
debug: add more logs to determine why community requests are missing
2022-12-13 10:25:24 -04:00
f25ac111db
chore: remove unneeded success signal
2022-12-07 12:15:23 -04:00
d63d2ca754
Use NTP sync source when available
2022-12-07 07:49:14 +00:00
195c149f47
feat(waku2): peer exchange
2022-12-06 10:23:05 -04:00
23d45d8707
chore(waku2): disable light client on status.prod
2022-11-29 15:45:32 -04:00
2166786b0e
Setup autorelay
2022-11-29 15:55:20 +00:00
ea89a41d96
fix: go-waku update discv5 ENR on succesful NAT
2022-11-28 08:41:23 -04:00
eaced1c1e9
fix(store): generate signals per storenode request with custom requestIDs
2022-11-28 08:40:58 -04:00
ee6bda5bcc
feat: add wakuext_listenAddresses
2022-11-28 08:10:51 -04:00
a6c7067f3b
feat: add multiaddresses to waku2 peers
2022-11-24 11:47:06 -04:00
e83ad01e66
fix: disable gossipsub peer exchange
2022-11-24 11:21:24 -04:00
2341dedfba
fix: exit relay loop on quit
2022-11-15 11:00:36 -04:00
d996fb60d4
feat: use identify protocol
2022-11-15 11:00:36 -04:00
91aac3cec0
chore: upgrade go-waku
2022-11-09 17:39:17 +03:00
6300751e36
chore: upgrade go-waku and log about messages sent/received
2022-11-09 17:39:17 +03:00
0f7c9f52d8
feat: mark automatic status updates as ephemeral
2022-11-09 15:49:26 +03:00
4bf5fcfe61
fix: pass status-go logger to go-waku
2022-11-07 18:03:58 +03:00
cd34538937
fix: set waku version to mailservers and set min peers for relay to 1
2022-11-07 18:03:52 +03:00
b14de2dd9d
fix: content topic in wakuv2
2022-10-10 10:38:42 -05:00
571ab4c88d
fix: use minPeers when initializing relay
2022-10-04 14:31:42 -04:00
7272bf0d91
fix: waku2 storenode cursor
2022-10-03 18:49:41 -04:00
824bb17ba9
fix: determine if a enr contains a UDP port ( #2864 )
2022-09-16 09:09:13 -04:00
208f075b72
feat: use dns discovery if a enrtree is used in the DiscV5BootstrapNodes config ( #2814 )
2022-09-15 10:32:54 -04:00
ad326fa290
feat: wakuv2 store ( #2780 )
...
Allows runnning a store node depending on node config settings.
2022-08-19 12:34:07 -04:00
Jakub Sokołowski
530f3c7a3a
rename status-react to status-mobile
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-17 15:37:14 +02:00
478990febf
fix: peer table queries
2022-04-01 18:06:10 -04:00
de949efcf4
fix: lint
2022-04-01 17:39:10 -04:00
faf8f34fef
fix: adding missing config settings
2022-04-01 17:39:10 -04:00
8a5f77dc37
Address linter issues
2022-03-28 13:14:12 +01:00
de2b8df033
feat: switch fleet
2022-03-22 18:47:07 -04:00
df92cdbaf8
fix: LOG15_ERROR
2022-03-03 08:50:40 -04:00
02d70899df
fix: query timestamp conversion
2022-03-02 10:58:56 -04:00
0b1c06403b
fix: timestamp conversion from uint64
2022-03-02 10:58:56 -04:00
381c5f6116
chore: bump go-waku
2022-02-24 10:07:42 -04:00
ee41e30881
feat: extract node config from settings to individual tables ( #2470 )
2022-01-12 16:04:43 -04:00
98784b752a
feat: desktop mailserver cycle ( #2481 )
2022-01-12 12:02:01 -04:00
268c8304a1
feat: Mark messages as confirmed in waku2 ( #2449 )
2021-12-01 16:15:18 +01:00
d32f0467ae
feat: Add DiscV5 to Waku2 ( #2434 )
...
* feat: Add DiscV5 to Waku2
* fix: null verification for discV5
2021-11-22 09:40:14 -04:00
6099380d9c
fix: waku2 - send messages in a separate goroutine ( #2433 )
2021-11-18 14:31:28 -04:00
38cc695753
waku2: log envelope hash and ids for all messages ( #2427 )
2021-11-11 12:13:55 -04:00
d35e0a339d
feat(waku2): use relay or lightpush depending on the number of peers ( #2425 )
2021-11-09 15:16:05 -04:00
f47229a466
feat: add dns discovery to wakuv2 ( #2422 )
2021-11-09 08:22:34 -04:00
4602982c77
waku2: enable message confirmations ( #2416 )
2021-11-02 14:27:37 -04:00
bade0a24ff
chore: bump go-waku ( #2404 )
2021-10-19 09:43:41 -04:00
cf11713d9c
feat: wakuv2 peer persistence ( #2287 )
2021-10-12 08:39:28 -04:00
4dbef97367
feat: waku2 + rendezvous ( #2393 )
2021-10-06 12:08:54 -04:00
6bb04e0858
fix: dial peer async
2021-10-01 08:29:23 -04:00
524e864398
feat: add gossipsub peer exchange option to wakuV2
2021-09-29 09:44:36 -04:00
da63894a5a
feat: wakuV2 light client using lightpush / filter ( #2351 )
2021-09-27 09:04:28 -04:00
71555991db
fix: waku2 history query
2021-09-27 09:04:28 -04:00
7d148272e1
feat: functions to add peers and dial ( #2345 )
2021-09-27 09:04:28 -04:00
0575030825
feat: adding peers, fix peer count and fix format of peer stats signal
2021-09-27 09:04:28 -04:00
049afe5765
Pass connection status chan to go-waku
...
Fix conn status chan gorouting never quitting
Fix import cycle
Add keepAlive interval to wakuv2 node
Add CustomNodes
Do not resume wakuv2 store
2021-09-23 19:00:40 +03:00
719a303b05
feat: wakuV2 bandwidth stats ( #2325 )
2021-08-30 17:35:37 -04:00
842ba229df
feat: add function to obtain bloomfilter ( #2334 )
2021-08-26 16:25:43 -04:00
f6dc6f752a
use 23/WAKU2-TOPICS format for content topics ( #2281 )
2021-08-17 11:27:28 -04:00
0aab3e238b
chore: bump go-waku ( #2292 )
2021-08-03 16:40:22 -04:00
facad9f07e
feat: upload/download rate for waku v1 messages ( #2286 )
...
* feat: upload/download rate for waku v1 messages
* reorganize code
* fix failing test
2021-08-03 15:27:15 -04:00
bfdc000bbc
go-waku: RequestAllHistoricMessages ( #2258 )
...
* feat: update wakuv2 store
* check online using waku version for now
* fix peerId and from/to multiplier
* fix: lint
* fix: handle waku2 cursors
* fix: code review
* fix: code review 2
* update go-waku version
* update vendor folder
2021-07-21 15:02:50 -04:00
4b0daeb47b
Move services to status-node
...
Move all the services to status-node, as some of them were there, some
of them were in the geth backend and scattered around.
2021-07-20 10:57:38 +02:00
40359f9c1b
go-waku integration ( #2247 )
...
* Adding wakunode module
* Adding wakuv2 fleet files
* Add waku fleets to update-fleet-config script
* Adding config items for waku v2
* Conditionally start waku v2 node depending on config
* Adapting common code to use go-waku
* Setting log level to info
* update dependencies
* update fleet config to use WakuNodes instead of BootNodes
* send and receive messages
* use hash returned when publishing a message
* add waku store protocol
* trigger signal after receiving store messages
* exclude linting rule SA1019 to check deprecated packages
2021-06-16 16:19:45 -04:00
Andrea Maria Piana
Siddarth Kumar
Richard Ramos
Igor Sirotin
kaichao
Vitaly Vlasov
Pablo Lopez
Prem Chaitanya Prathi
Michal Iskierko
Patryk Osmaczko
Vitaliy Vlasov
frank
Roman Volosovskyi
Jonathan Rainville
Jakub Sokołowski
Anthony Laibe
Vitaliy Vlasov