roadmap/content/waku/updates/2024-07-08.md

title	tags	date
2024-07-08 Waku Weekly	waku-updates	2024-07-08

Milestone - Store Service Upgrade

• Store v3-beta - Message Hashes

  • achieved:
    • [research] take up reported bugfixes after afk; continue with service rollout
    • [chat] tunning store hash query to shorten the confirmation time of outgoing messages https://github.com/status-im/status-go/pull/5349
  • next:
    • [research] start with storev3 benchmarking test plan

• DOS protection for req-res protocols and metrics

  • achieved:
    • [Epic: nwaku] Node Bandwidth Management Features - https://github.com/waku-org/pm/issues/117
      • BW metrics per shard: implemented per shard metric collection - https://github.com/waku-org/nwaku/issues/1945
      • Added dashboard panels for relay per shard traffic
      • Added dashboard panels for non-relay protocols data traffic
      • Added dashboard panels for non-relay protocols request rates
    • [nwaku] feat: Enforce service specific rate limits - https://github.com/waku-org/nwaku/issues/2032
      • Finalizing last phase of the feature:
      • Added per peer filtering of high users
      • Filter service specific limits for ping and subscribe per peer
  • next:
    • [Epic: nwaku] Node Bandwidth Management Features - https://github.com/waku-org/pm/issues/117
      • Separate add distinction between gross/net inbound traffic of shards.
    • [nwaku] feat: Enforce service specific rate limits - https://github.com/waku-org/nwaku/issues/2032
      • finish testing, add more unit tests

• PostgreSQL Maintenance

  • achieved:
    • [nwaku] new issue to create sonda tool: https://github.com/waku-org/nwaku/issues/2869
  • next:
    • [nwaku] start implementation of sonda tool

Milestone - Direct Message Reliability

• Review connection management strategy and back-off and fix long disconnection issues

  • achieved:
    • [chat] feat: filter peers stored in cache by cluster-id in peer-exchange - https://github.com/waku-org/go-waku/pull/1139
    • [chat] feat: expose router and mesh peers to obtain list of peers in mesh https://github.com/waku-org/go-libp2p-pubsub/pull/1
    • [chat] improve relay peer connectivity and refactor peerManager to support lightMode https://github.com/waku-org/go-waku/pull/1135
    • [chat] enable peerExchange in relay for better peer discovery https://github.com/status-im/status-go/pull/5411
    • [chat] fix peerExchange peer source and enable peerExchange in lightClient https://github.com/status-im/status-go/pull/5350
    • [chat] query store node when back from sleep: https://github.com/status-im/status-go/issues/5412
    • [chat] IMO of what to do regarding receive reliability: https://forum.vac.dev/t/receive-message-reliability-for-status-desktop/302
  • next:
    • [chat] expose rpc methods to obtain list of peers by topic, and list of peers in mesh
    • [chat] lightClient topic health reporting and peer connectivity improvements
    • [chat] when back online only request from store node since last time not 24 hours
    • [chat] investigate connection management for outgoing messages

• Tooling: filter and light push protocols

  • achieved:
    • [chat] optimize filter subscriptions by aggregating them https://github.com/waku-org/go-waku/pull/1144 and https://github.com/status-im/status-go/pull/5440
    • [nwaku] stress test on waku-simulator
  • next:
    • [nwaku] add rln support
    • [nwaku] run lite-protocol-tester on shards.staging

• Reliability Protocol for Relay

  • achieved:
    • [chat] draft reliability for relay protocol spec https://github.com/waku-org/specs/pull/23
    • [nwaku] carry on with the implementation in nwaku - https://github.com/waku-org/nwaku/issues/2819
  • next:
    • [chat] continue with the reliability protocol
    • [nwaku] submit first PR in nwaku - https://github.com/waku-org/nwaku/issues/2819

• Reliability Protocol for Resource-Restricted Clients

  • achieved:
    • [nwaku] Accepted new lightpush protocol definition with detailed fail case support - https://github.com/waku-org/pm/issues/93
  • next:
    • [nwaku] Implement: feat: Enhance lightpush protocol error handling - https://github.com/waku-org/nwaku/issues/2722

• Review MVDS usage and fail path

  • achieved:
    • [chat] reset MVDS epoch after peer is back online https://github.com/status-im/status-go/pull/5349
  • next:
    • [chat] continue mvds review

Milestone - End-to-end reliability protocol

• End-to-end reliability protocol - PoC
  • achieved:
    • [research] started exploring POC in go-waku as an example application
    • [research] researched Vac’s de-MLS protocol for possible integration
  • next:
    • [research] continue with the POC starting with a minimal working version first
  • blockers:

Milestone - Static Sharding - dedicated shards

• Sharding peer management and discovery hardening
  • achieved:
    • [nwaku] added origin of peers in admin rest endpoint as per request, to debug and further understand discovery performance https://github.com/waku-org/nwaku/pull/2848
    • [nwaku] discussed with nim-libp2p team and tested a version of logging errors on publish to understand how often messages are not sent without returning errors

Milestone - Scale 1:1 chat messages PoC

• RLNv2 in nwaku

  • achieved:
    • [research] RLNv2 config for the Waku Network: https://github.com/waku-org/nwaku/pull/2843
    • [research] bug fix in RLN, vulnerability: https://github.com/waku-org/nwaku/pull/2855
  • next:
    • [research] assist to deploy 0.30.0 release and integrate it in The Waku Network

• Maturing RLN variables/parameters revision

  • achieved:
    • [research] continuing the execution of RLN in resource-restricted network: https://github.com/waku-org/pm/issues/168
    • [research] simulations using the waku simulator for different purposes
    • [research] expanded RLNv2 testing, assisted with simulating and debugging vulnerabilities
  • next:
    • [research] assist to deploy 0.30.0 release and integrate it in The Waku Network
    • [research] complete execution of RLNv2 test scenarios

• Pay for RLN provision first PoC

  • achieved:
    • [research] added chain interaction to incentivization POC
  • next:
    • [research] draft a specification for RLN mainnet deployment

Other Work

Enhancements

• achieved:
  • [nwaku] deployment of release v0.30.1, which adds RLN_v2

Bugs

• achieved:
  • [chat] fix: panic due to enr having more than 300 bytes - https://github.com/waku-org/go-waku/pull/1140
  • [chat] fix: ignore ws from circuit relay addresses, and allow non multiaddresses in multiaddrs ENR key - https://github.com/waku-org/go-waku/pull/1141
  • [chat] fix failing wakuv2 tests https://github.com/status-im/status-go/pull/5444
  • [nwaku] bug: build error on new AMD cpu's - https://github.com/waku-org/nwaku/issues/2560
  • [nwaku] https://github.com/waku-org/nwaku/issues/2625
  • [nwaku] https://github.com/waku-org/nwaku/issues/2615
  • [nwaku] https://github.com/waku-org/nwaku/issues/2591
  • [nwaku] https://github.com/waku-org/nwaku/issues/2590
  • [nwaku] https://github.com/waku-org/nwaku/issues/2253
  • [nwaku] https://github.com/waku-org/nwaku/issues/2319
  • [nwaku] https://github.com/waku-org/nwaku/issues/2304
  • [nwaku] refactor relative code to absolute: https://github.com/waku-org/nwaku/issues/2845 (not merged, need to wait till v0.30.0)
  • [nwaku] handle rln_msg_limit issue : https://github.com/waku-org/nwaku/issues/2822
• next:
  • [nwaku] peer exchange returns nodes that no longer exist. - https://github.com/waku-org/nwaku/issues/2414