roadmap/content/waku/updates/2023-11-20.md

95 lines
5.4 KiB
Markdown
Raw Normal View History

2023-11-20 22:58:24 +00:00
---
title: 2023-11-20 Waku Weekly
tags:
- waku-updates
date: 2023-11-20
2023-11-21 01:10:56 +00:00
draft: false
2023-11-20 22:58:24 +00:00
---
# 2023-11-20 Waku weekly
## [Waku Network Can Support 10K Users](https://github.com/waku-org/pm/issues/12)
- _achieved:_
- closed last PostgreSQL issue for Store scalability
- confirmed no unknown blockers from Waku's side to continue dogfooding in conversation with Status Communities
- started team-internal dogfooding of a test community using static sharding
- started fleet ownership handover process: published guidelines/list of responsibilities - https://www.notion.so/Fleet-Ownership-7532aad8896d46599abac3c274189741
- _next:_
- continue dogfooding of Status Desktop with Status staging fleet with test community
- training session to conclude fleet ownership handover: https://www.notion.so/Fleet-Ownership-7532aad8896d46599abac3c274189741
- _risks:_
- Dependency on Vac/DST to conclude ~1k nodes simulations.
- Implementation of static sharding in Status Communities and design decisions mostly driven by go-waku developer, with minimal input from Status dev ([1](https://github.com/status-im/status-go/pull/4161), [2](https://github.com/status-im/status-go/pull/4094), [3](https://github.com/status-im/status-go/pull/4093)). See [status-go#4057](https://github.com/status-im/status-go/issues/4057) for remaining work. Mitigation by on-boarding Chat SDK lead on 6 Nov to drive effort.
- lack of confidence in simulation results: results so far exhibits various artifacts and anomalies seemingly related to tooling limitations. It is therefore difficult to draw certain conclusions re Waku scalability.
- lack of clarity in terms of Status fleet ownership, monitoring and maintenance, which is an integral part of the solution.
### [Targeted dogfooding for Status Communities](https://github.com/waku-org/pm/issues/97)
- _achieved_: logout / login freeze, fix request on correct pubsub topic, and add missing shard information on community invite
- _next_: dogfooding
## [Waku Network can Support 1 Million Users](https://github.com/waku-org/pm/issues/83) - 2023-11-30
- _achieved_:
- Closed last Postgresql issue for basic Store scalability. See 10k milestone.
- Assisted DST in setting up initial tests with the ~1K tool. Currently still fine-tuning parameters, ensuring results are consistent, etc. for smaller configurations.
- _risks_:
- Dependency on Vac/DST to run 10k nodes simulations. Tracked under
[`vac:dst:eng-10ktool`](https://roadmap.logos.co/tags/vac-updates).
- Wakutorsis tool is being dropped, meaning new tooling needs to be developed for 10k nodes simulations. It is currently uncertain whether such tool can be developed.
- Large scale simulations done by Vac/DST only covered nwaku relay. go-waku, status-go simulations are not planned short term (theoretical review of Status Communities messages is), nor are simulations including request-response protocols such as store and filter.
- lack of real world feedback/dogfooding: the complete static sharding solution involves significant changes to the Waku protocol and tech stack. Although each element is unit tested, dogfooding may hit corner cases in the integrated solution that cannot be foreseen/recreated in lab conditions.
## [Waku Network Gen 0](https://github.com/waku-org/pm/issues/50) - 2023-12-01
### [1.4: Sharded peer management and discovery](https://github.com/waku-org/pm/issues/67)
**[nwaku] [chore: improve cluster id, shards, topics flow](https://github.com/waku-org/nwaku/issues/2183)**
- _achieved_: Various tests updates and fixes.
- _next_: Figure out why CI passes locally only.
### [1.2: Autosharding for autoscaling](https://github.com/waku-org/pm/issues/65)
**[nwaku] [chore: allow fetching cached messages by content or pubsub topic](https://github.com/waku-org/nwaku/issues/2201)**
- _achieved_: failed refactor of message cache
- _next_: a better and simpler message cache
**[js-waku] [feat: Autosharding API for req-resp protocols](https://github.com/waku-org/js-waku/issues/1500)**
- _achieved_: derive pubsub topic from content topic in encoders/decoders when autosharding is specified
- _next_: node config should specify static sharding or autosharding. implement autosharded topics in all req-resp protocols
## [Support Many Platforms](https://github.com/waku-org/pm/issues/42) - 2024-04-30
### [Presentation Readiness ](https://github.com/waku-org/pm/issues/95)
**[js-waku] [feat: node connection state](https://github.com/waku-org/js-waku/issues/1666)**
- _achieved_: modified `ConnectionManager` to track connection state. exposed through read function and new event
- _next_: resolve any remaining feedback
## Other Work
### Enhancements
**[nwaku] [chore(REST): adding to `/admin/v1/peers` response lightpush and filter v2 peer info](https://github.com/waku-org/nwaku/issues/2220)**
- _achieved_: implemented, tested and raised PR
- _next_: get PR reviewed, implement feedback and merge
**[nwaku] [chore: allow text/plain contentType for rest request's body types](https://github.com/waku-org/nwaku/issues/2207)**
2023-11-20 23:06:22 +00:00
- *achieved*: Better support for js-waku using RestApi: Allow text/plain contentType
- *next*: Bandwidth management preparation
2023-11-20 22:58:24 +00:00
**[nwaku] [chore: decouple listen and announced addresses](https://github.com/waku-org/nwaku/issues/2148)**
- _achieved_: got the PR reviewed, implemented feedback and merged
### Ecosystem Development
2023-11-21 01:10:56 +00:00
- *achieved*: two talks last week. Logos + Waku at Web3Privacy meetup and RLN at DCxPrague
2023-11-21 01:09:14 +00:00
- *next*: afk for a week