mirror of https://github.com/logos-co/roadmap.git
DST - Add/update 2024 milestones (#61)
This commit is contained in:
Benjamin Arntzen
GitHub
parent
4e440f4be2
commit
9124fc5dd8
|
|
@ -0,0 +1,43 @@
|
|||
---
|
||||
title: "Testnet"
|
||||
description: "Help Codex deploy and run a testnet. Provide support and advice."
|
||||
---
|
||||
## `vac:dst:deployment-and-analysis:codex:testnet`
|
||||
---
|
||||
|
||||
```mermaid
|
||||
%%{
|
||||
init: {
|
||||
'theme': 'base',
|
||||
'themeVariables': {
|
||||
'primaryColor': '#BB2528',
|
||||
'primaryTextColor': '#fff',
|
||||
'primaryBorderColor': '#7C0000',
|
||||
'lineColor': '#F8B229',
|
||||
'secondaryColor': '#006100',
|
||||
'tertiaryColor': '#fff'
|
||||
}
|
||||
}
|
||||
}%%
|
||||
gantt
|
||||
tickInterval 1month
|
||||
dateFormat YYYY-MM-DD
|
||||
section Status
|
||||
Testnet: 2024-05-01, 2024-12-31
|
||||
```
|
||||
|
||||
- status: 15%
|
||||
- CC: Wings
|
||||
|
||||
### Description
|
||||
|
||||
Assist the Codex team with deploying and running a testnet for the Codex network.
|
||||
|
||||
- Provide a 256TB Storage Provider deployment, which should later build towards 1PiB
|
||||
- Provide various support and analysis for how the testnet operates and help improve Codex
|
||||
|
||||
### Justification
|
||||
|
||||
### Deliverables
|
||||
- Materially assist Codex with rolling out testnet
|
||||
- Working SP storing real data
|
||||
|
|
@ -0,0 +1,44 @@
|
|||
---
|
||||
title: "Mixnet"
|
||||
description: "Help the Nomos team deploy and run a mixnet."
|
||||
---
|
||||
## `vac:dst:deployment-and-analysis:nomos:mixnet`
|
||||
---
|
||||
|
||||
```mermaid
|
||||
%%{
|
||||
init: {
|
||||
'theme': 'base',
|
||||
'themeVariables': {
|
||||
'primaryColor': '#BB2528',
|
||||
'primaryTextColor': '#fff',
|
||||
'primaryBorderColor': '#7C0000',
|
||||
'lineColor': '#F8B229',
|
||||
'secondaryColor': '#006100',
|
||||
'tertiaryColor': '#fff'
|
||||
}
|
||||
}
|
||||
}%%
|
||||
gantt
|
||||
tickInterval 1month
|
||||
dateFormat YYYY-MM-DD
|
||||
section Status
|
||||
Mixnet: 2024-05-01, 2024-12-31
|
||||
```
|
||||
|
||||
- status: 10%
|
||||
- CC: Wings
|
||||
|
||||
### Description
|
||||
|
||||
Assist the Nomos team with deploying and running a mixnet at scale within VacLab.
|
||||
|
||||
- Provide analysis of the VacLab mixnet
|
||||
- Through [Visualiser](../../tooling/vac/visualiser-tool.md), provide visualisation tools and work with the Nomos team to implement privacy preserving metrics and measurements in Nomos to help understand the mixnet's performance.
|
||||
- Work with the Nomos team to deploy the visualisation tools for their own purposes.
|
||||
|
||||
### Justification
|
||||
|
||||
### Deliverables
|
||||
- Lab version of mixnet fully operational and rolled out
|
||||
- Working metrics via Visualiser Tool
|
||||
|
|
@ -0,0 +1,48 @@
|
|||
---
|
||||
title: "10k Node Cluster"
|
||||
description: "Run 10,000 Waku nodes in one cluster, with a pipeline for analysis and measurements."
|
||||
---
|
||||
## `vac:dst:deployment-and-analysis:waku:10k`
|
||||
---
|
||||
|
||||
```mermaid
|
||||
%%{
|
||||
init: {
|
||||
'theme': 'base',
|
||||
'themeVariables': {
|
||||
'primaryColor': '#BB2528',
|
||||
'primaryTextColor': '#fff',
|
||||
'primaryBorderColor': '#7C0000',
|
||||
'lineColor': '#F8B229',
|
||||
'secondaryColor': '#006100',
|
||||
'tertiaryColor': '#fff'
|
||||
}
|
||||
}
|
||||
}%%
|
||||
gantt
|
||||
tickInterval 1month
|
||||
dateFormat YYYY-MM-DD
|
||||
section Status
|
||||
10k: 2024-05-01, 2024-11-01
|
||||
```
|
||||
|
||||
- status: 90%
|
||||
- CC: Wings
|
||||
|
||||
### Description
|
||||
|
||||
Run 10,000 Waku nodes actively passing messages in one network.
|
||||
|
||||
Gather bandwidth details, deliverability rate, retrieval times. Measure reliability, improve reliability and document deployment and analysis processes.
|
||||
|
||||
Gather QoS details such as latency, dropped packets, etc.
|
||||
|
||||
### Justification
|
||||
|
||||
### Deliverables
|
||||
Documentation of both the deployment process and actual deployments.
|
||||
|
||||
Useful analytics for the Waku team that can be used to improve the Waku software.
|
||||
|
||||
Research articles such as blog posts about the large scale clusters.
|
||||
|
||||
|
|
@ -0,0 +1,48 @@
|
|||
---
|
||||
title: "Midscale"
|
||||
description: "Run smaller 1K-5K node Waku deployments, with a pipeline for analysis and measurements."
|
||||
---
|
||||
## `vac:dst:deployment-and-analysis:waku:midscale`
|
||||
---
|
||||
|
||||
```mermaid
|
||||
%%{
|
||||
init: {
|
||||
'theme': 'base',
|
||||
'themeVariables': {
|
||||
'primaryColor': '#BB2528',
|
||||
'primaryTextColor': '#fff',
|
||||
'primaryBorderColor': '#7C0000',
|
||||
'lineColor': '#F8B229',
|
||||
'secondaryColor': '#006100',
|
||||
'tertiaryColor': '#fff'
|
||||
}
|
||||
}
|
||||
}%%
|
||||
gantt
|
||||
tickInterval 1month
|
||||
dateFormat YYYY-MM-DD
|
||||
section Status
|
||||
Midscale: 2024-05-01, 2024-11-01
|
||||
```
|
||||
|
||||
- status: 20%
|
||||
- CC: Wings
|
||||
|
||||
### Description
|
||||
|
||||
Run deployments of between 1000 and 5000 Waku nodes actively passing messages in one network.
|
||||
|
||||
- Measure relay bandwidth
|
||||
- Measure reliability of Waku message relaying
|
||||
- Measure usage of the DiscV5 protocol
|
||||
- Test Store protocol at scale
|
||||
- Test Waku relay+store reliability with nodes going offline/online
|
||||
- If nodes go online/offline, we should be able to retrieve missing messages from the store. This will also test Waku message relaying in a different way.
|
||||
- Filter and lightpush tests
|
||||
- Test heterogenous clusters involving different node implementations such as nwaku and go-waku.
|
||||
|
||||
### Justification
|
||||
|
||||
### Deliverables
|
||||
Similar deliverables to 10k sim, but with focuses on smaller scale and more frequent deployments.
|
||||
|
|
@ -1,5 +1,6 @@
|
|||
---
|
||||
title: "Bandwidth Test"
|
||||
description: "Measure bandwidth usage for individual nodes in large Waku clusters."
|
||||
---
|
||||
## `vac:dst:eng-10ktool:vac:bandwidth`
|
||||
---
|
||||
|
|
|
|||
|
|
@ -1,5 +1,6 @@
|
|||
---
|
||||
title: "QoS"
|
||||
description: "Add QoS parameter support to the 10k tool."
|
||||
---
|
||||
## `vac:dst:eng-10ktool:vac:qos`
|
||||
---
|
||||
|
|
|
|||
|
|
@ -1,5 +1,6 @@
|
|||
---
|
||||
title: "Waku Protocols"
|
||||
description: "Measure and test additional Waku protocol features."
|
||||
---
|
||||
## `vac:dst:eng-10ktool:waku:waku-protocols`
|
||||
---
|
||||
|
|
|
|||
|
|
@ -10,6 +10,16 @@ lastmod: 2023-09-08
|
|||
## `vac:dst:`
|
||||
---
|
||||
|
||||
### `tooling`
|
||||
* [[vac/dst/tooling/vac/deployer-tool|deployer-tool ]]
|
||||
* [[vac/dst/tooling/vac/visualiser-tool|visualiser-tool ]]
|
||||
|
||||
## `deployment-and-analysis`
|
||||
* [[vac/dst/deployment-and-analysis/waku/10k|10k ]]
|
||||
* [[vac/dst/deployment-and-analysis/waku/midscale|midscale ]]
|
||||
* [[vac/dst/deployment-and-analysis/nomos/mixnet|mixnet ]]
|
||||
* [[vac/dst/deployment-and-analyis/codex/testnet|testnet ]]
|
||||
|
||||
### `wakurtosis:waku:`
|
||||
|
||||
* [x] [[vac/dst/wakurtosis/waku/techreport|techreport ]]
|
||||
|
|
@ -52,5 +62,3 @@ lastmod: 2023-09-08
|
|||
* [[vac/dst/eng-10ktool/vac/bandwidth-test|bandwidth-test ]]
|
||||
* [[vac/dst/eng-10ktool/vac/qos|QoS ]]
|
||||
* [[vac/dst/eng-10ktool/waku/waku-protocols|waku-protocols ]]
|
||||
|
||||
|
||||
|
|
|
|||
|
|
@ -0,0 +1,45 @@
|
|||
---
|
||||
title: "Deployer Tool"
|
||||
description: "Build a tool that makes it easy to deploy large numbers of nodes in a controlled network."
|
||||
---
|
||||
## `vac:dst:tooling:vac:deployer-tool`
|
||||
---
|
||||
|
||||
```mermaid
|
||||
%%{
|
||||
init: {
|
||||
'theme': 'base',
|
||||
'themeVariables': {
|
||||
'primaryColor': '#BB2528',
|
||||
'primaryTextColor': '#fff',
|
||||
'primaryBorderColor': '#7C0000',
|
||||
'lineColor': '#F8B229',
|
||||
'secondaryColor': '#006100',
|
||||
'tertiaryColor': '#fff'
|
||||
}
|
||||
}
|
||||
}%%
|
||||
gantt
|
||||
tickInterval 1month
|
||||
dateFormat YYYY-MM-DD
|
||||
section Status
|
||||
Deployer Tool: 2024-05-01, 2024-11-01
|
||||
```
|
||||
|
||||
- status: 80%
|
||||
- CC: Alberto
|
||||
|
||||
### Description
|
||||
|
||||
A first version of tool that allows deploying >10k gossipsub / waku relay nodes.
|
||||
|
||||
The tool should measure bandwidth usage per node and bundle the measurement data for analaysis.
|
||||
|
||||
The tool should be built in such a way that it can be used for other deployments as well.
|
||||
|
||||
### Justification
|
||||
|
||||
|
||||
### Deliverables
|
||||
|
||||
* https://github.com/vacp2p/10ksim
|
||||
|
|
@ -0,0 +1,46 @@
|
|||
---
|
||||
title: "Visualiser Tool"
|
||||
description: "Build a web app that displays a map of a project's network, showing the flow of messages between nodes."
|
||||
---
|
||||
## `vac:dst:tooling:vac:visualiser-tool`
|
||||
---
|
||||
|
||||
```mermaid
|
||||
%%{
|
||||
init: {
|
||||
'theme': 'base',
|
||||
'themeVariables': {
|
||||
'primaryColor': '#BB2528',
|
||||
'primaryTextColor': '#fff',
|
||||
'primaryBorderColor': '#7C0000',
|
||||
'lineColor': '#F8B229',
|
||||
'secondaryColor': '#006100',
|
||||
'tertiaryColor': '#fff'
|
||||
}
|
||||
}
|
||||
}%%
|
||||
gantt
|
||||
tickInterval 1month
|
||||
dateFormat YYYY-MM-DD
|
||||
section Status
|
||||
Visualiser Tool: 2024-05-01, 2024-11-01
|
||||
```
|
||||
|
||||
- status: 10%
|
||||
- CC: Alberto
|
||||
|
||||
### Description
|
||||
|
||||
A first version of tool that allows for visualising the message flow of a Waku network. It should be adaptable to other network types too (particularly Nomos, Codex)
|
||||
|
||||
This relies on a Grafana Loki deployment to store and query logs.
|
||||
|
||||
### Justification
|
||||
|
||||
### Deliverables
|
||||
|
||||
A peer to peer network mapper that creates a visualisation something like this:
|
||||
|
||||
[](visualiser-tool.png)
|
||||
|
||||
The tool should be able to visualise the message flow of a Waku network, by lighting up nodes in a graph as they receive messages, flashing a different colour for each message (or message type).
|
||||
Binary file not shown.
|
After Width: | Height: | Size: 506 KiB |
Loading…
Reference in New Issue