Vac dst roadmap update ice (#68)

This commit is contained in:
kaiserd 2024-05-14 19:23:45 +02:00 committed by GitHub
parent 259ac1dd49
commit e8989e5076
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
17 changed files with 100 additions and 214 deletions

View File

@ -0,0 +1,40 @@
---
title: Distributed Systems Testing Service Unit
tags:
- dst
- vac
date: 2024-05-14
lastmod: 2024-05-14
---
## `vac:dst:`
---
### `wakurtosis:waku:`
* [[vac/dst/wakurtosis/waku/gossipsub-topology-analysis|gossipsub-topology-analysis ]]
### `wakurtosis:nomos:`
* [x] [[vac/dst/wakurtosis/nomos/ci-integration|ci-integration ]]
### `wakurtosis:vac:`
* [[vac/dst/wakurtosis/vac/rlog|rlog]]
### `analysis:nomos`
* [x] [[vac/dst/analysis/nomos/nomos-simulation-analysis|simulation-analysis ]]
### `analysis-gsub-model:vac`
* [[vac/dst/analysis-gsub-model/vac/refactoring|refactoring ]]
### `analysis-gsub-model:status:`
* [[vac/dst/analysis-gsub-model/status/control-messages|control-messages ]]
### `analysis-shadow:vac:`
* [[vac/dst/analysis-shadow/vac/shadow-basic-simulation|shadow-basic-simulation ]]
* [[vac/dst/analysis-shadow/vac/shadow-gossipsub-analysis|shadow-gossipsub-analysis ]]
### `analysis-shadow:waku:`
* [[vac/dst/analysis-shadow/waku/shadow-waku-relay-analysis|shadow-waku-relay-analysis ]]
### `dr-support:`
* [[roadmap/vac/dst/dr-support/vac/carnot-2-3rds-executable-spec|carnot-2-3rds-executable-spec ]]

View File

@ -25,7 +25,7 @@ gantt
Simulation Analysis: 2023-08-01, 2023-09-15
```
- status: 70%
- status: 100%
- CC: Ganesh
### Description

View File

@ -0,0 +1,45 @@
---
title: "Rlog: Wakurtosis Retrospective"
---
## `vac:dst:wakurtosis:waku:retrospective-rlog`
---
```mermaid
%%{
init: {
'theme': 'base',
'themeVariables': {
'primaryColor': '#BB2528',
'primaryTextColor': '#fff',
'primaryBorderColor': '#7C0000',
'lineColor': '#F8B229',
'secondaryColor': '#006100',
'tertiaryColor': '#fff'
}
}
}%%
gantt
tickInterval 1month
dateFormat YYYY-MM-DD
section Status
Wakurtosis Retrospective: 2023-08-01, 2023-09-30
```
- status: 50%
- CC: Jordi
### Description
Research log discussing what would we have needed from Wakurtosis to make it work for us beyond our smaller solution.
Why did we decide to drop Kurtosis and work towards a Kubernetes-based solution now.
### Justification
### Info
* [Alberto's Opinion](https://www.notion.so/Alberto-s-Opinion-5f1af38a2e274f42baad0e322629f3a9)
### Deliverables

View File

@ -32,12 +32,20 @@ gantt
### Description
The Vac P2P team is transitioning nim-libp2p to a monthly release cycle.
Our approach involves selecting a commit hash to designate as the monthly version a week prior to release.
DST will conduct stability tests on this version (with additional testing in Nomos and Waku test fleets outside of the DST scope).
Our aim is to increasingly automate this process.
The next round of testing is scheduled for the end of May, targeting the beginning of June.
This process involves selecting a commit hash to designate as the monthly version a week prior to release.
DST will conduct stability tests on this version.
This also comprises analysing results as well as identifying and pinpointing bugs if any arise.
Specific issues might require several test runs and thorough analysis.
Our aim is to increasingly automate this process.
Additional testing outside the scope of DST and this milestone comprises:
* testing on a Nimbus test fleet
* testing on a Waku test fleet
### Justification
### Deliverables
- Monthly report of libp2p testing outcomes
- Monthly report of libp2p testing outcomes

View File

@ -1,45 +0,0 @@
---
title: "Bandwidth Test"
description: "Measure bandwidth usage for individual nodes in large Waku clusters."
---
## `vac:dst:eng-10ktool:vac:bandwidth`
---
```mermaid
%%{
init: {
'theme': 'base',
'themeVariables': {
'primaryColor': '#BB2528',
'primaryTextColor': '#fff',
'primaryBorderColor': '#7C0000',
'lineColor': '#F8B229',
'secondaryColor': '#006100',
'tertiaryColor': '#fff'
}
}
}%%
gantt
tickInterval 1month
dateFormat YYYY-MM-DD
section Status
Bandwidth Test: 2023-08-01, 2023-10-31
```
- status: 80%
- CC: Alberto
### Description
A first version of tool that allows running >10k gossipsub / waku relay nodes.
The tool should measure bandwidth usage per node and bundle the simulation data for analaysis.
### Justification
### Deliverables
* https://github.com/vacp2p/cs-codex-dist-tests

View File

@ -1,42 +0,0 @@
---
title: "QoS"
description: "Add QoS parameter support to the 10k tool."
---
## `vac:dst:eng-10ktool:vac:qos`
---
```mermaid
%%{
init: {
'theme': 'base',
'themeVariables': {
'primaryColor': '#BB2528',
'primaryTextColor': '#fff',
'primaryBorderColor': '#7C0000',
'lineColor': '#F8B229',
'secondaryColor': '#006100',
'tertiaryColor': '#fff'
}
}
}%%
gantt
tickInterval 1month
dateFormat YYYY-MM-DD
section Status
QoS 10ktool: 2023-11-01, 2023-12-31
```
- status: 0%
- CC: Alberto
### Description
Add QoS parameter support to the 10k tool.
### Justification
### Deliverables

View File

@ -1,49 +0,0 @@
---
title: "Waku Protocols"
description: "Measure and test additional Waku protocol features."
---
## `vac:dst:eng-10ktool:waku:waku-protocols`
---
```mermaid
%%{
init: {
'theme': 'base',
'themeVariables': {
'primaryColor': '#BB2528',
'primaryTextColor': '#fff',
'primaryBorderColor': '#7C0000',
'lineColor': '#F8B229',
'secondaryColor': '#006100',
'tertiaryColor': '#fff'
}
}
}%%
gantt
tickInterval 1month
dateFormat YYYY-MM-DD
section Status
Waku Protocols: 2023-11-01, 2023-12-31
```
- status: 0%
- CC: Alberto
### Description
So far, we tested gossip / relay, as well as discv5.
This milestone comprises running further Waku protocols, namely:
* filter
* lightpush
* store
* peer exchange
### Justification
### Deliverables

View File

@ -4,7 +4,7 @@ tags:
- dst
- vac
date: 2023-08-25
lastmod: 2023-09-08
lastmod: 2024-05-14
---
## `vac:dst:`
@ -25,41 +25,12 @@ lastmod: 2023-09-08
* [x] [[vac/dst/wakurtosis/waku/techreport|techreport ]]
* [x] [[vac/dst/wakurtosis/waku/techreport_02|techreport_02 ]]
* [[vac/dst/wakurtosis/waku/techreport_03|techreport_03 ]]
* [x] [[vac/dst/wakurtosis/waku/features|wakurtosis:features ]]
* [[vac/dst/wakurtosis/waku/gossipsub-topology-analysis|gossipsub-topology-analysis ]]
### `wakurtosis:nomos:`
* [x] [[vac/dst/wakurtosis/nomos/ci-integration|ci-integration ]]
### `wakurtosis:vac:`
* [[vac/dst/wakurtosis/vac/rlog|rlog]]
* [[vac/dst/wakurtosis/vac/retrospective-rlog|retrospective-rlog ]]
* [x] [[vac/dst/wakurtosis/vac/maintenance|maintenance ]]
### `analysis:nomos`
* [[vac/dst/analysis/nomos/nomos-simulation-analysis|simulation-analysis ]]
### `analysis-gsub-model:vac`
* [[vac/dst/analysis-gsub-model/vac/refactoring|refactoring ]]
### `analysis-gsub-model:status:`
* [[vac/dst/analysis-gsub-model/status/control-messages|control-messages ]]
### `analysis-shadow:vac:`
* [[vac/dst/analysis-shadow/vac/shadow-basic-simulation|shadow-basic-simulation ]]
* [[vac/dst/analysis-shadow/vac/shadow-gossipsub-analysis|shadow-gossipsub-analysis ]]
### `analysis-shadow:waku:`
* [[vac/dst/analysis-shadow/waku/shadow-waku-relay-analysis|shadow-waku-relay-analysis ]]
### `dr-support:`
* [[roadmap/vac/dst/dr-support/vac/carnot-2-3rds-executable-spec|carnot-2-3rds-executable-spec ]]
### `eng:vac:`
* [[vac/dst/eng/vac/bundle-simulation-data|bundle-simulation-data ]]
### `eng-10ktool:`
* [[vac/dst/eng-10ktool/vac/bandwidth-test|bandwidth-test ]]
* [[vac/dst/eng-10ktool/vac/qos|QoS ]]
* [[vac/dst/eng-10ktool/waku/waku-protocols|waku-protocols ]]

View File

@ -1,42 +0,0 @@
---
title: "Techreport_03"
---
## `vac:dst:wakurtosis:waku:techreport_03`
---
```mermaid
%%{
init: {
'theme': 'base',
'themeVariables': {
'primaryColor': '#BB2528',
'primaryTextColor': '#fff',
'primaryBorderColor': '#7C0000',
'lineColor': '#F8B229',
'secondaryColor': '#006100',
'tertiaryColor': '#fff'
}
}
}%%
gantt
tickInterval 1month
dateFormat YYYY-MM-DD
section Status
Techreport_02: done, 2023-09-01, 2023-09-30
```
- status: 70%
- CC: Jordi
### Description
Add runs with 0msg/s to isolate the effect of discv5.
### Justification
### Deliverables
* techreport addendum