Vac weekly update

This commit is contained in:
ksr 2024-04-02 19:30:11 +02:00
parent b5c73ca3e0
commit 130ce2e6f0
No known key found for this signature in database
GPG Key ID: E4EB341A3BB26FA5
1 changed files with 122 additions and 0 deletions

View File

@ -0,0 +1,122 @@
---
title: "2024-04-02 Vac weekly"
tags:
- "vac-updates"
date: 2024-04-02
lastmod: 2024-04-02
draft: false
---
## Vac 2024/04/02
### vac:p2p:
- `nimlibp2p:vac:webrtc-transport`
- Fix the WebRTC CI on Windows/MacOS
- Mbed-TLS: improve installation/code generation
- Address all the comments on UDP
- `nimlibp2p:vac:gossipsub-stagger-send`
- Bump libp2p and fix compilation issue - https://github.com/status-im/nimbus-eth2/pull/6132
- Bump libp2p and use new gossipsup constructor - https://github.com/status-im/nimbus-eth2/pull/6148
- `nimlibp2p:vac:maintenance`
- Reviewing PRs
### vac:tke:
- `waku:general-incentives`
- Possibly continuing marketplace discussion with Waku (Martin)
- `waku:rln-membership:`
- Working on the proposal for RLN design (Martin)
- `status:SNT-staking`
- Supporting the SC team ad hoc (Martin)
- Discussing using the staking contract at the org level (Martin)
- `status:L2-deployment`
- Further research into airdrop and incentive strategies of existing L2s (Martin)
- `nomos:mixnet-incentives`
- adjusted pricing function to account for measurement costs (Frederico)
- verified that the modifications of the reward split scheme are correct (Frederico)
- `nomos:cryptarchia-wealth-concentration-estimated-stake`
- reviewed blog posts (Frederico)
- `codex:cdx`
- reviewed latest marketplace proposal (Fred
### vac:dst:
- `eng-10ktool:vac:bandwidth-test`
- Delayed simulations.
- Finished plotter module tests ready to review (https://github.com/vacp2p/10ksim/pull/19)
- Finished data class, related PR already merged (https://github.com/vacp2p/10ksim/pull/16)
- Improvements for scrapping, related and merged PRs (https://github.com/vacp2p/10ksim/pull/17 and https://github.com/vacp2p/10ksim/pull/18)
- Investigate attacknet (https://twitter.com/ethPandaOps/status/1769773689979974006)
- `eng-10ktool:vac:bandwidth-test`
- Many many fixes to get Kubernetes with OpenvSwitch + offloading + VMs working
- Reinstalled 3 nodes with new Debian + Proxmox flavour
- Installed Mellanox OFED drivers
- Experimented with VirtIO network, managed to eventually get SR-IOV and Virtual Functions working
- Waku - Benchmarked 1-worker (one worker as one eighth of a 64 core node) cluster
- Indications are we can scale to ~14k nodes if scaling is linear, vs CPU usage observed on 1-worker
- Had 243 Waku nodes, including publishing, running on the worker or 1/8th node with headroom to spare
- Network offloading appears to about 2x as efficient CPU wise when running Waku
- Further fixes for offloading setup once SR-IOV was working
- Waku - Reinstalled 24 workers, then wiped them all and reinstalled 8 of them :(
- Diagnosed incredibly complicated packet loss issues (which turned out to be caused by cloned VMs - note to self - clean up /etc/machine-id next time!)
- Waku - Benchmarked 8-worker cluster (1 physical 64-core), scaled to 1200 nodes, hit major issue with Calico
- Documented here - https://github.com/projectcalico/calico/issues/8676
- Added caching to Harbor, further investigated removing Harbor rate limits
- Discovered that adding multiple jobservice workers to Harbor makes rate limits higher
- Deployed 6 jobservice workers in Harbor
- Removed Vaxis and Nia from Kubernetes to help with CPU accounting since they host worker VMs
### vac:qa:
- `waku:test-automation-sharding`
- Sharding [interop tests](https://github.com/waku-org/waku-interop-tests/pull/24)(@Florin)
- Added around 70 new tests so far
- Issues found:
- node crashes when there are many flags to the docker [start command](https://github.com/waku-org/nwaku/issues/2550)(@Florin)
- node can be started on [multiple clusters](https://github.com/waku-org/nwaku/issues/2552)(@Florin)
- all REST API calls return 200 with [empty response](https://github.com/waku-org/go-waku/issues/1074)(@Florin)
- Sharding [tests update](https://github.com/waku-org/go-waku/pull/1060)(@Roman)
- Closed issue: [data race occurs when publishing to unsubscribed pubSubTopic](https://github.com/waku-org/go-waku/issues/1070)(@Roman)
- `waku:test-automation-go-waku`
- Merged Discv5 [PR](https://github.com/waku-org/go-waku/pull/1051)(@Roman)
- Closed issue: [race condition while setting boot nodes for Discv5](https://github.com/waku-org/go-waku/issues/1059)(@Roman)
- `waku:test-automation-nwaku`
- Peer & Communication Management(@Alex)
- Continue implementing tests
- Found a couple weird behaviours
### vac:acz:
- `secure-channels:waku:ethereum-chat`
- Finish the examination DCGKA ref implementation [repo](https://github.com/trvedata/key-agreement)
- Started to write a report about the examination of vector clocks used in DCGKA ref implementation
- Checked that there is the motivation why we chose DCGKA in [rfc](https://github.com/vacp2p/rfc-index/blob/ETH-SECPM-DEC/vac/raw/Decentralized%20messaging%20Ethereum.md)
- `zerokit:vac:maintenance`
- github removed semaphore commit we used, was fixing CI issue
### vac:sc::
### vac:rfc:
- - `vac:rfc-process-update`
- Worked on workflow to sync rfc website - https://github.com/vacp2p/rfc-index/pull/29
- Added some format changes to eth-secpm-dec - https://github.com/vacp2p/rfc-index/pull/28
- Rfc-website is ready - https://github.com/vacp2p/rfc-website/tree/mas
### vac:dr:
- `unstructured-p2p-improvements-survey`
- Looked into different aspects of libp2p specifications (including gossipsub versions and corresponding discussions). Also looked into the corresponding nim-libp2p works.
- Followed discussions/PRs on libp2p specs and libp2p implementations
### vac:nes:
- `state-separation:vac:state-separation-doc`
- Refined the State Separation PDAGs doc and add changes together with Ugur (Moudy + Ugur)
- Worked on gathering important components for state separation (Moudy)
- Researched and identified accumulators/nullifiers to integrate (Moudy)
- Discussed monitoring with Moudy, and continued with [monitoring](https://www.notion.so/Nescience-cd358fe429b14fa2ab38ca42835a8451?pvs=4#26df10f045fb4c6683cbce362095a303) (Marvin + Moudy)
- Discussed with Moudy about [PDAG report](https://www.notion.so/Nescience-cd358fe429b14fa2ab38ca42835a8451?pvs=4#4a32272ca966467d8cd46833bedaafd0) and next version of proposal on state-separation (Ugur + Moudy)
- Started to write a draft of the next version of proposal on state-separation (Ugur)
- Read about mutator set including Merkle Mountain Range and Bloom filters (Ugur)
- `proofsystems:vac:research-existing-proof-systems`
- check out [Sirius docs](https://github.com/snarkify/sirius) (Rostyslav)
- started writing [LatticeFold writeup](https://eprint.iacr.org/2024/257.pdf) (Rostyslav)
- Work on write up for [Mangrove](https://eprint.iacr.org/2024/416) (Marvin)
- `proofsystems:vac:benchmarks`
- Kept working on the paper since new findings are arising (i.e. Nova Scotia not using Groth16) (Moudy)
- Conducted server testing (Rostyslav)