From 130ce2e6f061b8f347617fd2d5473f24e102ff35 Mon Sep 17 00:00:00 2001 From: ksr Date: Tue, 2 Apr 2024 19:30:11 +0200 Subject: [PATCH] Vac weekly update --- content/vac/updates/2024-04-02.md | 122 ++++++++++++++++++++++++++++++ 1 file changed, 122 insertions(+) create mode 100644 content/vac/updates/2024-04-02.md diff --git a/content/vac/updates/2024-04-02.md b/content/vac/updates/2024-04-02.md new file mode 100644 index 000000000..ac1d4453a --- /dev/null +++ b/content/vac/updates/2024-04-02.md @@ -0,0 +1,122 @@ +--- +title: "2024-04-02 Vac weekly" +tags: + - "vac-updates" +date: 2024-04-02 +lastmod: 2024-04-02 +draft: false +--- + +## Vac 2024/04/02 + +### vac:p2p: +- `nimlibp2p:vac:webrtc-transport` + - Fix the WebRTC CI on Windows/MacOS + - Mbed-TLS: improve installation/code generation + - Address all the comments on UDP +- `nimlibp2p:vac:gossipsub-stagger-send` + - Bump libp2p and fix compilation issue - https://github.com/status-im/nimbus-eth2/pull/6132 + - Bump libp2p and use new gossipsup constructor - https://github.com/status-im/nimbus-eth2/pull/6148 +- `nimlibp2p:vac:maintenance` + - Reviewing PRs + +### vac:tke: +- `waku:general-incentives` + - Possibly continuing marketplace discussion with Waku (Martin) +- `waku:rln-membership:` + - Working on the proposal for RLN design (Martin) +- `status:SNT-staking` + - Supporting the SC team ad hoc (Martin) + - Discussing using the staking contract at the org level (Martin) +- `status:L2-deployment` + - Further research into airdrop and incentive strategies of existing L2s (Martin) +- `nomos:mixnet-incentives` + - adjusted pricing function to account for measurement costs (Frederico) + - verified that the modifications of the reward split scheme are correct (Frederico) +- `nomos:cryptarchia-wealth-concentration-estimated-stake` + - reviewed blog posts (Frederico) +- `codex:cdx` + - reviewed latest marketplace proposal (Fred + +### vac:dst: +- `eng-10ktool:vac:bandwidth-test` + - Delayed simulations. + - Finished plotter module tests ready to review (https://github.com/vacp2p/10ksim/pull/19) + - Finished data class, related PR already merged (https://github.com/vacp2p/10ksim/pull/16) + - Improvements for scrapping, related and merged PRs (https://github.com/vacp2p/10ksim/pull/17 and https://github.com/vacp2p/10ksim/pull/18) + - Investigate attacknet (https://twitter.com/ethPandaOps/status/1769773689979974006) +- `eng-10ktool:vac:bandwidth-test` + - Many many fixes to get Kubernetes with OpenvSwitch + offloading + VMs working + - Reinstalled 3 nodes with new Debian + Proxmox flavour + - Installed Mellanox OFED drivers + - Experimented with VirtIO network, managed to eventually get SR-IOV and Virtual Functions working + - Waku - Benchmarked 1-worker (one worker as one eighth of a 64 core node) cluster + - Indications are we can scale to ~14k nodes if scaling is linear, vs CPU usage observed on 1-worker + - Had 243 Waku nodes, including publishing, running on the worker or 1/8th node with headroom to spare + - Network offloading appears to about 2x as efficient CPU wise when running Waku + - Further fixes for offloading setup once SR-IOV was working + - Waku - Reinstalled 24 workers, then wiped them all and reinstalled 8 of them :( + - Diagnosed incredibly complicated packet loss issues (which turned out to be caused by cloned VMs - note to self - clean up /etc/machine-id next time!) + - Waku - Benchmarked 8-worker cluster (1 physical 64-core), scaled to 1200 nodes, hit major issue with Calico + - Documented here - https://github.com/projectcalico/calico/issues/8676 + - Added caching to Harbor, further investigated removing Harbor rate limits + - Discovered that adding multiple jobservice workers to Harbor makes rate limits higher + - Deployed 6 jobservice workers in Harbor + - Removed Vaxis and Nia from Kubernetes to help with CPU accounting since they host worker VMs + +### vac:qa: +- `waku:test-automation-sharding` + - Sharding [interop tests](https://github.com/waku-org/waku-interop-tests/pull/24)(@Florin) + - Added around 70 new tests so far + - Issues found: + - node crashes when there are many flags to the docker [start command](https://github.com/waku-org/nwaku/issues/2550)(@Florin) + - node can be started on [multiple clusters](https://github.com/waku-org/nwaku/issues/2552)(@Florin) + - all REST API calls return 200 with [empty response](https://github.com/waku-org/go-waku/issues/1074)(@Florin) + - Sharding [tests update](https://github.com/waku-org/go-waku/pull/1060)(@Roman) + - Closed issue: [data race occurs when publishing to unsubscribed pubSubTopic](https://github.com/waku-org/go-waku/issues/1070)(@Roman) +- `waku:test-automation-go-waku` + - Merged Discv5 [PR](https://github.com/waku-org/go-waku/pull/1051)(@Roman) + - Closed issue: [race condition while setting boot nodes for Discv5](https://github.com/waku-org/go-waku/issues/1059)(@Roman) +- `waku:test-automation-nwaku` + - Peer & Communication Management(@Alex) + - Continue implementing tests + - Found a couple weird behaviours + +### vac:acz: +- `secure-channels:waku:ethereum-chat` + - Finish the examination DCGKA ref implementation [repo](https://github.com/trvedata/key-agreement) + - Started to write a report about the examination of vector clocks used in DCGKA ref implementation + - Checked that there is the motivation why we chose DCGKA in [rfc](https://github.com/vacp2p/rfc-index/blob/ETH-SECPM-DEC/vac/raw/Decentralized%20messaging%20Ethereum.md) +- `zerokit:vac:maintenance` + - github removed semaphore commit we used, was fixing CI issue + +### vac:sc:: + +### vac:rfc: +- - `vac:rfc-process-update` + - Worked on workflow to sync rfc website - https://github.com/vacp2p/rfc-index/pull/29 + - Added some format changes to eth-secpm-dec - https://github.com/vacp2p/rfc-index/pull/28 + - Rfc-website is ready - https://github.com/vacp2p/rfc-website/tree/mas + +### vac:dr: +- `unstructured-p2p-improvements-survey` + - Looked into different aspects of libp2p specifications (including gossipsub versions and corresponding discussions). Also looked into the corresponding nim-libp2p works. + - Followed discussions/PRs on libp2p specs and libp2p implementations + +### vac:nes: +- `state-separation:vac:state-separation-doc` + - Refined the State Separation PDAGs doc and add changes together with Ugur (Moudy + Ugur) + - Worked on gathering important components for state separation (Moudy) + - Researched and identified accumulators/nullifiers to integrate (Moudy) + - Discussed monitoring with Moudy, and continued with [monitoring](https://www.notion.so/Nescience-cd358fe429b14fa2ab38ca42835a8451?pvs=4#26df10f045fb4c6683cbce362095a303) (Marvin + Moudy) + - Discussed with Moudy about [PDAG report](https://www.notion.so/Nescience-cd358fe429b14fa2ab38ca42835a8451?pvs=4#4a32272ca966467d8cd46833bedaafd0) and next version of proposal on state-separation (Ugur + Moudy) + - Started to write a draft of the next version of proposal on state-separation (Ugur) + - Read about mutator set including Merkle Mountain Range and Bloom filters (Ugur) +- `proofsystems:vac:research-existing-proof-systems` + - check out [Sirius docs](https://github.com/snarkify/sirius) (Rostyslav) + - started writing [LatticeFold writeup](https://eprint.iacr.org/2024/257.pdf) (Rostyslav) + - Work on write up for [Mangrove](https://eprint.iacr.org/2024/416) (Marvin) +- `proofsystems:vac:benchmarks` + - Kept working on the paper since new findings are arising (i.e. Nova Scotia not using Groth16) (Moudy) + - Conducted server testing (Rostyslav) +