mirror of https://github.com/logos-co/roadmap.git
weeklies up to 08-14
This commit is contained in:
parent
2b62ed7709
commit
8aa23a49f9
|
|
@ -0,0 +1,81 @@
|
|||
---
|
||||
title: "2023-08-11 Codex weekly"
|
||||
tags:
|
||||
- "codex-updates"
|
||||
date: 2023-08-11
|
||||
lastmod: 2023-08-17
|
||||
draft: false
|
||||
---
|
||||
|
||||
|
||||
# Codex update August 11
|
||||
|
||||
---
|
||||
## Client
|
||||
|
||||
### Milestone: Merkelizing block data
|
||||
|
||||
- Initial Merkle Tree implementation - https://github.com/codex-storage/nim-codex/pull/504
|
||||
- Work on persisting/serializing Merkle Tree is underway, PR upcoming
|
||||
|
||||
### Milestone: Block discovery and retrieval
|
||||
|
||||
- Continued analysis of block discovery and retrieval - https://hackmd.io/_KOAm8kNQamMx-lkQvw-Iw?both=#fn5
|
||||
- Reviewing papers on peers sampling and related topics
|
||||
- [Wormhole Peer Sampling paper](http://publicatio.bibl.u-szeged.hu/3895/1/p2p13.pdf)
|
||||
- [Smoothcache](https://dl.acm.org/doi/10.1145/2713168.2713182)
|
||||
- Starting work on simulations based on the above work
|
||||
|
||||
### Milestone: Distributed Client Testing
|
||||
|
||||
- Continuing working on log collection/analysis and monitoring
|
||||
- Details here https://github.com/codex-storage/cs-codex-dist-tests/pull/41
|
||||
- More related issues/PRs:
|
||||
- https://github.com/codex-storage/infra-codex/pull/20
|
||||
- https://github.com/codex-storage/infra-codex/pull/20
|
||||
- Testing and debugging Condex in continuous testing environment
|
||||
- Debugging continuous tests [cs-codex-dist-tests/pull/44](https://github.com/codex-storage/cs-codex-dist-tests/pull/44)
|
||||
- pod labeling [cs-codex-dist-tests/issues/39](https://github.com/codex-storage/cs-codex-dist-tests/issues/39)
|
||||
|
||||
---
|
||||
## Infra
|
||||
|
||||
### Milestone: Kubernetes Configuration and Management
|
||||
- Move Dist-Tests cluster to OVH and define naming conventions
|
||||
- Configure Ingress Controller for Kibana/Grafana
|
||||
- **Create documentation for Kubernetes management**
|
||||
- **Configure Dist/Continuous-Tests Pods logs shipping**
|
||||
|
||||
### Milestone: Continuous Testing and Labeling
|
||||
- Watch the Continuous tests demo
|
||||
- Implement and configure Dist-Tests labeling
|
||||
- Set up logs shipping based on labels
|
||||
- Improve Docker workflows and add 'latest' tag
|
||||
|
||||
### Milestone: CI/CD and Synchronization
|
||||
- Set up synchronization by codex-storage
|
||||
- Configure Codex Storage and Demo CI/CD environments
|
||||
|
||||
---
|
||||
## Marketplace
|
||||
|
||||
### Milestone: L2
|
||||
|
||||
- Taiko L2 integration
|
||||
- Done but merge is blocked by a few issues - https://github.com/codex-storage/nim-codex/pull/483
|
||||
|
||||
### Milestone: Marketplace Sales
|
||||
|
||||
- Lots of cleanup and refactoring
|
||||
- Finished refactoring state machine PR [link](https://github.com/codex-storage/nim-codex/pull/469)
|
||||
- Added support for loading node's slots during Sale's module start [link](https://github.com/codex-storage/nim-codex/pull/510)
|
||||
|
||||
---
|
||||
## DAS
|
||||
|
||||
### Milestone: DHT simulations
|
||||
|
||||
- Implementing a DHT in Python for the DAS simulator - https://github.com/cortze/py-dht.
|
||||
|
||||
|
||||
NOTE: Several people are/where out during the last few weeks, so some milestones are paused until they are back
|
||||
|
|
@ -0,0 +1,47 @@
|
|||
---
|
||||
title: "2023-08-17 Nomos weekly"
|
||||
tags:
|
||||
- "nomos-updates"
|
||||
date: 2023-08-14
|
||||
lastmod: 2023-08-17
|
||||
draft: false
|
||||
---
|
||||
|
||||
|
||||
# **Nomos weekly report 14th August**
|
||||
---
|
||||
|
||||
## **Network Privacy and Mixnet**
|
||||
|
||||
### Research
|
||||
- Mixnet architecture discussions. Potential agreement on architecture not very different from PoC
|
||||
- Mixnet preliminary design [https://www.notion.so/Mixnet-Architecture-613f53cf11a245098c50af6b191d31d2]
|
||||
### Development
|
||||
- Mixnet PoC implementation starting [https://github.com/logos-co/nomos-node/pull/302]
|
||||
- Implementation of mixnode: a core module for implementing a mixnode binary
|
||||
- Implementation of mixnet-client: a client library for mixnet users, such as nomos-node
|
||||
|
||||
### **Private PoS**
|
||||
- No progress this week.
|
||||
|
||||
---
|
||||
## **Data Availability**
|
||||
### Research
|
||||
- Continued analysis of node decay in data availability problem
|
||||
- Improved upper bound on the probability of the event that data is no longer available given by the (K,N) erasure ECC scheme [https://www.overleaf.com/read/gzqvbbmfnxyp]
|
||||
|
||||
### Development
|
||||
- Library survey: Library used for the benchmarks is not yet ready for requirements, looking for alternatives
|
||||
- RS & KZG benchmarking for our use case https://www.notion.so/2D-Reed-Solomon-Encoding-KZG-Commitments-benchmarking-b8340382ecc741c4a16b8a0c4a114450
|
||||
- Study documentation on Danksharding and set of questions for Leonardo [https://www.notion.so/2D-Reed-Solomon-Encoding-KZG-Commitments-benchmarking-b8340382ecc741c4a16b8a0c4a114450]
|
||||
|
||||
---
|
||||
## **Testing, CI and Simulation App**
|
||||
|
||||
### Development
|
||||
- Sim fixes/improvements [https://github.com/logos-co/nomos-node/pull/299], [https://github.com/logos-co/nomos-node/pull/298], [https://github.com/logos-co/nomos-node/pull/295]
|
||||
- Simulation app and instructions shared [https://github.com/logos-co/nomos-node/pull/300], [https://github.com/logos-co/nomos-node/pull/291], [https://github.com/logos-co/nomos-node/pull/294]
|
||||
- CI: Updated and merged [https://github.com/logos-co/nomos-node/pull/290]
|
||||
- Parallel node init for improved simulation run times [https://github.com/logos-co/nomos-node/pull/300]
|
||||
- Implemented branch overlay for simulating 100K+ nodes [https://github.com/logos-co/nomos-node/pull/291]
|
||||
- Sequential builds for nomos node features updated in CI [https://github.com/logos-co/nomos-node/pull/290]
|
||||
|
|
@ -0,0 +1,97 @@
|
|||
---
|
||||
title: "2023-08-17 Vac weekly"
|
||||
tags:
|
||||
- "vac-updates"
|
||||
date: 2023-08-14
|
||||
lastmod: 2023-08-17
|
||||
draft: false
|
||||
---
|
||||
|
||||
|
||||
Vac Milestones: https://www.notion.so/Vac-Roadmap-907df7eeac464143b00c6f49a20bb632
|
||||
|
||||
# Vac week 33 August 14th
|
||||
|
||||
---
|
||||
## *vsu::P2P*
|
||||
### `vac:p2p:nim-libp2p:vac:maintenance`
|
||||
- Improve gossipsub DDoS resistance https://github.com/status-im/nim-libp2p/pull/920
|
||||
- delivered: Perf protocol https://github.com/status-im/nim-libp2p/pull/925
|
||||
- delivered: Test-plans for the perf protocol https://github.com/lchenut/test-plans/tree/perf-nim
|
||||
- Bandwidth estimate as a parameter (waiting for final review) https://github.com/status-im/nim-libp2p/pull/941
|
||||
### `vac:p2p:nim-chronos:vac:maintenance`
|
||||
- delivered: Remove hard-coded ports from test https://github.com/status-im/nim-chronos/pull/429
|
||||
- delivered: fixed flaky test using REUSE_PORT https://github.com/status-im/nim-chronos/pull/438
|
||||
|
||||
---
|
||||
## *vsu::Tokenomics*
|
||||
- admin/misc:
|
||||
- (5 CC days off)
|
||||
### `vac:tke::codex:economic-analysis`
|
||||
- Filecoin economic structure and Codex token requirements
|
||||
### `vac:tke::status:SNT-staking`
|
||||
- tests with the contracts
|
||||
### `vac:tke::nomos:economic-analysis`
|
||||
- resume discussions with Nomos team
|
||||
|
||||
---
|
||||
## *vsu::Distributed Systems Testing (DST)*
|
||||
### `vac:dst:wakurtosis:waku:techreport`
|
||||
- 1st Draft of Wakurtosis Research Blog (https://github.com/vacp2p/vac.dev/pull/123)
|
||||
- Data Process / Analysis of Non-Discv5 K13 Simulations (Wakurtosis Tech Report v2.5)
|
||||
### `vac:dst:shadow:vac:basic-shadow-simulation`
|
||||
- Basic Shadow Simulation of a gossipsub node (Setup, 5nodes)
|
||||
### `vac:dst:10ksim:vac:10ksim-bandwidth-test`
|
||||
- Try and plan on how to refactor/generalize testing tool from Codex.
|
||||
- Learn more about Kubernetes
|
||||
### `vac:dst:wakurtosis:nomos:ci-integration_02`
|
||||
- Enable subnetworks
|
||||
- Plan how to use wakurtosis with fixed version
|
||||
### `vac:dst:eng:vac:bundle-simulation-data`
|
||||
- Run requested simulations
|
||||
|
||||
---
|
||||
## *vsu:Smart Contracts (SC)*
|
||||
### `vac:sc::vac:secureum-upskilling`
|
||||
- Learned about
|
||||
- cold vs warm storage reads and their gas implications
|
||||
- UTXO vs account models
|
||||
- `DELEGATECALL` vs `CALLCODE` opcodes, `CREATE` vs `CREATE2` opcodes; Yul Assembly
|
||||
- Unstructured proxies https://eips.ethereum.org/EIPS/eip-1967
|
||||
- C3 Linearization https://forum.openzeppelin.com/t/solidity-diamond-inheritance/2694) (Diamond inheritance and resolution)
|
||||
- Uniswap deep dive
|
||||
- Finished Secureum slot 2 and 3
|
||||
### `vac:sc::vac:maintainance/misc`
|
||||
- Introduced Vac's own `foundry-template` for smart contract projects
|
||||
- Goal is to have the same project structure across projects
|
||||
- Github repository: https://github.com/vacp2p/foundry-template
|
||||
|
||||
---
|
||||
## *vsu:Applied Cryptogarphy & ZK (ACZ)*
|
||||
- `vac:acz:zerokit:vac:maintenance`
|
||||
- PR reviews https://github.com/vacp2p/zerokit/pull/200, https://github.com/vacp2p/zerokit/pull/201
|
||||
|
||||
---
|
||||
## *vip::zkVM*
|
||||
### `vac:zkvm::vac:research-existing-proof-systems`
|
||||
- delivered Nescience WIP doc
|
||||
- delivered FHE review
|
||||
- delivered Nova vs Sangria done - Some discussions during the meeting
|
||||
- started HyperNova writeup
|
||||
- started writing a trimmed version of FHE writeup
|
||||
- researched CCS (for HyperNova)
|
||||
- Research Protogalaxy https://eprint.iacr.org/2023/1106 and Protostar https://eprint.iacr.org/2023/620.
|
||||
### `vac:zkvm::vac:proof-system-benchmarks`
|
||||
- More work on benchmarks is ongoing
|
||||
- Putting down a document that explains the differences
|
||||
|
||||
---
|
||||
## *vc::Deep Research*
|
||||
### `vac:dr:valpriv:vac:tor-push-poc`
|
||||
- revised the code for PR
|
||||
### `vac:dr:valpriv:vac:tor-push-relwork`
|
||||
- added section for mixnet, non-Tor/non-onion routing-based anonymity network
|
||||
### `vac:dr:gsub-scaling:vac:gossipsub-simulation`
|
||||
- Used shadow simulator to run first GossibSub simulation
|
||||
### `vac:dr:gsub-scaling:vac:gossipsub-improvements-tech-report`
|
||||
- Finalized 1st draft of the GossipSub scaling article
|
||||
|
|
@ -5,5 +5,12 @@ lastmod: "2023-08-07"
|
|||
draft: false
|
||||
---
|
||||
|
||||
- [Waku Network support for 10k users](roadmap/waku/milestone-waku-10-users.md)
|
||||
-
|
||||
- 90% - [Waku Network support for 10k users](roadmap/waku/milestone-waku-10-users.md)
|
||||
- 80% - Waku Network support for 1MM users
|
||||
- 65% - Restricted-run (light node) protocols are production ready
|
||||
- 60% - Peer management strategy for relay and light nodes are defined and implemented
|
||||
- 10% - Quality processes are implemented for `nwaku` and `go-waku`
|
||||
- 80% - Define and track network and community metrics for continuous monitoring improvement
|
||||
- 20% - Executed an array of community growth activity (8 hackathons, workshops, and bounties)
|
||||
- 15% - Dogfooding of RLN by platforms has started
|
||||
- 06% - First protocol to incentivize operators has been defined
|
||||
|
|
@ -0,0 +1,103 @@
|
|||
---
|
||||
title: "2023-08-14 Waku weekly"
|
||||
tags:
|
||||
- "waku-updates"
|
||||
date: 2023-08-14
|
||||
lastmod: 2023-08-17
|
||||
draft: false
|
||||
---
|
||||
|
||||
|
||||
# 2023-08-14 Waku weekly
|
||||
---
|
||||
## Epics
|
||||
|
||||
**[Waku Network Can Support 10K Users](https://github.com/waku-org/pm/issues/12)** {E:2023-10k-users}
|
||||
|
||||
All software has been delivered. Pending items are:
|
||||
- Running stress testing on PostgreSQL to confirm performance gain https://github.com/waku-org/nwaku/issues/1894
|
||||
- Setting up a staging fleet for Status to try static sharding
|
||||
- Running simulations for Store protocol: [Will confirm with Vac/DST on dates/commitment](https://github.com/vacp2p/research/issues/191#issuecomment-1672542165) and probably move this to [1mil epic](https://github.com/waku-org/pm/issues/31)
|
||||
|
||||
---
|
||||
## Eco Dev
|
||||
|
||||
**[Aug 2023](https://github.com/waku-org/internal-waku-outreach/issues/103)** {E:2023-eco-growth}
|
||||
|
||||
- _achieved_: web3conf talk, swags, 2 side events, twitter promotions, requested for marketing collateral to commshub
|
||||
- _next_: complete waku metrics, coordinate events with Lou, ethsafari planning, muchangmai planning
|
||||
- _blocker_: was blocked on infra for hosting nextjs app for waku metrics but migrating to SSR and hosting on vercel
|
||||
|
||||
---
|
||||
## Docs
|
||||
|
||||
**[Advanced docs for js-waku](https://github.com/waku-org/docs.waku.org/issues/104)**
|
||||
|
||||
- _next_: document notes/recommendations for NodeJS, begin docs on `js-waku` encryption
|
||||
|
||||
---
|
||||
## nwaku
|
||||
|
||||
**[Release Process Improvements](https://github.com/waku-org/nwaku/issues/1889)** {E:2023-qa}
|
||||
|
||||
- _achieved_: minor CI fixes and improvements
|
||||
- _next_: document how to run PR built images in waku-simulator, adding Linux arm64 binaries and images
|
||||
|
||||
**[PostgreSQL](https://github.com/waku-org/nwaku/issues/1888)** {E:2023-10k-users}
|
||||
|
||||
- _achieved_: Learned that the insertion rate is constrained by the `relay` protocol. i.e. the maximum insert rate is limited by `relay` so I couldn't push the "insert" operation to a limit from a _Postgres_ point of view. For example, if 25 clients publish messages concurrently, and each client publishes 300 msgs, all the messages are correctly stored. If repeating the same operation but with 50 clients, then many messages are lost because the _relay_ protocol doesn't process all of them.
|
||||
- _next_: Carry on with stress testing. Analyze the performance differences between _Postgres_ and _SQLite_ regarding the _read_ operations.
|
||||
|
||||
**[Autosharding v1](https://github.com/waku-org/nwaku/issues/1846)** {E:2023-1mil-users}
|
||||
|
||||
- _achieved_: many feedback/update cycles for FILTER, LIGHTPUSH, STORE & RFC
|
||||
- _next_: updating ENR for live subscriptions
|
||||
|
||||
**[HTTP REST API: Store, Filter, Lightpush, Admin and Private APIs](https://github.com/waku-org/nwaku/issues/1076)** {E:2023-many-platforms}
|
||||
|
||||
- _achieved_: Legacy Filter - v1 - interface Rest Api support added.
|
||||
- _next_: Extend Rest Api interface for new v2 filter. Get v2 filter service supported from node. Add more tests.
|
||||
|
||||
---
|
||||
## js-waku
|
||||
|
||||
**[Maintenance](https://github.com/waku-org/js-waku/issues/1455)** {E:2023-qa}
|
||||
|
||||
- achieved: upgrade libp2p & chainsafe deps to libp2p 0.46.3 while removing deprecated libp2p standalone interface packages (new breaking change libp2p w/ other deps), add tsdoc for referenced types, setting up/fixing prettier/eslint conflict
|
||||
|
||||
**[Developer Experience (2023)](https://github.com/waku-org/js-waku/issues/1453)** {E:2023-eco-growth}
|
||||
|
||||
- _achieved_: non blocking pipeline step (https://github.com/waku-org/js-waku/issues/1411)
|
||||
|
||||
**[Peer Exchange is supported and used by default](https://github.com/waku-org/js-waku/issues/1429)** {E:2023-light-protocols}
|
||||
|
||||
- _achieved_: close the "fallback mechanism for peer rejections", refactor peer-exchange compliance test
|
||||
- _next_: peer-exchange to be included with default discovery, action peer-exchange browser feedback
|
||||
|
||||
---
|
||||
## go-waku
|
||||
|
||||
**[Maintenance](https://github.com/waku-org/go-waku/issues/634)** {E:2023-qa}
|
||||
|
||||
- _achieved_: improved keep alive logic for identifying if machine is waking up; added vacuum feature to sqlite and postgresql; made migrations optional; refactored db and migration code, extracted code to generate node key to its own separate subcommand
|
||||
|
||||
**[C-Bindings Improvement: Callbacks and Duplications](https://github.com/waku-org/go-waku/issues/629)** {E:2023-many-platforms}
|
||||
|
||||
- _achieved_: PR for updating the RFC to use callbacks, and refactored the encoding functions
|
||||
|
||||
**[Improve Test Coverage](https://github.com/waku-org/go-waku/issues/620)** {E:2023-qa}
|
||||
|
||||
- _achieved_: Fixed issues reported by the data race detector tool.
|
||||
- _next_: identify areas where test coverage needs improvement.
|
||||
|
||||
**[RLN: Post-Testnet3 Improvements](https://github.com/waku-org/go-waku/issues/605)** {E:2023-rln}
|
||||
|
||||
- _achieved_: exposed merkle tree configuration, removed embedded resources from go-zerokit-rln, fixed nwaku / go-waku rlnKeystore compatibility, added merkle tree persistence and modified zerokit to print to stderr any error obtained while executing functions via FFI.
|
||||
- _next_: interop with nwaku
|
||||
|
||||
**[Introduce Peer Management](https://github.com/waku-org/go-waku/issues/594)** {E:2023-peer-mgmt}
|
||||
|
||||
- _achieved_: add service slots to peer manager.
|
||||
- _next_: implement relay connectivity loop, integrate gossipsub scoring for peer disconnections
|
||||
|
||||
---
|
||||
Loading…
Reference in New Issue