mirror of https://github.com/logos-co/roadmap.git
99 lines
4.6 KiB
Markdown
99 lines
4.6 KiB
Markdown
|
---
|
||
|
|
title: 2024-02-12 Codex Weekly
|
||
|
|
tags:
|
||
|
|
- codex-updates
|
||
|
|
date: 2024-02-12
|
||
|
|
lastmod: 2024-02-12
|
||
|
|
draft: false
|
||
|
|
description: Weekly update of Codex
|
||
|
|
---
|
||
|
|
|
||
|
|
# Codex Update Feb 6th - Feb 12th
|
||
|
|
|
||
|
|
> The Codex team continues to make progress with various initiatives to wrap up the demo for the Q1/Q2 public testnet release. An internal testnet has been running for the past few weeks and has been used to test the latest version of Codex and can be accessed using the [Codex Testnet Starter](https://github.com/codex-storage/codex-testnet-starter) documentation.
|
||
|
|
>
|
||
|
|
> Ongoing and new lines of research and development will soon begin in preparation for the next version of Codex that will be used for the mainnet release.. Here are the updates from different team members and their ongoing work.
|
||
|
|
Development is currently broken into three distinct teams:
|
||
|
|
|
||
|
|
1. Client, Testing, and Infrastructure
|
||
|
|
2. Marketplace
|
||
|
|
3. Research
|
||
|
|
|
||
|
|
The different teams have actively moving on various fronts. The following are their team updates to various ongoing Epics.
|
||
|
|
|
||
|
|
## Client, Testing and Infrastructure
|
||
|
|
|
||
|
|
### Epic: Nim Improvements
|
||
|
|
Completed:
|
||
|
|
- [Add Nim-matrix workflow to run on merge queue](<https://github.com/codex-storage/nim-codex/pull/693>)
|
||
|
|
- [changes to build improvements proposal so default version for the compiler is now represented as special version `repo_version` which can be accessed locally and in CI](https://github.com/codex-storage/nim-codex/pull/673/commits/f92d069d82741bb6ae5f51574f7610d79566cc78)
|
||
|
|
|
||
|
|
Ongoing:
|
||
|
|
- [Nim memory profiler](https://github.com/codex-storage/nim-chroprof)
|
||
|
|
|
||
|
|
### Epic: Wiring the Proving System
|
||
|
|
Completed:
|
||
|
|
- [Integrated zk verifier into nim-codex](https://github.com/codex-storage/nim-codex/pull/683)
|
||
|
|
|
||
|
|
Ongoing:
|
||
|
|
- [Started reviewing the Circom circuit](https://github.com/codex-storage/codex-storage-proofs-circuits/pull/5)
|
||
|
|
|
||
|
|
### Epic: Improve Client Stability
|
||
|
|
Completed:
|
||
|
|
- Two PRs for testing framework (one [PR #93](https://github.com/codex-storage/cs-codex-dist-tests/pull/93), and one [PR #94](https://github.com/codex-storage/cs-codex-dist-tests/pull/94))
|
||
|
|
|
||
|
|
|
||
|
|
Ongoing:
|
||
|
|
- Run Continuous-Test outside of the cluster to reproduce 'file size issue'
|
||
|
|
|
||
|
|
### Epic: Infra
|
||
|
|
Ongoing:
|
||
|
|
- [Create Codex Helm chart](<https://github.com/codex-storage/infra-codex/issues/58>)
|
||
|
|
- [Deploy Codex Storage nodes in Testnet cluster #115](<https://github.com/codex-storage/infra-codex/issues/115>)
|
||
|
|
- Tracking down the timeout issues in Codex
|
||
|
|
- [Updates to logtools](https://github.com/codex-storage/logtools)
|
||
|
|
- Now understand what deploy IDs and test runs are ([4 min video here](https://vimeo.com/911297714/5afc6e0056));
|
||
|
|
- [Worked on the block flow tracker](https://github.com/gmega/blockexc-parser)
|
||
|
|
|
||
|
|
|
||
|
|
## Marketplace
|
||
|
|
|
||
|
|
### Epic: End-to-end Testing
|
||
|
|
Completed:
|
||
|
|
- [Fixed decoding issue in nim-ethers](https://github.com/codex-storage/nim-ethers/pull/63)
|
||
|
|
- [Workaround for that same decoding issue](https://github.com/codex-storage/codex-contracts-eth/pull/85)
|
||
|
|
- Can't use the fix from nim-ethers yet, Codex is still on old version of chronos
|
||
|
|
- [Published nim-serde](https://github.com/codex-storage/nim-serde)
|
||
|
|
- Finalized `nim-serde` api: now has two main pragmas, `serialize` and `deserialize`, that can be applied at the object-level or field-level:
|
||
|
|
- Each can set `key` (valid at field-level), `ignore` (valid at field-level), and `mode` (valid at object-level)
|
||
|
|
- `mode` can be one of:
|
||
|
|
- OptOut
|
||
|
|
- OptIn
|
||
|
|
- Strict
|
||
|
|
- Many more tests for the `nim-serde` lib — `serialize` `OptIn, OptOut, Strict` and `deserialize` `OptIn, OptOut, Strict`
|
||
|
|
- Added a comprehensive README to nim-serde
|
||
|
|
- Added CI to serde, with branch protection rules on master
|
||
|
|
- Added support for deserializing seq[byte]
|
||
|
|
- Updated `nim-ethers` `json-rpc` and `chronos` upgrade PR to use `nim-serde` instead of the json util. Created the PR https://github.com/codex-storage/nim-ethers/pull/64
|
||
|
|
|
||
|
|
|
||
|
|
Ongoing:
|
||
|
|
- [WIP on finishing the Availabilities API endpoints tweaks](https://github.com/codex-storage/nim-codex/pull/692)
|
||
|
|
- Tried to integrate `nim-serde` in `nim-codex`, but running into symbol clashes with `parseJson`, so changed `parseJson` to `JsonNode.parse`, still needs to be integrated into `nim-codex`
|
||
|
|
|
||
|
|
## Research
|
||
|
|
```
|
||
|
|
2024 R&D Goals
|
||
|
|
1. Proving system and aggregation improvements (folding or lookups)
|
||
|
|
2. Aggregator/validator design
|
||
|
|
3. DHT improvements
|
||
|
|
4. Tokenomics and incentive design
|
||
|
|
5. Bandwidth incentives
|
||
|
|
6. Dynamic data (appendable data)
|
||
|
|
```
|
||
|
|
Completed:
|
||
|
|
- N/A
|
||
|
|
|
||
|
|
Ongoing:
|
||
|
|
- more work on the algebra backend (pairings, APIs)
|
||
|
|
- work towards an independent Groth16 prover (so that we can debug the Nim one) - an initial version of that seems to work now
|