From 19ee92d36ea84f2bb440845f7765bbdd75938aee Mon Sep 17 00:00:00 2001 From: jessiebroke <18238304+jessiebroke@users.noreply.github.com> Date: Mon, 29 Jan 2024 04:09:39 -0500 Subject: [PATCH] add weekly Codex update 1/29 --- content/codex/updates/2024-01-22.md | 5 +- content/codex/updates/2024-01-29.md | 94 +++++++++++++++++++++++++++++ 2 files changed, 97 insertions(+), 2 deletions(-) create mode 100644 content/codex/updates/2024-01-29.md diff --git a/content/codex/updates/2024-01-22.md b/content/codex/updates/2024-01-22.md index d41d2aa8f..ecf304cf7 100644 --- a/content/codex/updates/2024-01-22.md +++ b/content/codex/updates/2024-01-22.md @@ -53,7 +53,6 @@ The different teams have actively moving on various fronts. The following are th - Add node storage information - Upload page updates periodically - Change error messages to appear below input area instead of an alert - - [Finish the Github Workflow to compile, build and setup the circuit with included generated proof for testing](https://github.com/codex-storage/codex-storage-proofs-circuits/actions/workflows/generate.yml) - Initial work on integration of the verifier into smart-contract suite, with passing storage proof tests - Rebase [nim-ethers to the latest version, 0.7.1](https://github.com/codex-storage/nim-codex/pull/664) @@ -79,13 +78,15 @@ The different teams have actively moving on various fronts. The following are th ## Research -### 2024 R&D Goals +``` +2024 R&D Goals 1. Proving system and aggregation improvements (folding or lookups) 2. Aggregator/validator design 3. DHT improvements 4. Tokenomics and incentive design 5. Bandwidth incentives 6. Dynamic data (appendable data) +``` - Completed: - Debug Groth16 implementation, discovered local bug in [constantine], made a CLI interface (+other improvements) for the Groth16 prover - Research and solve puzzles for ZK hack IV kickoff diff --git a/content/codex/updates/2024-01-29.md b/content/codex/updates/2024-01-29.md new file mode 100644 index 000000000..0bc79ea42 --- /dev/null +++ b/content/codex/updates/2024-01-29.md @@ -0,0 +1,94 @@ +--- +title: 2024-01-29 Codex Weekly +tags: + - codex-updates +date: 2024-01-29 +lastmod: 2024-01-29 +draft: false +description: Weekly update of Codex +--- + +# Codex Update Jan 22nd - Jan 29th + +> The Codex team continues to make progress with various initiatives to wrap up the demo for the Q1/Q2 public testnet release. An internal testnet has been running for the past few weeks and has been used to test the latest version of Codex and can be accessed using the [Codex Testnet Starter](https://github.com/codex-storage/codex-testnet-starter) documentation. + +> Ongoing and new lines of research and development will soon begin in preparation for the next version of Codex that will be used for the mainnet release.. Here are the updates from different team members and their ongoing work. + +Development is currently broken into three distinct teams: + +1. Client, Testing, and Infrastructure +2. Marketplace +3. Research + +The different teams have actively moving on various fronts. The following are their team updates to various ongoing Epics. + +## Client + +### Epic: Nim Improvements +- Completed: + - [Filed Atlas issue to restore handling forked repos](https://github.com/nim-lang/atlas/issues/103) + - [Filed Atlas issue for handling "vendoring" style setups](https://github.com/nim-lang/atlas/issues/104) +- Ongoing: + - [Review Atlas graph updates and contribute](https://github.com/nim-lang/atlas/issues/107) + +### Epic: Wiring the Proving System +- Completed: +- Ongoing: + - [Dataset expiry](https://github.com/codex-storage/nim-codex/pull/678) + - Update DataSampler to match updated SlotBuilder + - Investigate: way to run codex tests through valgrind or similar tool + - Integrate DataSampler in Marketplace callbacks + +### Epic: Improve Client Stability +- Completed: +- Ongoing: + - [Contibue rebasing of unmerged Chronos V4 PR and build improvements PR + fixes to initial idea on builds](https://github.com/codex-storage/nim-codex/pull/680) + - [Continue work on asynctest branch](https://github.com/codex-storage/nim-codex/pull/671) + - [Bug-fixing to track down the "file sizes differ" bug]() + - [Other bugs to be fixed](https://github.com/codex-storage/nim-codex/issues/685) + + +## Marketplace + +### Epic: End-to-end Testing +- Completed: + - [Fix tests and replcae GPL licensed ZK verifier w/ MIT version that take JSON output from Circom in contract](https://github.com/codex-storage/codex-contracts-eth/pull/79) + - [Add formatting check to CI in codex-contracts-eth repo](https://github.com/codex-storage/codex-contracts-eth/pull/80) + - [Rebase Marketplace integration test refactor with erasure coding changes](https://github.com/codex-storage/nim-codex/pull/662) + - +- Ongoing: + - [Persistent Availabilities](https://github.com/codex-storage/nim-codex/issues/467) + - [Design Plan](https://github.com/codex-storage/nim-codex/issues/467#issuecomment-1894115147) + - [Add duration to Codex frontend](https://github.com/codex-storage/codex-frontend/commit/bd2d2befbcee88b734ece774856436732f70875c) + - [Added a calendar for the expiry of creating ROSC's](https://github.com/codex-storage/codex-frontend/commit/bf6cc85d55ce54588d8f20a39c9e96e243de13b3) + - Work to add ceremony files to Codex + - [Ceremony file distribution](https://github.com/codex-storage/codex-storage-proofs-circuits/pull/3) + - [Add Ceremony file hash to Marketplace's Contract configuration](https://github.com/codex-storage/codex-storage-proofs-circuits/pull/4) + - [Add support to retrieve Ceremony file hash from Contract's configuration](https://github.com/codex-storage/nim-codex/pull/684) + - [Add support for Ceremony file hash download from S3](https://github.com/codex-storage/codex-contracts-eth/pull/81/files) + - Continue work on updating nim-ethers to support JSON-RPC breaking changes and pulling out utils/json to its own library + +## Infra + +- Completed: + - [Deploy a site to store circuit ceremony files](https://github.com/codex-storage/infra-codex/issues/122) + - [Automate Codex ceremony files upload to Cloudflare R2 using GitHub Actions](https://github.com/codex-storage/infra-codex/issues/123) +- Ongoing: + - [Create Codex Helm chart](https://github.com/codex-storage/infra-codex/issues/58) + - [Deploy Codex Storage nodes in Testnet cluster](https://github.com/codex-storage/infra-codex/issues/115) + +## Research +``` +2024 R&D Goals +1. Proving system and aggregation improvements (folding or lookups) +2. Aggregator/validator design +3. DHT improvements +4. Tokenomics and incentive design +5. Bandwidth incentives +6. Dynamic data (appendable data) +``` +- Completed: + - Implement G2 curves (so most building blocks are now in place in my algebra backend to be able to experiment + - Review work from Hashcloak collaboration for zk backend benchmarking test suite +- Ongoing: + - New proof system design proposal \ No newline at end of file