* Remove chat and dissemination from nomos-cli
* Dissemination using executor http client in nomos-cli
* Blob retrieval from indexer using executor http client
* Range reqeust type from nomos-node
* Split executor and validator commands
* Use executor in tests instead of nomos node
* Executor config from node config
* Bring generics to the testing game
* Fill in missing gaps in test
* Implement testnode wrapper
* Use sleep on dispersal service instead
* Fix cfgsync
* Clippy happy
* Clippy happy tests
* Mixnet config in tests for validator
* Tests: General config and multiple nodes (#832)
* Use executor in tests instead of nomos node
* Bring generics to the testing game
* Fill in missing gaps in test
* Clippy happy
* Mixnet config in tests for validator
* Derive different types of configs from general in tests
* Validator and executor in cfgsync
---------
Co-authored-by: danielSanchezQ <3danimanimal@gmail.com>
* Tests executor node mix config (#834)
* Merge branch 'master' into tests-executor-node-mix-config
* add mix configs
---------
Co-authored-by: danielSanchezQ <3danimanimal@gmail.com>
Co-authored-by: Youngjoon Lee <5462944+youngjoon-lee@users.noreply.github.com>
* Re-structure connection handling properly
* Handle event based connections
* Fix test
* Handling auto reconnection for dispersal behaviour
* Ignore cli test
* Added basic dispersal structure
* Expand impl
* Pull events from network service
* Implement network adapter
Tie types together in service
* Fill up service processing
* Tie up types in kzgrs backend implementation
* Implement disperse
* Pipe encode and dispersal
* Create mempool adapter
* Add mempool adapter
* Tiny comment
* Refactor common things in backends
* Further extract to common
* Extract dial_peers
* Pipe out executor events
* Add wrapper settings
* Dial up dispersal peers
* Clippy happy
* dial_peers -> dial_validator_subnetwork_peers
* Add members list to membership trait
* Implement peers selection and dialing up from specification
* Fix tests
* Fix tiny doc
* Handle replication messages
* Multiple indexes for kzgrs verifier
* Add rocksdb storage to node config
* Configurable delay before sending blob info to mempool
* Dial peers in same subnet for replication
* Update da integration tests
* Update nomos node tests
* Load kzgrs config from file
* SLOW_ENV set true for macos CI
* Assert retrieved blobs in dissemination test
* Kzgrs params deserialize unchecked
* Use common test node in da tests
* Pick ranged subnetids when sampling
* Da network settings for integration tests
* Predefined node keys and deterministic rng
* Disperse kzgrs encoded blob
* Cli swarm fixes
* Increase indexer integration test timeout
* Check dispersal responses in cli da adapter
* DA membership configuration in node tests
* Nomos Cli act as a node in tests
* Increase timeout for dispersal tests
* Different node configurations for da tests
* Collect unique ids for sampling
* Add sampling relay to consensus and massage all generics
* Pipe in sampling filtering of blob info
* Add mark in block
* Pipe validate block
* Refactor mark_in_block -> mark_complete
* Fix generics on tests
* Fix generics on tests
* Fix rebase
* Cargo fmt after rebase
* Sampling service configuration
* Sampling service config in indexer integration tests
---------
Co-authored-by: Gusto <bacvinka@gmail.com>
* initial
* first iteration, lots of lifetime and trait issues, does not compile
* Daniel/sampling service (#706)
* Implement sampling service
* Implement libp2p adapter listen_to_sampling_messages
* temporary empty backend mod; implement start_sampling
* addressed PR comments; moved random sampling subnet list generation to backend (todo impl)
* addressed PR nitpicks
* remove empty mod which was failing CI due to cargo fmt
* removed unused code
---------
Co-authored-by: holisticode <holistic.computing@gmail.com>
Co-authored-by: Daniel Sanchez <sanchez.quiros.daniel@gmail.com>
* Nomos cli executor swarm
* Executor swarm and backend in nomos-cli
* Libp2p executor adapter in nomos cli
* Update nomos-cli/src/da/network/backend.rs
Co-authored-by: Daniel Sanchez <sanchez.quiros.daniel@gmail.com>
* Use FillFromNodeList with executor backend
* Integrate Executor backend into the cli
* Use subnetwork id where appropriate
* Common clone_deserialize_error
* Use thiserror
* Minimal dialing in cli swarm
* Send dispersal messages async
* Remove unused connection id
---------
Co-authored-by: Daniel Sanchez <sanchez.quiros.daniel@gmail.com>
* ColumnIndex type in Blob trait
* Store blob id and column after verification
* Use blob_id+column_idx storage scheme in indexer
* Store and load multiple columns for the same blob
* Add comments
* Build up validator behaviour and swarm
* Refactor modules
* More barebones structure on validator swarm
* Refactor protocols into submodule
* Pipe up events stream into swarm impl
* Clippy happy on tests
* WIP: cli dispersal reenable
* WIP: Nomos da network mock in cli app
* Mock adapter with KzgEncoder in cli
* Send BlobInfo to the mempool
* KzgrsSettings in dispersal cli app
* Dispersal backend mock for executor
* build_attestation_message to build_blob_id refactor
* Pass blob metadata via the cli args
* Fix reading messages state machine
* Improve waker on behaviour
* Rename test
* First sketch
* Implement replication
* Refactor protocols names
* Clippy happy
* expose behaviour
* Return dummy on outbound for validator behaviour
* Implement behaviour, lacks streams handling
* Cleanup
* Implement stream handling
* Add some documentation and comments
* Clippy fixes after rebase
* Move all neighbours to test_utils module
* Executor only outgoing streams
* First assault at testing behaviours
* Add debug instead of traces
* Added more logs
* Bullshitting tests
* Fix outstream handling, offers hook to send new peer streams
* Fix blob dispersal handling
* Refactor test, use new api
* Imports cleanup
* Working test
* Add docs
* Non overlapping test port
* DispersedBlobData in nomos-core
* Implement BlobInfo in kzgrs-backend
* Fullreplication BlobInfo
* Use block info in da mempool
* Blob info in consensus
* Blob info in da-verifier
* BlobInfo in da indexer
* BlobInfo in nomos-api
* Verifier and Indexer integration tests with BlobInfo
* Blob info in nomos node
* Import DaEncoder trait
* Fix attempt 1 - nonworking
* Added missing open stream request
* Expand outbound lifecycle to openstream state
* Fix reading messages state machine
* Use tracing
* Remove unnecessary loop
* Use stream style for test
* Send 10 messages
* Use quic in test
* Sends and receives
* cargo update fixed the panic
* Refactor test
* reschedule polls
* Clippy cleanup
* Remove leftover features
* Cargo fmt
* Improve waker on behaviour
* Rename test
* Split message definitions for broadcast, dispersal and sampling
* Expose dispersal messages via crate
* Create nomos-da-messages crate
* From trait implementations for messages
* Rename broadcast to replication
* Prost crate integration for DA
* Packing and unpacking for protobuf messages
* Minimal helper macro for dispersal message
* Use protoc in gh actions
* Move dispersal related protocol to nomos-da-dispersal
* Api endpoint to add blob and receive attestation
* Nomos DA Certificate serialization
* Kzgrs verification params provider
* Indexer http api using kzgrs
* Plug da http endpoints into nomos api
gusto
Daniel Sanchez
Giacomo Pasini
Deep Mondal
Youngjoon Lee
Caio
Roman Zajic
holisticode