codex-storage
/
das-research
mirror of https://github.com/codex-storage/das-research.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
298 Commits 79 Branches 0 Tags 2.6 MiB
Commit Graph

298 Commits

Author SHA1 Message Date
Csaba Kiraly 933cca00e9
progress plot: always use y range 0..1 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-03-22 15:30:26 +01:00
Csaba Kiraly 952c3c63a3
DASampling: more progress metrics 
Expose sampling success as a metric as well

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-03-19 11:37:13 +01:00
Csaba Kiraly fedb018fea
WIP restricted neighborhood 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-03-05 11:56:17 +01:00
Csaba Kiraly d4096f4f1c
gereralize GossipSub setup 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-03-05 09:12:04 +01:00
Csaba Kiraly 5dc9ea0e59
WIP more sampling options 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-03-04 14:20:40 +01:00
Csaba Kiraly 878b0a1b94
DASampling: add global statistics 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 14:21:57 +01:00
Csaba Kiraly 3824cbbe38
Simulator: move progress stats between send and receive 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 14:21:16 +01:00
Csaba Kiraly f8d5bfbb30
WIP: minimal sample generation and check 
This is early WIP, it only checks if neighbors would be able to
provide all the samples needed by nodes.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 14:20:34 +01:00
Csaba Kiraly bb6f3e80b4
Block: implement deep copy 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 13:50:59 +01:00
Csaba Kiraly a35d278685
add node level P2PNeighbor class 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 11:19:08 +01:00
Csaba Kiraly c909f0b75d
make Neighbor objects peer with other Neighbor objects 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 11:08:28 +01:00
Csaba Kiraly bc289555d3
node: addRowNeighbor and addColumnNeighbor 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 10:26:41 +01:00
Csaba Kiraly 207ff42348
smallConf: changing evenLineDistribution to False 
Changing default here, since a generic version of even line distribution
is not yet implemented.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 09:18:55 +01:00
Csaba Kiraly 2eb92b755a
adding individual Validator objects behind Node 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 09:16:32 +01:00
Csaba Kiraly 4d0a000a67
fixup: renaming 2024-02-20 09:13:43 +01:00
Csaba Kiraly 6c85ebfd35
renaming Validator object to Node 
In the SubnetDas model Nodes behave as previous validators,
getting samples (whole columns) from GossipSub.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 09:13:31 +01:00
Csaba Kiraly dc00073246
observer: fix row/column count test 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 09:09:18 +01:00
Csaba Kiraly e8c27531bd
not all nodes sample in both dimensions 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 02:56:28 +01:00
Csaba Kiraly 36d098cea3
Merge branch 'visual' 
New visualizer module with updated plots, and plotting after each run.
 2024-02-19 13:53:15 +01:00
Csaba Kiraly 2b69a3ae35
Merge pull request #53 from codex-storage/independent-dimensions 
Independent dimensions
 2024-02-19 11:30:28 +01:00
Sudipta Basak 2335b468e3
Merge pull request #57 from sudiptab2100/patch-1 
Independent Dimensions - Fixed results string in shape.py
 2024-02-18 21:31:10 +05:30
Sudipta Basak 00c3b3fe54 plot textBox attribute value fixed 2024-02-17 12:40:17 +01:00
Sudipta Basak e6b33cb542
Fixed results string in shape.py 2024-02-16 15:42:52 +05:30
Csaba Kiraly cc51b2ba45
fix plotting if row/column sizes differ 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-01-30 14:20:28 +01:00
Csaba Kiraly 9fb2f6cfe6
update example smallConf with N/K 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-12-05 10:37:09 +01:00
Csaba Kiraly fbb73265c1
fixup: set N/K in observer 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-15 14:24:34 +02:00
Csaba Kiraly 14cdec54cb
fix N/K in error patterns 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-15 14:24:26 +02:00
Csaba Kiraly cb9616af14
Add N/K to shape 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-15 14:24:10 +02:00
Csaba Kiraly d2a2c8b137
block: introduce N and K in both EC dimensions 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-15 14:24:00 +02:00
Csaba Kiraly 4f5205e247
plot RCdist only if saveRCdist 2023-07-15 14:23:12 +02:00
Csaba Kiraly 866229f8e8
fixup: df.pivot needs parameter names 2023-07-13 11:30:50 +02:00
Csaba Kiraly b427cf93c0
plot figures right after simulation run 
This allows to observe partial results during long studies.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-12 21:28:37 +02:00
Csaba Kiraly 0dfbace655
fix heatmap when spacing in not equal 
Histogram2d was binning data, even if axes values were not
on a linear scale, creating some strange figures. We
do not need the binning here.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-12 21:15:48 +02:00
Csaba Kiraly e805dd9582
smallConf: handle row/column dimensions 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-12 14:13:05 +02:00
Csaba Kiraly 9bd3a698e4
visualizer: workaround for R/C separation 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-12 14:13:05 +02:00
Csaba Kiraly b49be37489
handle two dimensions on Chi separately 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>

# Conflicts:
#	DAS/simulator.py
#	DAS/validator.py
 2023-07-12 14:13:05 +02:00
Csaba Kiraly e18822b8aa
handle 2 dimensions separately (except visualizer) 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>

# Conflicts:
#	DAS/simulator.py
#	DAS/validator.py
 2023-07-12 14:13:05 +02:00
Csaba Kiraly f21a9ddb01
block: handle 2 dimensions separately 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-12 14:13:04 +02:00
Csaba Kiraly db5fd6c157
add TODO on proposerPublishTo 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-12 14:12:36 +02:00
Csaba Kiraly cff3a1526f
extending .gitignore 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-12 14:12:32 +02:00
leobago 562ef5122f More output 2023-06-11 19:30:10 +02:00
leobago 8a24e4f88e heatmap plotting WIP 2023-06-11 19:26:44 +02:00
leobago 731331046c Better order for the plots 2023-06-11 18:46:55 +02:00
Leo 041535183c
Merge pull request #51 from codex-storage/license-clarify 
clarify license
 2023-05-24 13:56:51 +02:00
Csaba Kiraly 66f6e568a7
clarify license 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-24 11:30:43 +02:00
Csaba Kiraly fc0bd39d7d
Merge pull request #50 from codex-storage/develop 
Develop
 2023-05-22 14:50:29 +02:00
Csaba Kiraly 8a1fda6b4c
README update 
Add short description of what DAS Simulator is about.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-21 15:55:21 +02:00
Leo 1569ca2946
Merge pull request #49 from codex-storage/visual 
Add new visuals
 2023-05-21 14:43:19 +02:00
leobago f1db022e17 Fix row and column distribution 2023-05-15 17:56:30 +02:00
leobago 20c68cf198 New visualizer module WIP 2023-05-13 11:25:09 +02:00