logos-storage/das-research
1
0
Fork 0
mirror of https://github.com/logos-storage/das-research.git synced 2026-01-03 05:33:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
298 Commits 82 Branches 0 Tags 2.9 MiB
Commit Graph

214 Commits

Author SHA1 Message Date
Csaba Kiraly
933cca00e9
progress plot: always use y range 0..1 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-03-22 15:30:26 +01:00
Csaba Kiraly
952c3c63a3
DASampling: more progress metrics 
Expose sampling success as a metric as well

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-03-19 11:37:13 +01:00
Csaba Kiraly
fedb018fea
WIP restricted neighborhood 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-03-05 11:56:17 +01:00
Csaba Kiraly
d4096f4f1c
gereralize GossipSub setup 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-03-05 09:12:04 +01:00
Csaba Kiraly
5dc9ea0e59
WIP more sampling options 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-03-04 14:20:40 +01:00
Csaba Kiraly
878b0a1b94
DASampling: add global statistics 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 14:21:57 +01:00
Csaba Kiraly
3824cbbe38
Simulator: move progress stats between send and receive 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 14:21:16 +01:00
Csaba Kiraly
f8d5bfbb30
WIP: minimal sample generation and check 
This is early WIP, it only checks if neighbors would be able to
provide all the samples needed by nodes.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 14:20:34 +01:00
Csaba Kiraly
bb6f3e80b4
Block: implement deep copy 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 13:50:59 +01:00
Csaba Kiraly
a35d278685
add node level P2PNeighbor class 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 11:19:08 +01:00
Csaba Kiraly
c909f0b75d
make Neighbor objects peer with other Neighbor objects 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 11:08:28 +01:00
Csaba Kiraly
bc289555d3
node: addRowNeighbor and addColumnNeighbor 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 10:26:41 +01:00
Csaba Kiraly
2eb92b755a
adding individual Validator objects behind Node 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 09:16:32 +01:00
Csaba Kiraly
4d0a000a67
fixup: renaming 2024-02-20 09:13:43 +01:00
Csaba Kiraly
6c85ebfd35
renaming Validator object to Node 
In the SubnetDas model Nodes behave as previous validators,
getting samples (whole columns) from GossipSub.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 09:13:31 +01:00
Csaba Kiraly
dc00073246
observer: fix row/column count test 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 09:09:18 +01:00
Csaba Kiraly
e8c27531bd
not all nodes sample in both dimensions 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-02-20 02:56:28 +01:00
Csaba Kiraly
36d098cea3
Merge branch 'visual' 
New visualizer module with updated plots, and plotting after each run.
 2024-02-19 13:53:15 +01:00
Sudipta Basak
00c3b3fe54 plot textBox attribute value fixed 2024-02-17 12:40:17 +01:00
Sudipta Basak
e6b33cb542
Fixed results string in shape.py 2024-02-16 15:42:52 +05:30
Csaba Kiraly
cc51b2ba45
fix plotting if row/column sizes differ 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-01-30 14:20:28 +01:00
Csaba Kiraly
fbb73265c1
fixup: set N/K in observer 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-15 14:24:34 +02:00
Csaba Kiraly
14cdec54cb
fix N/K in error patterns 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-15 14:24:26 +02:00
Csaba Kiraly
cb9616af14
Add N/K to shape 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-15 14:24:10 +02:00
Csaba Kiraly
d2a2c8b137
block: introduce N and K in both EC dimensions 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-15 14:24:00 +02:00
Csaba Kiraly
4f5205e247
plot RCdist only if saveRCdist 2023-07-15 14:23:12 +02:00
Csaba Kiraly
866229f8e8
fixup: df.pivot needs parameter names 2023-07-13 11:30:50 +02:00
Csaba Kiraly
0dfbace655
fix heatmap when spacing in not equal 
Histogram2d was binning data, even if axes values were not
on a linear scale, creating some strange figures. We
do not need the binning here.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-12 21:15:48 +02:00
Csaba Kiraly
9bd3a698e4
visualizer: workaround for R/C separation 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-12 14:13:05 +02:00
Csaba Kiraly
b49be37489
handle two dimensions on Chi separately 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>

# Conflicts:
#	DAS/simulator.py
#	DAS/validator.py
 2023-07-12 14:13:05 +02:00
Csaba Kiraly
e18822b8aa
handle 2 dimensions separately (except visualizer) 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>

# Conflicts:
#	DAS/simulator.py
#	DAS/validator.py
 2023-07-12 14:13:05 +02:00
Csaba Kiraly
f21a9ddb01
block: handle 2 dimensions separately 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-12 14:13:04 +02:00
Csaba Kiraly
db5fd6c157
add TODO on proposerPublishTo 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-12 14:12:36 +02:00
leobago
562ef5122f More output 2023-06-11 19:30:10 +02:00
leobago
8a24e4f88e heatmap plotting WIP 2023-06-11 19:26:44 +02:00
leobago
731331046c Better order for the plots 2023-06-11 18:46:55 +02:00
leobago
f1db022e17 Fix row and column distribution 2023-05-15 17:56:30 +02:00
leobago
20c68cf198 New visualizer module WIP 2023-05-13 11:25:09 +02:00
Csaba Kiraly
16e32a3f98
Merge branch 'develop' into failureMode 2023-05-02 15:05:54 +02:00
Csaba Kiraly
293914e1c3
move initBlock code after network setup 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-02 13:47:08 +02:00
Csaba Kiraly
cec9b9f6a7
fixup: fix missing 'order' in failureModel == "sequential" 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-02 13:42:41 +02:00
Csaba Kiraly
3c0898c925
adding failureModes with special erasure patterns 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-02 13:42:40 +02:00
Csaba Kiraly
06e70e1b40
configure bandwidth in mbps 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-02 13:37:57 +02:00
Leonardo Bautista-Gomez
dfec7bcde8
Clearer debugging data and add row/column distribution to results 2023-05-02 12:22:21 +02:00
Csaba Kiraly
f47f46a330
fix validator assignment when evenLineDistribution = True 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-02 12:19:08 +02:00
Csaba Kiraly
08e67cbeb1
measure validation progress more precisely 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-02 12:19:08 +02:00
Leonardo Bautista-Gomez
6eac3eb8e7 Merge develop into vis 2023-04-27 13:58:51 +02:00
Leonardo Bautista-Gomez
eed410e4db Do not count unavailable block on averages 2023-04-26 18:22:17 +02:00
HajarZaiz
3fbda15272 Avg changes 2023-04-25 21:32:31 +00:00
HajarZaiz
e7c2807aca Minor changes 2023-04-23 14:55:31 +00:00