logos-storage/das-research
1
0
Fork 0
mirror of https://github.com/logos-storage/das-research.git synced 2026-01-11 09:33:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
185 Commits 82 Branches 0 Tags 2.9 MiB
Commit Graph

185 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Csaba Kiraly
8bcf601e88
add SparseBlock with selected rows and columns only 
SparseBlock stores only selected rows and columns.
Initial implementation without checks and asserts.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-22 11:33:10 +01:00
Csaba Kiraly
ba92840b2c
optimize debug printing 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-22 10:00:10 +01:00
Csaba Kiraly
31b7a5ecea
use shuffled round robin between output queues 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>

# Conflicts:
#	DAS/validator.py
 2023-03-22 09:32:56 +01:00
Csaba Kiraly
d20d8c7c3c
add per-run progress plots 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 15:12:38 +01:00
Csaba Kiraly
74ab8d3fd2
dump results to XML after each run 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 14:53:48 +01:00
Csaba Kiraly
94f25596f3
updating Scenario1 config 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 14:45:31 +01:00
Leonardo Bautista-Gomez
d46f0a5310
Fix visualizer to loop over all parameters 2023-03-21 13:53:11 +01:00
Csaba Kiraly
f2696858a7
WIP: plot progress graph on the fly 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:16:18 +01:00
Csaba Kiraly
cc75679b70
add generalized metrics collection 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:52 +01:00
Csaba Kiraly
44a975f277
Validator node: add nodeClass property 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:52 +01:00
Csaba Kiraly
f16e446657
fixup: define random seed in scenario1 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:52 +01:00
Csaba Kiraly
d5098d6eee
add duplicate statistics 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:51 +01:00
Csaba Kiraly
bbc26155e4
move traffic stats calculation to observer 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:51 +01:00
Csaba Kiraly
b66bb761b7
add progress meters to observer 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:51 +01:00
Csaba Kiraly
b5f53f9eb0
set vpn in validator 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:51 +01:00
Csaba Kiraly
7552097b32
remove resetShape 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:51 +01:00
Csaba Kiraly
9e4ebe0897
adding Scenario 1 config 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:51 +01:00
Csaba Kiraly
38b28787ed
count number of validators having all rows/columns 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:50 +01:00
Csaba Kiraly
a01c1fedbd
adding log level TRACE 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:50 +01:00
Csaba Kiraly
9733698e95
simplify code 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:50 +01:00
Csaba Kiraly
b892a34f73
remove unused golden data 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:50 +01:00
Csaba Kiraly
f569de4dc6
use new simulator object instead of reset 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>

# Conflicts:
#	study.py
 2023-03-21 12:12:50 +01:00
Csaba Kiraly
e511bdf5fd
use main 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-21 12:12:50 +01:00
Leo
fd532a6f17
Merge pull request #22 from status-im/twoClasses 
Two classes
 2023-03-20 21:01:28 +01:00
Csaba Kiraly
64fcbff0ef
warn if no nodes for a row/column 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-20 19:36:42 +01:00
Csaba Kiraly
353efec141
fixup: use vpn1 and vpn2 correctly 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:38:58 +01:00
Csaba Kiraly
c366c05616
handle overlap for multiple validators per node correctly 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:38:57 +01:00
Csaba Kiraly
5613996547
fixup: make validatorsPerNode and bandwidth consistent 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:38:57 +01:00
Csaba Kiraly
9d9612fd34
rename numberValidators to numberNodes 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:38:53 +01:00
Csaba Kiraly
065086f88c
configure using validatorsPerNode1/2 instead of chi1/2 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:00:52 +01:00
Csaba Kiraly
45fe454204
WIP: extend Vis with new parameters 
Current code assumes 6 parameters in some places.
Still needs some work

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:57:46 +01:00
Csaba Kiraly
ef4e32ed53
introduce node classes 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:57:43 +01:00
Csaba Kiraly
49b1c239d7
use itertools 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:54:20 +01:00
Csaba Kiraly
dc7a4d3c03
generate row/column interest locally in validator 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:54:16 +01:00
Csaba Kiraly
4a5d410f6a
fixup: add bwUplink to save file name 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:53:02 +01:00
Csaba Kiraly
99e051e6fc
adding uplinkBw configuration 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:50:48 +01:00
Leo
d9d79f9245
Merge pull request #23 from status-im/fix-deterministic 
Fix deterministic
 2023-03-15 23:15:24 +01:00
Leo
b39d75125e
Merge branch 'develop' into fix-deterministic 2023-03-15 13:37:02 +01:00
Leonardo Bautista-Gomez
0a92ef7071 Adding and logging random seed in the shape for each simulation 2023-03-15 13:18:02 +01:00
Leonardo Bautista-Gomez
833ae76097 add shape repr 2023-03-15 12:37:23 +01:00
Leo
cb2625a284
Merge pull request #24 from status-im/config-py 
Multiproc
 2023-03-15 11:57:30 +01:00
Leo
8c9106d03d
Merge pull request #21 from status-im/multiproc 
Parallel execution of simulations with parameters to select number of threads
 2023-03-14 16:49:04 +01:00
Leonardo Bautista-Gomez
45bdcc3308 Seed by microseconds. Determinisme checked. 2023-03-14 11:25:17 +01:00
Leonardo Bautista-Gomez
377072ef79 Fix deterministic feature 2023-03-14 11:07:59 +01:00
leobago
ba94cc8da1 Update requirements 2023-03-14 08:26:37 +01:00
Csaba Kiraly
567d13e370
add numJobs parameter to config 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-13 14:22:14 +01:00
Leo
fa2ebccee5
Merge pull request #20 from status-im/config-py 
configure with code
 2023-03-07 16:03:20 +01:00
Csaba Kiraly
16b670e916
fix issues with logging in parallel execution 
For fixing logging issues see
https://stackoverflow.com/questions/58026381/logging-nested-functions-using-joblib-parallel-and-delayed-calls
and https://github.com/joblib/joblib/issues/1017

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-07 13:11:17 +01:00
Csaba Kiraly
f5ffb0a07b
use joblib to run in parallel 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-07 13:11:13 +01:00
Csaba Kiraly
0b6cfad967
factorize study code 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-07 13:10:33 +01:00