codex-storage
/
das-research
mirror of https://github.com/codex-storage/das-research.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
187 Commits 79 Branches 0 Tags 2.6 MiB
Commit Graph

187 Commits

Author SHA1 Message Date
Leo 57b0ee89f7
Merge pull request #32 from status-im/measure-progress 
Measure and save progress and traffic statistics.
 2023-03-30 11:18:19 +02:00
Csaba Kiraly 98db10f7a6
Add more documentation 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-30 00:13:33 +02:00
Csaba Kiraly cb0a3ea1ba
fixup: avoid warning on mean if empty 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-29 16:36:40 +02:00
Csaba Kiraly eb4f451303
save progress and traffic statistics to XML 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 23:15:44 +02:00
Csaba Kiraly 23af30e381
add generalized metrics collection 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:29:22 +02:00
Csaba Kiraly 7e4074938a
add duplicate statistics 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:29:22 +02:00
Csaba Kiraly 6616cc799f
move traffic stats calculation to observer 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:29:20 +02:00
Csaba Kiraly 119777787e
add progress meters to observer 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:28:30 +02:00
Csaba Kiraly 037c4cd67a
count number of validators having all rows/columns 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:28:30 +02:00
Csaba Kiraly bcf3098e9f
Merge pull request #28 from status-im/cleanup 
Code cleanup
 2023-03-27 11:41:19 +02:00
Csaba Kiraly 3795948564
fix requirements.txt 2023-03-27 11:37:23 +02:00
Csaba Kiraly ec6ed7c1e8
dump results to XML after each run 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly 894009b414
Validator node: add nodeClass property 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly ff93161b8d
set vpn in validator 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly 122f6a8348
remove resetShape 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly 6e4b37a3d2
adding log level TRACE 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly af124c0755
simplify code 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly 952d191ccd
remove unused golden data 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly 954d40e758
use new simulator object instead of reset 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>

# Conflicts:
#	study.py
 2023-03-27 11:37:21 +02:00
Csaba Kiraly d38b8074f4
use main 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:21 +02:00
Csaba Kiraly c7a3fb1c52
Merge pull request #26 from status-im/fix-uniformDistribution 
Fixing the global random uniform distribution
 2023-03-24 16:46:42 +01:00
Leonardo Bautista-Gomez 680817b97b Remove global randomness parameter for validator 2023-03-23 20:10:27 +01:00
Leonardo Bautista-Gomez 3642083f22 Fixing the global random uniform distribution of topics across validators 2023-03-21 15:16:19 +01:00
Csaba Kiraly 263558b5a0
Merge pull request #25 from status-im/fix-visualizer 
Fix visualizer to loop over all parameters
 2023-03-21 12:50:08 +01:00
Leonardo Bautista-Gomez 125ba2ad4a Fix visualizer to loop over all parameters 2023-03-21 10:41:52 +01:00
Leo fd532a6f17
Merge pull request #22 from status-im/twoClasses 
Two classes
 2023-03-20 21:01:28 +01:00
Csaba Kiraly 64fcbff0ef
warn if no nodes for a row/column 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-20 19:36:42 +01:00
Csaba Kiraly 353efec141
fixup: use vpn1 and vpn2 correctly 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:38:58 +01:00
Csaba Kiraly c366c05616
handle overlap for multiple validators per node correctly 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:38:57 +01:00
Csaba Kiraly 5613996547
fixup: make validatorsPerNode and bandwidth consistent 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:38:57 +01:00
Csaba Kiraly 9d9612fd34
rename numberValidators to numberNodes 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:38:53 +01:00
Csaba Kiraly 065086f88c
configure using validatorsPerNode1/2 instead of chi1/2 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:00:52 +01:00
Csaba Kiraly 45fe454204
WIP: extend Vis with new parameters 
Current code assumes 6 parameters in some places.
Still needs some work

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:57:46 +01:00
Csaba Kiraly ef4e32ed53
introduce node classes 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:57:43 +01:00
Csaba Kiraly 49b1c239d7
use itertools 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:54:20 +01:00
Csaba Kiraly dc7a4d3c03
generate row/column interest locally in validator 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:54:16 +01:00
Csaba Kiraly 4a5d410f6a
fixup: add bwUplink to save file name 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:53:02 +01:00
Csaba Kiraly 99e051e6fc
adding uplinkBw configuration 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:50:48 +01:00
Leo d9d79f9245
Merge pull request #23 from status-im/fix-deterministic 
Fix deterministic
 2023-03-15 23:15:24 +01:00
Leo b39d75125e
Merge branch 'develop' into fix-deterministic 2023-03-15 13:37:02 +01:00
Leonardo Bautista-Gomez 0a92ef7071 Adding and logging random seed in the shape for each simulation 2023-03-15 13:18:02 +01:00
Leonardo Bautista-Gomez 833ae76097 add shape repr 2023-03-15 12:37:23 +01:00
Leo cb2625a284
Merge pull request #24 from status-im/config-py 
Multiproc
 2023-03-15 11:57:30 +01:00
Leo 8c9106d03d
Merge pull request #21 from status-im/multiproc 
Parallel execution of simulations with parameters to select number of threads
 2023-03-14 16:49:04 +01:00
Leonardo Bautista-Gomez 45bdcc3308 Seed by microseconds. Determinisme checked. 2023-03-14 11:25:17 +01:00
Leonardo Bautista-Gomez 377072ef79 Fix deterministic feature 2023-03-14 11:07:59 +01:00
leobago ba94cc8da1 Update requirements 2023-03-14 08:26:37 +01:00
Csaba Kiraly 567d13e370
add numJobs parameter to config 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-13 14:22:14 +01:00
Leo fa2ebccee5
Merge pull request #20 from status-im/config-py 
configure with code
 2023-03-07 16:03:20 +01:00
Csaba Kiraly 16b670e916
fix issues with logging in parallel execution 
For fixing logging issues see
https://stackoverflow.com/questions/58026381/logging-nested-functions-using-joblib-parallel-and-delayed-calls
and https://github.com/joblib/joblib/issues/1017

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-07 13:11:17 +01:00