logos-storage/das-research
1
0
Fork 0
mirror of https://github.com/logos-storage/das-research.git synced 2026-01-10 00:53:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
283 Commits 82 Branches 0 Tags 2.9 MiB
Commit Graph

81 Commits

Author SHA1 Message Date
Csaba Kiraly
b22a096cbc
set number of copies of rows/columns published 
Sets how many copies are sent out by the block producer over
rows and over columns.
Note, previously this was set to match netDegree in both
dimensions. We keep this default.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2024-03-04 10:17:46 +01:00
Csaba Kiraly
36d098cea3
Merge branch 'visual' 
New visualizer module with updated plots, and plotting after each run.
 2024-02-19 13:53:15 +01:00
Csaba Kiraly
b49be37489
handle two dimensions on Chi separately 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>

# Conflicts:
#	DAS/simulator.py
#	DAS/validator.py
 2023-07-12 14:13:05 +02:00
Csaba Kiraly
e18822b8aa
handle 2 dimensions separately (except visualizer) 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>

# Conflicts:
#	DAS/simulator.py
#	DAS/validator.py
 2023-07-12 14:13:05 +02:00
Csaba Kiraly
db5fd6c157
add TODO on proposerPublishTo 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-07-12 14:12:36 +02:00
leobago
562ef5122f More output 2023-06-11 19:30:10 +02:00
Csaba Kiraly
16e32a3f98
Merge branch 'develop' into failureMode 2023-05-02 15:05:54 +02:00
Csaba Kiraly
293914e1c3
move initBlock code after network setup 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-02 13:47:08 +02:00
Csaba Kiraly
06e70e1b40
configure bandwidth in mbps 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-02 13:37:57 +02:00
Leonardo Bautista-Gomez
dfec7bcde8
Clearer debugging data and add row/column distribution to results 2023-05-02 12:22:21 +02:00
Csaba Kiraly
f47f46a330
fix validator assignment when evenLineDistribution = True 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-02 12:19:08 +02:00
Csaba Kiraly
08e67cbeb1
measure validation progress more precisely 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-02 12:19:08 +02:00
Leo
b2df64f8b9
Merge pull request #42 from status-im/failureRate-exact 
make failureRate exact
 2023-04-19 16:52:08 +02:00
Csaba Kiraly
1638a18507
make failureRate exact 
simplify code and make sure failureRate is the exact
portion of segments missing, not just a probability per
sample.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-04-18 14:54:38 +02:00
Csaba Kiraly
b74ac19557
fixup: increase step counter while steps4StopCondition 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-04-18 12:49:59 +02:00
Leonardo Bautista-Gomez
d51cefabb7 Merge branch 'addDiagnostics' into develop 2023-04-13 13:39:33 +02:00
Leonardo Bautista-Gomez
c4ad3cf80e Small fix 2023-03-30 16:10:10 +02:00
Leonardo Bautista-Gomez
ae36844e7f Add stop condition fix 2023-03-30 14:26:14 +02:00
Leonardo Bautista-Gomez
d2a653b07c Remove plotting config 2023-03-30 14:11:12 +02:00
Leonardo Bautista-Gomez
1ae4352dad Fix merge remote-tracking branch 'origin/develop' into addDiagnostics 2023-03-30 14:06:17 +02:00
Leonardo Bautista-Gomez
699a912991 Merge branch 'develop' into addDiagnostics 2023-03-30 13:56:09 +02:00
Leonardo Bautista-Gomez
4b7bf81cee Remove stop condition fix 2023-03-30 13:52:40 +02:00
Leonardo Bautista-Gomez
98423d29c0 Typos and sets 2023-03-30 13:49:01 +02:00
Csaba Kiraly
1b4a225114
Merge pull request #35 from status-im/issue-29 
Solving Issue 29 partially. Still remains the problems of stop condition.
 2023-03-30 13:46:00 +02:00
Leo
7719f84a10
Switch from time steps to miliseconds (#30) 
Switch from time steps to miliseconds
 2023-03-30 13:41:50 +02:00
Leonardo Bautista-Gomez
296c4fb762 Rows and columns to sets 2023-03-30 13:36:48 +02:00
Leonardo Bautista-Gomez
795bb1d10d Move set to simulator for future diagnostic purposes 2023-03-30 13:15:42 +02:00
Leonardo Bautista-Gomez
9800161ac9 Switch from time steps to miliseconds. Rebase to traffic progress. 2023-03-30 11:35:44 +02:00
Leonardo Bautista-Gomez
e285890fa7 Fixes allocation bug, remove duplicates in rowIDs and columnIDs, add diagnostics when the block is not available. Add number of steps without progress to stop condition. 2023-03-29 16:42:09 +02:00
Csaba Kiraly
f85cdb401b
fix line allocation when evenLineDistribution=True 
vector should have chi elements for each validator

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-29 15:49:52 +02:00
Csaba Kiraly
75a9b484e9
fixup: close plot to release memory 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 23:28:12 +02:00
Csaba Kiraly
dc51727b32
plot progress per run 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 23:16:05 +02:00
Csaba Kiraly
eb4f451303
save progress and traffic statistics to XML 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 23:15:44 +02:00
Csaba Kiraly
23af30e381
add generalized metrics collection 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:29:22 +02:00
Csaba Kiraly
7e4074938a
add duplicate statistics 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:29:22 +02:00
Csaba Kiraly
6616cc799f
move traffic stats calculation to observer 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:29:20 +02:00
Csaba Kiraly
119777787e
add progress meters to observer 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:28:30 +02:00
Csaba Kiraly
037c4cd67a
count number of validators having all rows/columns 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:28:30 +02:00
Csaba Kiraly
122f6a8348
remove resetShape 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly
6e4b37a3d2
adding log level TRACE 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly
af124c0755
simplify code 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly
952d191ccd
remove unused golden data 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Leonardo Bautista-Gomez
680817b97b Remove global randomness parameter for validator 2023-03-23 20:10:27 +01:00
Leonardo Bautista-Gomez
3642083f22 Fixing the global random uniform distribution of topics across validators 2023-03-21 15:16:19 +01:00
Csaba Kiraly
64fcbff0ef
warn if no nodes for a row/column 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-20 19:36:42 +01:00
Csaba Kiraly
9d9612fd34
rename numberValidators to numberNodes 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:38:53 +01:00
Csaba Kiraly
065086f88c
configure using validatorsPerNode1/2 instead of chi1/2 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:00:52 +01:00
Csaba Kiraly
ef4e32ed53
introduce node classes 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:57:43 +01:00
Csaba Kiraly
dc7a4d3c03
generate row/column interest locally in validator 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:54:16 +01:00
Csaba Kiraly
16b670e916
fix issues with logging in parallel execution 
For fixing logging issues see
https://stackoverflow.com/questions/58026381/logging-nested-functions-using-joblib-parallel-and-delayed-calls
and https://github.com/joblib/joblib/issues/1017

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-07 13:11:17 +01:00