codex-storage
/
das-research
mirror of https://github.com/codex-storage/das-research.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
239 Commits 79 Branches 0 Tags 2.6 MiB
Commit Graph

72 Commits

Author SHA1 Message Date
Leonardo Bautista-Gomez dfec7bcde8
Clearer debugging data and add row/column distribution to results 2023-05-02 12:22:21 +02:00
Csaba Kiraly f47f46a330
fix validator assignment when evenLineDistribution = True 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-02 12:19:08 +02:00
Csaba Kiraly 08e67cbeb1
measure validation progress more precisely 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-05-02 12:19:08 +02:00
Leo b2df64f8b9
Merge pull request #42 from status-im/failureRate-exact 
make failureRate exact
 2023-04-19 16:52:08 +02:00
Csaba Kiraly 1638a18507
make failureRate exact 
simplify code and make sure failureRate is the exact
portion of segments missing, not just a probability per
sample.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-04-18 14:54:38 +02:00
Csaba Kiraly b74ac19557
fixup: increase step counter while steps4StopCondition 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-04-18 12:49:59 +02:00
Leonardo Bautista-Gomez d51cefabb7 Merge branch 'addDiagnostics' into develop 2023-04-13 13:39:33 +02:00
Leonardo Bautista-Gomez c4ad3cf80e Small fix 2023-03-30 16:10:10 +02:00
Leonardo Bautista-Gomez ae36844e7f Add stop condition fix 2023-03-30 14:26:14 +02:00
Leonardo Bautista-Gomez d2a653b07c Remove plotting config 2023-03-30 14:11:12 +02:00
Leonardo Bautista-Gomez 1ae4352dad Fix merge remote-tracking branch 'origin/develop' into addDiagnostics 2023-03-30 14:06:17 +02:00
Leonardo Bautista-Gomez 699a912991 Merge branch 'develop' into addDiagnostics 2023-03-30 13:56:09 +02:00
Leonardo Bautista-Gomez 4b7bf81cee Remove stop condition fix 2023-03-30 13:52:40 +02:00
Leonardo Bautista-Gomez 98423d29c0 Typos and sets 2023-03-30 13:49:01 +02:00
Csaba Kiraly 1b4a225114
Merge pull request #35 from status-im/issue-29 
Solving Issue 29 partially. Still remains the problems of stop condition.
 2023-03-30 13:46:00 +02:00
Leo 7719f84a10
Switch from time steps to miliseconds (#30) 
Switch from time steps to miliseconds
 2023-03-30 13:41:50 +02:00
Leonardo Bautista-Gomez 296c4fb762 Rows and columns to sets 2023-03-30 13:36:48 +02:00
Leonardo Bautista-Gomez 795bb1d10d Move set to simulator for future diagnostic purposes 2023-03-30 13:15:42 +02:00
Leonardo Bautista-Gomez 9800161ac9 Switch from time steps to miliseconds. Rebase to traffic progress. 2023-03-30 11:35:44 +02:00
Leonardo Bautista-Gomez e285890fa7 Fixes allocation bug, remove duplicates in rowIDs and columnIDs, add diagnostics when the block is not available. Add number of steps without progress to stop condition. 2023-03-29 16:42:09 +02:00
Csaba Kiraly f85cdb401b
fix line allocation when evenLineDistribution=True 
vector should have chi elements for each validator

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-29 15:49:52 +02:00
Csaba Kiraly 75a9b484e9
fixup: close plot to release memory 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 23:28:12 +02:00
Csaba Kiraly dc51727b32
plot progress per run 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 23:16:05 +02:00
Csaba Kiraly eb4f451303
save progress and traffic statistics to XML 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 23:15:44 +02:00
Csaba Kiraly 23af30e381
add generalized metrics collection 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:29:22 +02:00
Csaba Kiraly 7e4074938a
add duplicate statistics 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:29:22 +02:00
Csaba Kiraly 6616cc799f
move traffic stats calculation to observer 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:29:20 +02:00
Csaba Kiraly 119777787e
add progress meters to observer 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:28:30 +02:00
Csaba Kiraly 037c4cd67a
count number of validators having all rows/columns 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:28:30 +02:00
Csaba Kiraly 122f6a8348
remove resetShape 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly 6e4b37a3d2
adding log level TRACE 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly af124c0755
simplify code 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly 952d191ccd
remove unused golden data 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Leonardo Bautista-Gomez 680817b97b Remove global randomness parameter for validator 2023-03-23 20:10:27 +01:00
Leonardo Bautista-Gomez 3642083f22 Fixing the global random uniform distribution of topics across validators 2023-03-21 15:16:19 +01:00
Csaba Kiraly 64fcbff0ef
warn if no nodes for a row/column 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-20 19:36:42 +01:00
Csaba Kiraly 9d9612fd34
rename numberValidators to numberNodes 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:38:53 +01:00
Csaba Kiraly 065086f88c
configure using validatorsPerNode1/2 instead of chi1/2 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:00:52 +01:00
Csaba Kiraly ef4e32ed53
introduce node classes 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:57:43 +01:00
Csaba Kiraly dc7a4d3c03
generate row/column interest locally in validator 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:54:16 +01:00
Csaba Kiraly 16b670e916
fix issues with logging in parallel execution 
For fixing logging issues see
https://stackoverflow.com/questions/58026381/logging-nested-functions-using-joblib-parallel-and-delayed-calls
and https://github.com/joblib/joblib/issues/1017

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-07 13:11:17 +01:00
Leo 37ff89bd82
Merge pull request #17 from status-im/bandwidth 
Bandwidth limited diffusion
 2023-03-03 11:48:21 +01:00
Csaba Kiraly 35d1790429
Merge remote-tracking branch 'origin/vis' into develop 
# Conflicts:
#	.gitignore
#	DAS/simulator.py
#	study.py
 2023-03-02 01:32:25 +01:00
HajarZaiz ceb8357034 Merge branch 'vis' of https://github.com/status-im/das-research into vis 2023-02-26 18:27:47 +01:00
Csaba Kiraly a03371cf4e
add logging of TX and RX statistics 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-24 10:43:45 +01:00
Csaba Kiraly 2707269836
fixup: moving simulator config to resetShape 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-23 22:21:16 +01:00
Csaba Kiraly b33f829b0e
proposer might push segments without participating in mesh 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-23 21:28:41 +01:00
Csaba Kiraly b7dab5bad9
fix sendSegmentToNeigh: specify dimension 
Specify along which dimension (row/column) a segment was
sent.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-23 21:15:39 +01:00
Csaba Kiraly bb8d05257b
WIP: initial implementation of uplink bandwidth limit 
- approximate: BW is not handled strict, entire rows are sent and can go over limit
- WIP: work in progress implementation

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-23 21:08:17 +01:00
Leonardo Bautista-Gomez 6e42055cb9 Add some more configuration parameters and some more testing 2023-02-23 12:17:57 +01:00