codex-storage
/
das-research
mirror of https://github.com/codex-storage/das-research.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
194 Commits 79 Branches 0 Tags 2.6 MiB
Commit Graph

55 Commits

Author SHA1 Message Date
Leonardo Bautista-Gomez ae36844e7f Add stop condition fix 2023-03-30 14:26:14 +02:00
Csaba Kiraly 1b4a225114
Merge pull request #35 from status-im/issue-29 
Solving Issue 29 partially. Still remains the problems of stop condition.
 2023-03-30 13:46:00 +02:00
Leo 7719f84a10
Switch from time steps to miliseconds (#30) 
Switch from time steps to miliseconds
 2023-03-30 13:41:50 +02:00
Leonardo Bautista-Gomez 296c4fb762 Rows and columns to sets 2023-03-30 13:36:48 +02:00
Leonardo Bautista-Gomez 795bb1d10d Move set to simulator for future diagnostic purposes 2023-03-30 13:15:42 +02:00
Csaba Kiraly f85cdb401b
fix line allocation when evenLineDistribution=True 
vector should have chi elements for each validator

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-29 15:49:52 +02:00
Csaba Kiraly eb4f451303
save progress and traffic statistics to XML 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 23:15:44 +02:00
Csaba Kiraly 23af30e381
add generalized metrics collection 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:29:22 +02:00
Csaba Kiraly 7e4074938a
add duplicate statistics 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:29:22 +02:00
Csaba Kiraly 6616cc799f
move traffic stats calculation to observer 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:29:20 +02:00
Csaba Kiraly 119777787e
add progress meters to observer 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:28:30 +02:00
Csaba Kiraly 037c4cd67a
count number of validators having all rows/columns 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 22:28:30 +02:00
Csaba Kiraly 122f6a8348
remove resetShape 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly 6e4b37a3d2
adding log level TRACE 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly af124c0755
simplify code 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Csaba Kiraly 952d191ccd
remove unused golden data 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-27 11:37:22 +02:00
Leonardo Bautista-Gomez 680817b97b Remove global randomness parameter for validator 2023-03-23 20:10:27 +01:00
Leonardo Bautista-Gomez 3642083f22 Fixing the global random uniform distribution of topics across validators 2023-03-21 15:16:19 +01:00
Csaba Kiraly 64fcbff0ef
warn if no nodes for a row/column 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-20 19:36:42 +01:00
Csaba Kiraly 9d9612fd34
rename numberValidators to numberNodes 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:38:53 +01:00
Csaba Kiraly 065086f88c
configure using validatorsPerNode1/2 instead of chi1/2 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 20:00:52 +01:00
Csaba Kiraly ef4e32ed53
introduce node classes 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:57:43 +01:00
Csaba Kiraly dc7a4d3c03
generate row/column interest locally in validator 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-16 19:54:16 +01:00
Csaba Kiraly 16b670e916
fix issues with logging in parallel execution 
For fixing logging issues see
https://stackoverflow.com/questions/58026381/logging-nested-functions-using-joblib-parallel-and-delayed-calls
and https://github.com/joblib/joblib/issues/1017

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-03-07 13:11:17 +01:00
Leo 37ff89bd82
Merge pull request #17 from status-im/bandwidth 
Bandwidth limited diffusion
 2023-03-03 11:48:21 +01:00
Csaba Kiraly 35d1790429
Merge remote-tracking branch 'origin/vis' into develop 
# Conflicts:
#	.gitignore
#	DAS/simulator.py
#	study.py
 2023-03-02 01:32:25 +01:00
HajarZaiz ceb8357034 Merge branch 'vis' of https://github.com/status-im/das-research into vis 2023-02-26 18:27:47 +01:00
Csaba Kiraly a03371cf4e
add logging of TX and RX statistics 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-24 10:43:45 +01:00
Csaba Kiraly 2707269836
fixup: moving simulator config to resetShape 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-23 22:21:16 +01:00
Csaba Kiraly b33f829b0e
proposer might push segments without participating in mesh 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-23 21:28:41 +01:00
Csaba Kiraly b7dab5bad9
fix sendSegmentToNeigh: specify dimension 
Specify along which dimension (row/column) a segment was
sent.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-23 21:15:39 +01:00
Csaba Kiraly bb8d05257b
WIP: initial implementation of uplink bandwidth limit 
- approximate: BW is not handled strict, entire rows are sent and can go over limit
- WIP: work in progress implementation

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-23 21:08:17 +01:00
Leonardo Bautista-Gomez 6e42055cb9 Add some more configuration parameters and some more testing 2023-02-23 12:17:57 +01:00
Leo c3a9eb6b4d
Merge pull request #15 from status-im/fix-small-graph 
set up complete graph if n<=d
 2023-02-23 10:18:09 +01:00
Leo edb4912dd5
Merge pull request #14 from status-im/log-steps 
Log steps
 2023-02-23 09:46:55 +01:00
Csaba Kiraly 763ebfe136
set up complete graph if n<=d 
If the number of nodes in a channel is smaller or equal than the
requested degree, a fully connected graph is used. For n>d, a random
d-regular graph is set up. (For n=d+1, the two are the same.)

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-23 09:06:57 +01:00
Csaba Kiraly e5c657e31e
more debug logging 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-23 09:04:51 +01:00
Csaba Kiraly 2775d180f1
debug log neighborhood of producer as well 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-22 21:48:11 +01:00
Csaba Kiraly 8c9ddcca55
add debug logging of topology 
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-22 21:48:03 +01:00
Leonardo Bautista-Gomez d5e7ae7ea7 Fix net degree bug 2023-02-22 14:49:46 +01:00
Leonardo Bautista-Gomez 09569422ab Documenting the DAS package for automatic generation with sphinx. First version. 2023-02-15 15:06:42 +01:00
Leonardo Bautista-Gomez 6334d1c779 Removing static variables 2023-02-08 20:10:26 +01:00
Leonardo Bautista-Gomez b64fe7b383 Merging changes from 'develop' branch into 'results' branch 2023-02-08 15:01:50 +01:00
Csaba Kiraly 50a210ad99
simplify send code and loop 
Treat send in block proposer as in validators to simplify
code and fix steps. Previously first step included first two
timelots: initial send by block proposer and first send by
validators.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-03 12:44:07 +01:00
Csaba Kiraly 6c6e10b81f
add tx/rx troughput statistics 
Collect statistics about Tx/Rx troughput, per timeslot and per node.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-03 11:30:28 +01:00
Csaba Kiraly c97dd58d76
keep track of sent and received samples per neighbor 
Keeps track of sent and received samples per line per neighbor.
Only send what wasn't yet sent or wasn't received from the other side.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-03 11:28:20 +01:00
Csaba Kiraly b38d8e13ae
add Neighbor class as placeholder 
Placeholder for per-negighbor structures

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
 2023-02-03 11:25:35 +01:00
Leonardo Bautista-Gomez 66824aedc6 Adding XML dump of results 2023-01-25 21:51:59 +01:00
Leonardo Bautista-Gomez fc7339dc91 Add configuration file, split configuration from simulation shape, fix bug about network degree and unbalanced row/column verification 2023-01-23 18:04:54 +01:00
leobago bf1a5a60e4 Adding multidimensional simulator and results module to gather data for visualization. 2023-01-16 22:43:52 +01:00