92 Commits

Author SHA1 Message Date
Csaba Kiraly
952c3c63a3
DASampling: more progress metrics
Expose sampling success as a metric as well

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-03-19 11:37:13 +01:00
Csaba Kiraly
fedb018fea
WIP restricted neighborhood
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-03-05 11:56:17 +01:00
Csaba Kiraly
d4096f4f1c
gereralize GossipSub setup
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-03-05 09:12:04 +01:00
Csaba Kiraly
5dc9ea0e59
WIP more sampling options
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-03-04 14:20:40 +01:00
Csaba Kiraly
878b0a1b94
DASampling: add global statistics
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-02-20 14:21:57 +01:00
Csaba Kiraly
3824cbbe38
Simulator: move progress stats between send and receive
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-02-20 14:21:16 +01:00
Csaba Kiraly
f8d5bfbb30
WIP: minimal sample generation and check
This is early WIP, it only checks if neighbors would be able to
provide all the samples needed by nodes.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-02-20 14:20:34 +01:00
Csaba Kiraly
c909f0b75d
make Neighbor objects peer with other Neighbor objects
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-02-20 11:08:28 +01:00
Csaba Kiraly
bc289555d3
node: addRowNeighbor and addColumnNeighbor
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-02-20 10:26:41 +01:00
Csaba Kiraly
2eb92b755a
adding individual Validator objects behind Node
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-02-20 09:16:32 +01:00
Csaba Kiraly
4d0a000a67
fixup: renaming 2024-02-20 09:13:43 +01:00
Csaba Kiraly
6c85ebfd35
renaming Validator object to Node
In the SubnetDas model Nodes behave as previous validators,
getting samples (whole columns) from GossipSub.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-02-20 09:13:31 +01:00
Csaba Kiraly
36d098cea3
Merge branch 'visual'
New visualizer module with updated plots, and plotting after each run.
2024-02-19 13:53:15 +01:00
Csaba Kiraly
b49be37489
handle two dimensions on Chi separately
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>

# Conflicts:
#	DAS/simulator.py
#	DAS/validator.py
2023-07-12 14:13:05 +02:00
Csaba Kiraly
e18822b8aa
handle 2 dimensions separately (except visualizer)
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>

# Conflicts:
#	DAS/simulator.py
#	DAS/validator.py
2023-07-12 14:13:05 +02:00
Csaba Kiraly
db5fd6c157
add TODO on proposerPublishTo
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-07-12 14:12:36 +02:00
leobago
562ef5122f More output 2023-06-11 19:30:10 +02:00
Csaba Kiraly
16e32a3f98
Merge branch 'develop' into failureMode 2023-05-02 15:05:54 +02:00
Csaba Kiraly
293914e1c3
move initBlock code after network setup
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-05-02 13:47:08 +02:00
Csaba Kiraly
06e70e1b40
configure bandwidth in mbps
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-05-02 13:37:57 +02:00
Leonardo Bautista-Gomez
dfec7bcde8
Clearer debugging data and add row/column distribution to results 2023-05-02 12:22:21 +02:00
Csaba Kiraly
f47f46a330
fix validator assignment when evenLineDistribution = True
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-05-02 12:19:08 +02:00
Csaba Kiraly
08e67cbeb1
measure validation progress more precisely
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-05-02 12:19:08 +02:00
Leo
b2df64f8b9
Merge pull request #42 from status-im/failureRate-exact
make failureRate exact
2023-04-19 16:52:08 +02:00
Csaba Kiraly
1638a18507
make failureRate exact
simplify code and make sure failureRate is the exact
portion of segments missing, not just a probability per
sample.

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-04-18 14:54:38 +02:00
Csaba Kiraly
b74ac19557
fixup: increase step counter while steps4StopCondition
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-04-18 12:49:59 +02:00
Leonardo Bautista-Gomez
d51cefabb7 Merge branch 'addDiagnostics' into develop 2023-04-13 13:39:33 +02:00
Leonardo Bautista-Gomez
c4ad3cf80e Small fix 2023-03-30 16:10:10 +02:00
Leonardo Bautista-Gomez
ae36844e7f Add stop condition fix 2023-03-30 14:26:14 +02:00
Leonardo Bautista-Gomez
d2a653b07c Remove plotting config 2023-03-30 14:11:12 +02:00
Leonardo Bautista-Gomez
1ae4352dad Fix merge remote-tracking branch 'origin/develop' into addDiagnostics 2023-03-30 14:06:17 +02:00
Leonardo Bautista-Gomez
699a912991 Merge branch 'develop' into addDiagnostics 2023-03-30 13:56:09 +02:00
Leonardo Bautista-Gomez
4b7bf81cee Remove stop condition fix 2023-03-30 13:52:40 +02:00
Leonardo Bautista-Gomez
98423d29c0 Typos and sets 2023-03-30 13:49:01 +02:00
Csaba Kiraly
1b4a225114
Merge pull request #35 from status-im/issue-29
Solving Issue 29 partially. Still remains the problems of stop condition.
2023-03-30 13:46:00 +02:00
Leo
7719f84a10
Switch from time steps to miliseconds (#30)
Switch from time steps to miliseconds
2023-03-30 13:41:50 +02:00
Leonardo Bautista-Gomez
296c4fb762 Rows and columns to sets 2023-03-30 13:36:48 +02:00
Leonardo Bautista-Gomez
795bb1d10d Move set to simulator for future diagnostic purposes 2023-03-30 13:15:42 +02:00
Leonardo Bautista-Gomez
9800161ac9 Switch from time steps to miliseconds. Rebase to traffic progress. 2023-03-30 11:35:44 +02:00
Leonardo Bautista-Gomez
e285890fa7 Fixes allocation bug, remove duplicates in rowIDs and columnIDs, add diagnostics when the block is not available. Add number of steps without progress to stop condition. 2023-03-29 16:42:09 +02:00
Csaba Kiraly
f85cdb401b
fix line allocation when evenLineDistribution=True
vector should have chi elements for each validator

Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-03-29 15:49:52 +02:00
Csaba Kiraly
75a9b484e9
fixup: close plot to release memory
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-03-27 23:28:12 +02:00
Csaba Kiraly
dc51727b32
plot progress per run
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-03-27 23:16:05 +02:00
Csaba Kiraly
eb4f451303
save progress and traffic statistics to XML
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-03-27 23:15:44 +02:00
Csaba Kiraly
23af30e381
add generalized metrics collection
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-03-27 22:29:22 +02:00
Csaba Kiraly
7e4074938a
add duplicate statistics
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-03-27 22:29:22 +02:00
Csaba Kiraly
6616cc799f
move traffic stats calculation to observer
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-03-27 22:29:20 +02:00
Csaba Kiraly
119777787e
add progress meters to observer
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-03-27 22:28:30 +02:00
Csaba Kiraly
037c4cd67a
count number of validators having all rows/columns
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-03-27 22:28:30 +02:00
Csaba Kiraly
122f6a8348
remove resetShape
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2023-03-27 11:37:22 +02:00