55 Commits

Author SHA1 Message Date
aya
9b99139ac1 Add more reporting ways 2024-12-25 17:59:00 +02:00
aya
bc8f1faa68 Make changes to reports collecting 2024-12-25 17:39:26 +02:00
aya
d5dcd4270b Modify aggregate reports 2024-12-25 17:02:47 +02:00
aya
b793a0bf59 Collect reports into 1 report 2024-12-25 16:30:16 +02:00
aya
1395d4eea3 Create new test file for test_get_multiple_2000_store_messages 2024-12-25 16:06:01 +02:00
aya
7f2be8e7d8 Increase workers to 4 2024-12-25 15:53:31 +02:00
aya
9e460871e2 Fix syntax error in pytest command 2024-12-25 15:31:15 +02:00
aya
f3ca6c932e Fix pytest command 2024-12-25 15:21:05 +02:00
aya
36f6ff2821 Run test_rln.py in single shard 2024-12-25 15:14:46 +02:00
aya
82abd26f45 Add test_rln.py again to job and increase shards to 13 2024-12-25 14:59:22 +02:00
aya
c9925a56c3 Fix command again by using -k instead of test name 2024-12-25 14:39:33 +02:00
aya
b8678bfb1f Fix error in pytest command 2024-12-25 14:28:03 +02:00
aya
c2ccaea7ba run test_get_multiple_2000_store_messages in separate shard 2024-12-25 14:22:11 +02:00
aya
adcfc49684 rerun test test_get_multiple_2000_store_messages 2024-12-25 13:32:42 +02:00
aya
ce434acebc Fix error in pytest command 2024-12-25 13:06:44 +02:00
aya
56fc12d7f5 Adding path of file instead of file name in yml file 2024-12-25 13:01:32 +02:00
aya
f1499c55f6 Fix logic to run test_cursor.py in seperate shard 2024-12-25 12:36:52 +02:00
aya
20d44b6154 using logic in yml file to run test_cursor.py in seperate file 2024-12-25 12:35:24 +02:00
aya
36563f7864 Mark test_get_multiple_2000_store_messages to run in shard 1 2024-12-25 12:14:44 +02:00
aya
2b01284f24 Make test_get_multiple_2000_store_messages run in seperate shard 2024-12-25 12:06:26 +02:00
aya
cb64a98226 Increase shards to 11 2024-12-24 19:24:35 +02:00
aya
57d17588e7 increase shards to 8 2024-12-24 19:05:35 +02:00
aya
17d11c7a08 CHange artifacts version to 4 2024-12-24 18:03:27 +02:00
aya
d70841895f Change number of shards to 5 2024-12-24 18:01:03 +02:00
aya
3730872dc5 Make each shard upload seperate report using artifacts 2024-12-24 17:07:06 +02:00
aya
6a12266897 Fix linters 2 2024-12-24 16:50:47 +02:00
aya
2463c42724 Fix linters 2024-12-24 16:47:10 +02:00
aya
5bc53559ed Change shards to 4 2024-12-15 12:29:35 +02:00
aya
f09d58667f Modify pytest command 2024-12-15 11:37:18 +02:00
aya
b1288391c8 increase shards to 4 2024-12-15 10:37:08 +02:00
aya
9cd19cdc8e change number of shards to =1 2024-12-15 09:48:11 +02:00
aya
6151559f49 Modify pytest run command 2024-12-12 10:46:27 +02:00
aya
6d52f4d00e Fix max number of shards error 2024-12-12 10:39:53 +02:00
aya
f257591626 reduce shards to 2 2024-12-12 10:31:12 +02:00
aya
41d4e38382 try the sharding option 2024-12-12 10:00:06 +02:00
aya
34901ad692 Revert changes done in the branch 2024-12-12 08:26:49 +02:00
aya
8e80b15c1c Change repo name 2024-12-04 13:43:32 +02:00
aya
e6792bf3b4 modify path of .txt file again 2024-12-04 12:00:03 +02:00
aya
7d43de8d2f change path of requirements.txt 2024-12-04 11:55:50 +02:00
aya
9580e59161 remove "remove_unwanted_software" from yml 2024-12-04 11:41:26 +02:00
aya
036e029dd6 change total workers to 40 2024-12-02 13:05:33 +02:00
aya
236e3ca938 change number of threads to 150 2024-12-02 12:43:15 +02:00
aya
0c4604aaf9 change number of threads to logical instead of auto 2024-12-02 12:33:01 +02:00
aya
9d1e1af6c6 Change number of threads to auto select 2024-12-02 12:25:38 +02:00
aya
2a9b91969a change number of threads to 12 2024-11-25 09:22:50 +02:00
aya
a5ca5fea33 Change number of threads for CI runners to 8 2024-11-25 08:10:58 +02:00
fbarbu15
aca216e95a
remove unwated software (#79)
* remove unwated software

* log fix

* log fix
2024-10-24 12:43:51 +03:00
fbarbu15
80210a079c
increase ci timeout (#66) 2024-08-20 10:34:43 +08:00
fbarbu15
4e96452119
use docker hub (#63) 2024-07-29 15:51:04 +03:00
Roman Zajic
151233fddb
chore: RLN relay tests (#30)
* fix: add get_multiaddr_with_id step
- temporarily use local docker images

* fix: discard containers used for RLN registration

* fix: switch to use cluster ID 1 for RLN

* test: publish at slow and spam rate

* fix: shorten test data set

* fix: move RLN related code into separate class

* fix: use send only publish function
- add spam and alternate rate tests

* fix: use math.trunc instead of rounding

* fix: first message without delay

* fix: add one more second to messages with delay

* fix: add methods to setup non default RLN nodes

* fix: rewrite tests using steps rather than fixtures
- prepare for non default settings for RLN

* test: random epoch with valid_payloads_at_slow_rate

* test: random user message limit with valid payloads

* fix: skip test "random user message limit with valid payloads"

* fix: mark flaky "at variable_rate with valid payloads"

* fix: rename tests for easier debugging

* fix: mark valid_payloads_dynamic_at_slow_rate to skip

* fix: forgot to add actual file

* test: valid payloads dynamic(on chain) at spam rate
- extend timeout for ensure_ready() to 600s
- add ensure_healthy() for future use
- add text content based rest call
- remove NODE1, NODE2 imports

* fix: revert env_vars to source images from Harbor

* fix: reuse setup first and second rln relay node for setup_main_rln_relay_nodes

* fix: reuse register_rln_single_node for register_main_rln_relay_nodes

* fix: start using src.steps.common
- removed RLN test class inheritance from StepsRelay

* fix: test using whole data set at test payloads_at_slow_rate

* fix: switch to send msg and check for slow rate tests

* fix: add comment for skip check at first message

* fix: refactor payloads_at_variable_rate to use only one payload pattern

* fix: remove the plural from payloads_at_variable_rate

* fix: multiple class inheritance for TestRelayRLN

* test: node1 with rln node2 without rln at spam rate

* test: mixed epoch at slow rate

* test: add lightpush methods

* test: send valid payloads lightpush at spam rate

* fix: node1 to act as light push receiving node
- add setup lightpush node to spin off node2 with lightpush support

* fix: use NODE1 NODE2 instead of DEFAULT_NWAKU

* fix: no lightpush param required for plain RLN relay

* fix: comment for lightpush

* fix: comment for lightpush - wait for implementation

* fix: comment on chain tests

* fix: add lightpush case to publish_message

* fix: remove check_light_pushed_message_reaches_receiving_peer from StepsRLN

* fix: change comment for mixed_epoch_at_slow_rate

* test: happy and common case with 5 nodes

* fix: add all required fixtures explicitly

* fix: add timeout param to ensure_ready

* fix: skip RLN tests for go-waku

* fix: reformated with pre-commit

* fix: uncomment skip for debugging

* fix: put the skip back

* fix: change comment for on chain tests

* fix: run RLN tests in serial
- add grouping of tests to runner
- use smaller dataset for spam rate tests

* test: Nim to Nim workflow

* test: check also additional nodes for go-waku

* test: all nodes are nwaku

* fix: string quotes

* fix: remove additional nodes

* fix: re-arrange skip conditions

* test: RLN only

* fix: change default additional nodes to nwaku only

* fix: change additional nodes rather at top level workflow

* fix: enable all tests

* test: problems with current workdir

* test: rln only

* test: correct typo

* test: re-enable all tests
- remove current dir debug

* fix: nwaku additional nodes for nim to nim worklfow

* fix: re-able discord notification
- delete test workflow

* fix: add get_multiaddr_with_id step
- temporarily use local docker images

* fix: discard containers used for RLN registration

* fix: switch to use cluster ID 1 for RLN

* test: publish at slow and spam rate

* fix: shorten test data set

* fix: rebase onto master

* fix: use send only publish function
- add spam and alternate rate tests

* fix: use math.trunc instead of rounding

* fix: first message without delay

* fix: add one more second to messages with delay

* fix: add methods to setup non default RLN nodes

* fix: rewrite tests using steps rather than fixtures
- prepare for non default settings for RLN

* test: random epoch with valid_payloads_at_slow_rate

* test: random user message limit with valid payloads

* fix: skip test "random user message limit with valid payloads"

* fix: mark flaky "at variable_rate with valid payloads"

* fix: rename tests for easier debugging

* fix: mark valid_payloads_dynamic_at_slow_rate to skip

* fix: forgot to add actual file

* test: valid payloads dynamic(on chain) at spam rate
- extend timeout for ensure_ready() to 600s
- add ensure_healthy() for future use
- add text content based rest call
- remove NODE1, NODE2 imports

* fix: revert env_vars to source images from Harbor

* fix: reuse setup first and second rln relay node for setup_main_rln_relay_nodes

* fix: reuse register_rln_single_node for register_main_rln_relay_nodes

* fix: start using src.steps.common
- removed RLN test class inheritance from StepsRelay

* fix: test using whole data set at test payloads_at_slow_rate

* fix: switch to send msg and check for slow rate tests

* fix: add comment for skip check at first message

* fix: refactor payloads_at_variable_rate to use only one payload pattern

* fix: remove the plural from payloads_at_variable_rate

* fix: multiple class inheritance for TestRelayRLN

* test: node1 with rln node2 without rln at spam rate

* test: mixed epoch at slow rate

* test: add lightpush methods

* test: send valid payloads lightpush at spam rate

* fix: node1 to act as light push receiving node
- add setup lightpush node to spin off node2 with lightpush support

* fix: use NODE1 NODE2 instead of DEFAULT_NWAKU

* fix: no lightpush param required for plain RLN relay

* fix: comment for lightpush

* fix: comment for lightpush - wait for implementation

* fix: comment on chain tests

* fix: add lightpush case to publish_message

* fix: remove check_light_pushed_message_reaches_receiving_peer from StepsRLN

* fix: change comment for mixed_epoch_at_slow_rate

* test: happy and common case with 5 nodes

* fix: add all required fixtures explicitly

* fix: add timeout param to ensure_ready

* fix: skip RLN tests for go-waku

* fix: uncomment skip for debugging

* fix: put the skip back

* fix: change comment for on chain tests

* fix: run RLN tests in serial
- add grouping of tests to runner
- use smaller dataset for spam rate tests

* test: Nim to Nim workflow

* test: check also additional nodes for go-waku

* test: all nodes are nwaku

* fix: string quotes

* fix: remove additional nodes

* fix: re-arrange skip conditions

* test: RLN only

* fix: change default additional nodes to nwaku only

* fix: change additional nodes rather at top level workflow

* fix: enable all tests

* test: problems with current workdir

* test: rln only

* test: correct typo

* test: re-enable all tests
- remove current dir debug

* fix: nwaku additional nodes for nim to nim worklfow

* fix: re-able discord notification
- delete test workflow

* test: re-test again after rebase

* fix: wait longer for credential store

* test: try again with Discord report off

* fix: enable Discord
- delete test workflow
2024-05-07 08:31:12 +08:00