Commit Graph

74 Commits

Author SHA1 Message Date
fbarbu15 945364b0b2
e2e tests (#65) 2024-08-20 14:11:36 +03:00
fbarbu15 80210a079c
increase ci timeout (#66) 2024-08-20 10:34:43 +08:00
Roman Zajic a4c3a648cc
chore: RLNv2 tests update (#62)
* test: node startup time for valid_payloads_dynamic_at_slow_rate

* fix: remove timing debug info

* fix: reuse existing keystore file

* fix: remove skip marks for PR2612

* fix: remove skip marks for Issue 2837

* test: change valid_payloads_at_slow_rate to send 102 messages

* fix: remove existing keystore before new registration

* test: magical 20 messages

* fix: omit RLN params for static mode
- update test_valid_payloads_at_slow_rate
- update test_valid_payloads_at_spam_rate

* fix: condition check for rln-relay-dynamic

* fix: update static tests
- update test_valid_payloads_dynamic_at_slow_rate

* fix: add rln-relay-user-message-limit to registration

* fix: on-chain tests

* fix: valid_payloads_n1_with_rln_n2_without_rln_at_spam_rate

* fix: rename lrn method for lightpush setup
- delete test_valid_payloads_mixed_epoch_at_slow_rate

* fix: test_valid_payloads_lightpush_at_spam_rate

* fix: run registration only when necessary

* fix: reorder tests - lightpush first
- test workflow

* fix: use touch instead of unlink

* test: single test only test_valid_payloads_lightpush_at_spam_rate

* test: run 2 tests

* fix: remove reporting part from test workflow

* fix: all tests

* fix: use rmtree on keystore dir_path

* fix: use external rm

* fix: enable all RLN tests

* fix: further optimize number or registrations

* test: single on chain test

* test: two on chain tests

* test: swap order of tests

* test: reduce test logging and output docker log

* fix: rewrite keystore path related logic

* fix: use cache for keystore prefixes

* fix: index in setup_optional_rln_relay_nodes

* fix: delete test workflows
- revert env_vars
2024-08-09 16:13:17 +08:00
fbarbu15 68c4b57c08
lightpush changes (#64)
* lightpush changes

* lightpush changes
2024-08-05 16:51:48 +03:00
fbarbu15 4e96452119
use docker hub (#63) 2024-07-29 15:51:04 +03:00
fbarbu15 6194c493f7
Chore/store propagation (#61)
* add store propagation delay

* incerease store propagation delay
2024-07-23 09:16:37 +02:00
fbarbu15 ae43bd4448
add store retry method (#60) 2024-07-18 10:41:20 +02:00
fbarbu15 cfc6aa8f72
rate limit changes (#59) 2024-07-17 13:27:09 +03:00
dependabot[bot] a6e56885da
Bump setuptools from 69.0.3 to 70.0.0 (#58)
Bumps [setuptools](https://github.com/pypa/setuptools) from 69.0.3 to 70.0.0.
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](https://github.com/pypa/setuptools/compare/v69.0.3...v70.0.0)

---
updated-dependencies:
- dependency-name: setuptools
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: fbarbu15 <florin@status.im>
2024-07-16 10:05:14 +03:00
fbarbu15 b56a98d8a6
fix lp fails (#57) 2024-07-16 09:43:07 +03:00
Roman Zajic 055541ad0d
fix: cluster_id 0 for peer store related tests (#56)
* fix: use cluster_id 0 for peer store related tests

* test: simulation for issue

* fix: use cluster_id not 0 and subscribe to static shard for go-waku

* fix: revert env values to original defaults
2024-07-15 15:47:42 +02:00
dependabot[bot] 03e577e558
Bump certifi from 2023.11.17 to 2024.7.4 (#53)
Bumps [certifi](https://github.com/certifi/python-certifi) from 2023.11.17 to 2024.7.4.
- [Commits](https://github.com/certifi/python-certifi/compare/2023.11.17...2024.07.04)

---
updated-dependencies:
- dependency-name: certifi
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: fbarbu15 <florin@status.im>
2024-07-12 18:01:01 +03:00
fbarbu15 a27c028104
chore: use another cluster id (#55)
* use another cluster id

* adjust tests
2024-07-11 23:00:18 +03:00
Roman Zajic d5cd78950a
fix: revert ADDITIONAL_NODES to its original default (#54) 2024-07-10 06:46:58 +02:00
Roman Zajic 6aa7716793
Test/peer exchange (#51)
* test: establish basic node setup for pe

* test: debug peer retrieval error with nwaku

* fix: disable discovery v5 on the requester node

* fix: assert node3 peer store to exact content

* test: get peers for filter node

* test: get peers after node1 was restarted

* fix: allow tests to run only when Node2 is Go-waku

* fix: revert NODE_1 to its original default
2024-07-09 14:07:48 +02:00
fbarbu15 07f4e1f438
add peer store capacity (#52) 2024-07-04 11:59:54 +03:00
fbarbu15 95f8a791fa
chore: fix connection error message (#50) 2024-07-03 11:14:00 +03:00
Roman Zajic 0ce2572810
chore: refactor setup relay node for sharding (#48)
* fix: refactor setup relay for sharding

* fix: refactor also all related to _resolve_sharding_flags
2024-07-02 09:33:53 +02:00
dependabot[bot] e8d5f78288
Bump urllib3 from 2.1.0 to 2.2.2 (#47)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.1.0 to 2.2.2.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/2.1.0...2.2.2)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-01 13:33:10 +03:00
fbarbu15 c9ce9314c6
bugfixes (#49) 2024-07-01 13:32:14 +03:00
Roman Zajic ccad2a12f6
Test/peer connection management (#45)
* test: get peers from peer store

* test: add peers to peer store

* fix: add go_waku support

* test: placeholder for Issue 1549 solution test

* test: expect two peers for two protocols/services

* test: restart survival with persistent peer store

* fix: add issue to skip mark

* fix: move Waku related methods to waku_node module

* test: full peer store takeover

* fix: add kill of Node 1

* fix: remove debug info
- skip while waiting on issue 2792

* test: peer store content after node restart

* fix: revert nwaku image back to use latest

* fix: added delays to let nodes finish discovery

* fix: move peer_persistence config steps out of start

* fix: NODE1 default back to DEFAULT_GOWAKU

* fix: partial refactor for setup_first-second_relay_node

* test: daily workflow after refactor

* test: shorter name for daily workflow

* test: RLN only

* test: increase timeout

* test: check Sepolia API endpoint

* test: run RLN tests in single thread

* fix: remove Sepolia API check

* fix: skipp all RLN tests till registration works

* fix: remove test workflow
2024-06-21 23:40:40 +08:00
fbarbu15 aab71a92a7
Test/discv5 (#46)
* discv5 tests

* discv5 tests
2024-06-17 17:52:16 +03:00
fbarbu15 03973b8897
Test/store v3 (#38)
* first commit

* get message tests 1

* store tests with node restarts

* reliability tests

* store tests

* fixes

* more tests

* fixes

* new store tests

* new store tests

* adjustments

* adjust tests for go-waku

* postgress test

* postgress test

* fixes

* small fixes

* reliability updates

* postgress test

* adjsutmens for go-waku
2024-05-28 16:50:14 +03:00
Roman Zajic 39a6d13276
fix: occasional failure to check published message for RLN tests (#44)
* test: increased message propagation delay

* test: increased message propagation delay in all instances

* fix: delete test workflow
2024-05-27 22:34:56 +08:00
fbarbu15 84636b7a57
fix dial fail test (#43) 2024-05-24 17:30:09 +03:00
fbarbu15 46f6de18dd
Revert "--- (#41)" (#42)
This reverts commit 07e8ae32b2.
2024-05-22 10:17:12 +03:00
dependabot[bot] 07e8ae32b2
--- (#41)
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-21 17:24:04 +03:00
fbarbu15 2e9a3d1202
all message fields are now camel case (#40) 2024-05-20 13:10:53 +03:00
fbarbu15 73a1711d54
fixed for lightpush with big payload (#39) 2024-05-16 12:57:30 +03:00
fbarbu15 d0a84b2009
temp store content topic fix (#37)
* temp sote content topic fix

* fix go-waku
2024-05-13 15:14:14 +03:00
Roman Zajic b9ec0bb1d2
fix: skip health check for go-waku (#36) 2024-05-09 21:53:03 +08:00
Roman Zajic 06281de7c8
chore: node readiness (#35)
* test: wait longer for info endpoint to start

* test: health endpoint response parsing

* fix: health endpoint response parsing

* fix: remove debug from health response parsing

* fix: mark on chain tests to skip again

* fix: check_healthy accepts both text and json response

* fix: delete test workflow

* fix: simplify if statements
2024-05-08 20:50:05 +08:00
Roman Zajic 151233fddb
chore: RLN relay tests (#30)
* fix: add get_multiaddr_with_id step
- temporarily use local docker images

* fix: discard containers used for RLN registration

* fix: switch to use cluster ID 1 for RLN

* test: publish at slow and spam rate

* fix: shorten test data set

* fix: move RLN related code into separate class

* fix: use send only publish function
- add spam and alternate rate tests

* fix: use math.trunc instead of rounding

* fix: first message without delay

* fix: add one more second to messages with delay

* fix: add methods to setup non default RLN nodes

* fix: rewrite tests using steps rather than fixtures
- prepare for non default settings for RLN

* test: random epoch with valid_payloads_at_slow_rate

* test: random user message limit with valid payloads

* fix: skip test "random user message limit with valid payloads"

* fix: mark flaky "at variable_rate with valid payloads"

* fix: rename tests for easier debugging

* fix: mark valid_payloads_dynamic_at_slow_rate to skip

* fix: forgot to add actual file

* test: valid payloads dynamic(on chain) at spam rate
- extend timeout for ensure_ready() to 600s
- add ensure_healthy() for future use
- add text content based rest call
- remove NODE1, NODE2 imports

* fix: revert env_vars to source images from Harbor

* fix: reuse setup first and second rln relay node for setup_main_rln_relay_nodes

* fix: reuse register_rln_single_node for register_main_rln_relay_nodes

* fix: start using src.steps.common
- removed RLN test class inheritance from StepsRelay

* fix: test using whole data set at test payloads_at_slow_rate

* fix: switch to send msg and check for slow rate tests

* fix: add comment for skip check at first message

* fix: refactor payloads_at_variable_rate to use only one payload pattern

* fix: remove the plural from payloads_at_variable_rate

* fix: multiple class inheritance for TestRelayRLN

* test: node1 with rln node2 without rln at spam rate

* test: mixed epoch at slow rate

* test: add lightpush methods

* test: send valid payloads lightpush at spam rate

* fix: node1 to act as light push receiving node
- add setup lightpush node to spin off node2 with lightpush support

* fix: use NODE1 NODE2 instead of DEFAULT_NWAKU

* fix: no lightpush param required for plain RLN relay

* fix: comment for lightpush

* fix: comment for lightpush - wait for implementation

* fix: comment on chain tests

* fix: add lightpush case to publish_message

* fix: remove check_light_pushed_message_reaches_receiving_peer from StepsRLN

* fix: change comment for mixed_epoch_at_slow_rate

* test: happy and common case with 5 nodes

* fix: add all required fixtures explicitly

* fix: add timeout param to ensure_ready

* fix: skip RLN tests for go-waku

* fix: reformated with pre-commit

* fix: uncomment skip for debugging

* fix: put the skip back

* fix: change comment for on chain tests

* fix: run RLN tests in serial
- add grouping of tests to runner
- use smaller dataset for spam rate tests

* test: Nim to Nim workflow

* test: check also additional nodes for go-waku

* test: all nodes are nwaku

* fix: string quotes

* fix: remove additional nodes

* fix: re-arrange skip conditions

* test: RLN only

* fix: change default additional nodes to nwaku only

* fix: change additional nodes rather at top level workflow

* fix: enable all tests

* test: problems with current workdir

* test: rln only

* test: correct typo

* test: re-enable all tests
- remove current dir debug

* fix: nwaku additional nodes for nim to nim worklfow

* fix: re-able discord notification
- delete test workflow

* fix: add get_multiaddr_with_id step
- temporarily use local docker images

* fix: discard containers used for RLN registration

* fix: switch to use cluster ID 1 for RLN

* test: publish at slow and spam rate

* fix: shorten test data set

* fix: rebase onto master

* fix: use send only publish function
- add spam and alternate rate tests

* fix: use math.trunc instead of rounding

* fix: first message without delay

* fix: add one more second to messages with delay

* fix: add methods to setup non default RLN nodes

* fix: rewrite tests using steps rather than fixtures
- prepare for non default settings for RLN

* test: random epoch with valid_payloads_at_slow_rate

* test: random user message limit with valid payloads

* fix: skip test "random user message limit with valid payloads"

* fix: mark flaky "at variable_rate with valid payloads"

* fix: rename tests for easier debugging

* fix: mark valid_payloads_dynamic_at_slow_rate to skip

* fix: forgot to add actual file

* test: valid payloads dynamic(on chain) at spam rate
- extend timeout for ensure_ready() to 600s
- add ensure_healthy() for future use
- add text content based rest call
- remove NODE1, NODE2 imports

* fix: revert env_vars to source images from Harbor

* fix: reuse setup first and second rln relay node for setup_main_rln_relay_nodes

* fix: reuse register_rln_single_node for register_main_rln_relay_nodes

* fix: start using src.steps.common
- removed RLN test class inheritance from StepsRelay

* fix: test using whole data set at test payloads_at_slow_rate

* fix: switch to send msg and check for slow rate tests

* fix: add comment for skip check at first message

* fix: refactor payloads_at_variable_rate to use only one payload pattern

* fix: remove the plural from payloads_at_variable_rate

* fix: multiple class inheritance for TestRelayRLN

* test: node1 with rln node2 without rln at spam rate

* test: mixed epoch at slow rate

* test: add lightpush methods

* test: send valid payloads lightpush at spam rate

* fix: node1 to act as light push receiving node
- add setup lightpush node to spin off node2 with lightpush support

* fix: use NODE1 NODE2 instead of DEFAULT_NWAKU

* fix: no lightpush param required for plain RLN relay

* fix: comment for lightpush

* fix: comment for lightpush - wait for implementation

* fix: comment on chain tests

* fix: add lightpush case to publish_message

* fix: remove check_light_pushed_message_reaches_receiving_peer from StepsRLN

* fix: change comment for mixed_epoch_at_slow_rate

* test: happy and common case with 5 nodes

* fix: add all required fixtures explicitly

* fix: add timeout param to ensure_ready

* fix: skip RLN tests for go-waku

* fix: uncomment skip for debugging

* fix: put the skip back

* fix: change comment for on chain tests

* fix: run RLN tests in serial
- add grouping of tests to runner
- use smaller dataset for spam rate tests

* test: Nim to Nim workflow

* test: check also additional nodes for go-waku

* test: all nodes are nwaku

* fix: string quotes

* fix: remove additional nodes

* fix: re-arrange skip conditions

* test: RLN only

* fix: change default additional nodes to nwaku only

* fix: change additional nodes rather at top level workflow

* fix: enable all tests

* test: problems with current workdir

* test: rln only

* test: correct typo

* test: re-enable all tests
- remove current dir debug

* fix: nwaku additional nodes for nim to nim worklfow

* fix: re-able discord notification
- delete test workflow

* test: re-test again after rebase

* fix: wait longer for credential store

* test: try again with Discord report off

* fix: enable Discord
- delete test workflow
2024-05-07 08:31:12 +08:00
fbarbu15 edb1f59448
add shard flag (#34) 2024-04-29 12:44:25 +03:00
fbarbu15 69c8e3f4b6
chore: go waku connection issues (#33)
* add go-waku peers via api

* add go-waku peers via api

* fix add_node_peer

* fix add_node_peer

* fix add_node_peer

* fix add_node_peer

* move create_message to commons
2024-04-23 10:44:12 +03:00
fbarbu15 c1d4c0cc6b
lightpush and store bugfixes (#32)
* bugfixes

* store bugfixes

* fix 2567
2024-04-18 13:04:08 +03:00
fbarbu15 8d956b3d9c
Test/store part 1 (#31)
* first set of tests

* fix ci

* new tests

* finish publish tests

* new tests

* running nodes tests

* new tests

* finishing touches

* new test

* temp commit

* running node tests

* new tests

* new store tests

* store part 1
2024-04-17 08:37:31 +03:00
dependabot[bot] 53417a8665
Bump idna from 3.6 to 3.7 (#29)
Bumps [idna](https://github.com/kjd/idna) from 3.6 to 3.7.
- [Release notes](https://github.com/kjd/idna/releases)
- [Changelog](https://github.com/kjd/idna/blob/master/HISTORY.rst)
- [Commits](https://github.com/kjd/idna/compare/v3.6...v3.7)

---
updated-dependencies:
- dependency-name: idna
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-15 09:31:03 +03:00
fbarbu15 8b525f2b1a
Light push tests (#27)
* first set of tests

* fix ci

* new tests

* finish publish tests

* new tests

* running nodes tests

* new tests

* finishing touches

* new test

* fixes

* fixes
2024-04-11 13:00:53 +03:00
fbarbu15 4ba5ee2418
fix allure broken history links (#28) 2024-04-04 11:00:16 +03:00
fbarbu15 0095b5e04a
sharding tests part 1 (#24)
* sharding struct

* add peers

* running nodes tests

* cleanup sharding steps

* new sharding tests

* test_different_cluster_different_shard

* new tests

* new static sharding tests

* new auto sharding tests

* change structure

* running nodes tests

* new autosharding tests

* adjust tests

* new sharding tests

* sharding

* sharding filter

* add peers
2024-04-02 09:11:56 +03:00
fbarbu15 17ba9baf45
bug fixes for nwaku 2436 and 2286 (#26) 2024-03-22 15:55:06 +02:00
dependabot[bot] 82d7ffd3fe
Bump black from 24.2.0 to 24.3.0 (#25)
Bumps [black](https://github.com/psf/black) from 24.2.0 to 24.3.0.
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](https://github.com/psf/black/compare/24.2.0...24.3.0)

---
updated-dependencies:
- dependency-name: black
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-22 12:41:49 +02:00
Florin Barbu 124f6cd5ad
add repro scripts folder (#23) 2024-03-18 12:28:35 +02:00
Florin Barbu 26dd7144c7
skip because of 1054 (#22) 2024-03-15 18:11:59 +08:00
Florin Barbu 776d2841fe
fix filter test (#21)
* fix filter test

* small fix
2024-03-12 11:11:04 +02:00
Florin Barbu dd140dcb74
small fixes (#20)
* small fixes

* adjustments

* xfail test
2024-03-07 14:36:53 +02:00
Florin Barbu 7df4741a36
fixes for latest failures (#19) 2024-03-05 08:55:35 +02:00
Florin Barbu 9d769c47d7
remove legacy filter flag (#18)
* remove legacy filter flag

* fix ping test
2024-02-21 13:42:13 +02:00
Florin Barbu 98c76dc214
fixes for latest failures and bugfixes (#17)
* fixes for latest failures and bugfixes

* other fixes
2024-02-15 14:58:20 +02:00