108 Commits

Author SHA1 Message Date
fbarbu15
914de83ec2
chore: store time filter fixes ()
* chore: store time filter fixes

* adjustments
2025-02-11 17:16:45 +02:00
Ivan FB
b3b902ae1c
waku_message.py: rename rateLimitProof to proof ()
This rename is needed because the REST responses from nwaku may contain
the proof field
2025-02-10 17:13:09 +02:00
fbarbu15
c217ea0343
chore: gowaku store fixes () 2025-02-05 13:55:44 +02:00
gabrielmer
54a0dc29e8
chore: updating the hash-computing function to use hex () 2025-01-31 12:11:19 +02:00
Ivan FB
03a4f24ce9
chore: log millisecond ()
* custom_logger.py: add millisecond precision
* pytest.ini set millisecond precision in logs
2025-01-31 09:21:44 +00:00
fbarbu15
247db73d75
chore: store fixes ()
* chore: store fixes

* chore: store fixes
2025-01-31 09:18:38 +02:00
fbarbu15
12a9ec96ca
chore: add reconciliation metrics () 2025-01-27 14:44:15 +02:00
AYAHASSAN287
110bdf5da0
Change tag name () 2025-01-14 15:33:12 +02:00
AYAHASSAN287
1a981a16e4
CI_RUNNERS ()
* Change number of threads for CI runners to 8

* change number of threads to 12

* Change number of threads to auto select

* change  number of threads to logical instead of auto

* change number of  threads to 150

* change total workers to 40

* Adding workflow_call in on section

* remove "remove_unwanted_software" from yml

* change path of requirements.txt

* modify path of .txt file again

* Change repo name

* Create docker volume

* Merge master to branch

* Revert changes  done in the branch

* try the sharding option

* Add pytest-shard 0.1.2 to requirements.txt

* reduce shards to 2

* Fix max number of shards error

* Modify pytest run command

* change number of shards  to =1

* increase shards to 4

* Modify pytest command

* Change shards to 4

* skip 3 tests

* skip rln tests

* skip test metric

* skip rln tests

* fix skipif mark

* Fix linters

* Fix linters 2

* run pre-commit command to fix linters

* Make each shard upload seperate report using artifacts

* Change number of shards to 5

* CHange artifacts version to 4

* increase shards to 8

* Increase shards to 11

* Make test_get_multiple_2000_store_messages run in seperate shard

* Mark  test_get_multiple_2000_store_messages to run in shard 1

* using logic in yml file to run test_cursor.py in seperate file

* Fix logic to run test_cursor.py in seperate shard

* Adding path of file instead of file name in yml file

* Fix error in pytest command

* rerun test test_get_multiple_2000_store_messages

* run test_get_multiple_2000_store_messages in separate shard

* Fix error in pytest  command

* Fix command again by using -k instead of test name

* Add test_rln.py again to job and increase shards to 13

* Run test_rln.py in single shard

* Fix pytest command

* Fix syntax error in pytest command

* Increase workers to 4

* Create new test file for test_get_multiple_2000_store_messages

* Collect reports into 1 report

* Modify aggregate reports

* Make changes to reports collecting

* Add more reporting ways

* Add send reports to discord again

* Fix command syntax error

* Revert changes

* Make changes to fix not executed tests issue

* remove 12 from matrix shards

* Try to fix missing test issue by adding collect-only

* Modify pytest command " remove collect only "

* Increate timeout for test test_get_multiple_2000_store_messages

* Reduce shards again to 8

* remove loadfile option

* Increase shards to 22

* increase shards to 42

* Increase shards to 49

* Increase shards to 63

* Modify test command to have 16 shards

* Change shards to 9

* Fix command of pytest

* Using ignore instead of -m

* Fix syntax error

* Modify test file path

* Increase shards to 16

* Modify test command

* fix: add multiple machines

* fix: prevent fail fast

* Remove multiple skips

* Revert changes in test_rln file

* Modify test command

fix: add multiple machines

fix: prevent fail fast

checkout on smoke_tests tag ()

* checkout on smoke_tests tag

* MOdify pytest command

* Update README.md

Add steps on how to use new tag for PR tests in readme file

Remove multiple skips

Revert changes in test_rln file

* Adding timeout to test test_on_empty_postgress_db

* Add comments in workflow for shards

---------

Co-authored-by: fbarbu15 <florin@status.im>
Co-authored-by: Florin Barbu <barbu_florin_adrian@yahoo.com>
2025-01-06 15:29:33 +02:00
AYAHASSAN287
1f853b3a11
checkout on smoke_tests tag ()
* checkout on smoke_tests tag

* MOdify pytest command

* Update README.md

Add steps on how to use new tag for PR tests in readme file
2024-12-27 10:10:12 +02:00
fbarbu15
25b995295b
chore: add rendezvousPeerFoundTotal_total metric () 2024-12-20 10:22:36 +08:00
Roman Zajic
dfdb7d3275
fix: comment out onchain rln tests () 2024-12-13 18:36:19 +08:00
AYAHASSAN287
013c6e8bb0
smoke_tests ()
* Selecting initial smoke tests set

* adding mark "smoke" in pytest.ini

* adding mark smoke to workflow file

* Remove allure reporting from yml file

* Adding more smoke tests

* Add PR image to new nwaku workflow

* change nwaku_daily.yml to test the PR job changes

* remove dependencies from yml file

* Remove secrets check from container yml file

* remove secrets from all files

* change image tag

* revert image tag

* Revert nwaku_daily.yml to origin

* Adding PR number to choose image

* adding docker-build-image to yml file

* adding docker-image-build dependencies

* Adding quay user & password

* Adding quay username & password

* Fix yml build

* Remove changes causing errors

* remove tests part to speedup the job

* add flag workflow_call: for reusable workflow

* checkout on branch instead of master

* trying to fetch from branch

* Check out specific branch

* make node1 input

* Adding node1 as input

* Add type to required input

* fix node input format

* change input node1 format

* Delete .github/workflows/container-image.yml

* Delete .github/workflows/nim_nwaku_pr.yml

* Create 2  files for PR tests

* revert original yml files

* Fix review points on PR

* fix review points

* revert test_common file to master

* revert nim_waku_daily to master

* Fix review points
2024-12-12 11:03:42 +02:00
fbarbu15
8425c0fed7
chore: fix wrong store node type ()
* chore: fix wrong store node type

* chore: adjust flaky LP test
2024-12-10 16:58:28 +02:00
fbarbu15
5caedf13c4
chore: metric updates ()
* chore: fix rln tests

* chore: fix rln tests

* revert wait_for_node_sec
2024-12-06 10:54:35 +02:00
fbarbu15
c95fff8ac3
chore: fix go waku lightprotocol tests ()
* chore: fix go waku lightprotocol tests

* chore: fix go waku lightprotocol tests
2024-11-27 18:05:52 +02:00
AYAHASSAN287
348a14cdea
Add known_issues tests ()
* Add draft test for example edge/service nodes

* Change nodes names & add loggers messages

* Adding test test_multiple_edge_service_nodes_communication

* adding test  test_store_no_peer_selected

* Adding 2 tests for store

* Add comments for test test_store_no_peer_selected

* Fix minor comment
2024-11-18 13:30:39 +02:00
AYAHASSAN287
b40938b030
E2E_Tests_CI_FIX ()
* add draft test case

* Adding test test_filter_3_senders_1_receiver

* Adding test test_filter_3_senders_45_msg_1_receiver

* add test test_filter_50_subscribe_node

* Remove comments and enhance tests

* Increase node limit to 1000 connection

* making PR ready with 3 tests

* Making changes for go-waku to pass

* Adding changes to make go-waku tests pass

* Change max nodes to 20 when node_2 = go-waku

* Fix CI failure because of nwaku

* Increase wait time for filter request

* Decrease number of nodes to pass the CI

* Add more wait to pass CI

* time_limit increase  to 120 to pass CI

* add flag filter-subscription-timeout to 600 instead of default value 300

* Additional changes for CI failure

* remove filter = true from subscribed filter node

* increase nodes to 15 in test_filter_many_subscribed_nodes

* test_filter_3_senders_multiple_msg_1_receiver

increase message_num to 12

* change max-connections to 50 instead of 1000

* commenting max-connection and filter timeout for CI failure

* Revert timeout back to 20
2024-11-10 09:48:47 +02:00
AYAHASSAN287
f5ff548e64
Ignore test_store_filter_interaction_with_six_nodes when NODE_2 = go-waku () 2024-11-07 17:30:03 +02:00
AYAHASSAN287
da90b9c3e1
E2E_Tests_part1 ()
* adding initial draft for repo example test

* Adding more steps to the example_six_nodes test

* draft3 with adding step5 to the testcase

* adding test test_store_filter_interaction_with_six_nodes

* adding draft of test test_2_filter_nodes

* adding 2 tests
1- test_msg_not_stored_when_ephemeral_true
2- test_msg_stored_when_ephemeral_false

* fix review comments and add final changes for additional 3 tests

* Fix indentation issue

* Fix indentation issue

* Fixing review comments

* Enhancements based on review

* Adding changes to make tests pass with NODE_2= GO-WAKU

* Fix CI failure in test_store_filter_interaction_with_six_nodes

* Fixing CI failure for test test_store_filter_interaction_with_six_nodes

* Add wait after filter request to fix CI failure

* increase wait for CI failure
2024-11-07 14:27:54 +02:00
fbarbu15
4d8e7e4955
chore: histogram metric update () 2024-10-31 10:11:25 +02:00
fbarbu15
dbc5bfe0f9
fix lp test () 2024-10-30 10:49:49 +02:00
AYAHASSAN287
e419b7f8a6
Waku edge tests all ()
* Adding function to calculate different time variants

exclude 5 tests for go-waku

* change second node to nwaku

* skip 2 tests failed for go-waku

* change node_2 back to nwaku

* skipping failed test for nwaku

* remove the skipping for nwaku node as requested
2024-10-28 12:30:40 +03:00
AYAHASSAN287
bd187ad118
adding test "test_store_not_include_data" ()
* adding test "test_store_not_include_data"

* adding test case for wrong peer address formatting

* try restore message with wrong peer id

* send peer address with wrong protocol

* Fixing review comments & add test for wrong topic

* adding test for topic content positive scenario

* adding test for different wrong content topic

* adding content topic & pubsubtopic tests

* adding test cases for wrong encoding 7 no encoding of pubsub topic

* adding test case test_time_filter_start_time_after_end_time

* adding more time tests

* adding tests with wrong start & end time

* adding invalid ascending test

* adding page_size tests

* adding invalid ascending test

* fix minor issues and adding comments

* fixing review comments

* minor change in test name

* Adding review comments
2024-10-24 13:16:37 +03:00
fbarbu15
aca216e95a
remove unwated software ()
* remove unwated software

* log fix

* log fix
2024-10-24 12:43:51 +03:00
fbarbu15
684d14c050
updated metric name () 2024-10-04 09:09:40 +03:00
shashank sanket
b0dc5206c9
Negative and edge cases for/store/v3/messages with query param hashes ()
* added test with hashes edge and boundry cases

* added 2 test with incorrect query param in cursor and hashes

* fixed linters error and handeliong for None error
2024-09-20 14:15:34 +05:30
shashank sanket
4c706c34bb
added store_test_cursor negative cases and edge cases () 2024-09-18 19:54:05 +05:30
fbarbu15
790e71db48
chore/fixes for nwaku updates ()
* fixes

* fixes

* fixes
2024-09-13 14:38:23 +03:00
fbarbu15
ef7ffac51f
update lp errors () 2024-09-12 05:58:34 +00:00
fbarbu15
86954c6270
store sync tests ()
* store sync tests

* fix

* store sync tests

* sync flag
2024-09-11 12:36:58 +03:00
fbarbu15
cc8bae75c1
test logs template () 2024-09-05 19:58:46 +08:00
fbarbu15
089b8eefce
metrics tests () 2024-08-30 14:15:45 +03:00
fbarbu15
4855cd710c
chore: check logs at teardown ()
* check logs at teardown

* fix

* fix
2024-08-27 11:56:25 +03:00
fbarbu15
945364b0b2
e2e tests () 2024-08-20 14:11:36 +03:00
fbarbu15
80210a079c
increase ci timeout () 2024-08-20 10:34:43 +08:00
Roman Zajic
a4c3a648cc
chore: RLNv2 tests update ()
* test: node startup time for valid_payloads_dynamic_at_slow_rate

* fix: remove timing debug info

* fix: reuse existing keystore file

* fix: remove skip marks for PR2612

* fix: remove skip marks for Issue 2837

* test: change valid_payloads_at_slow_rate to send 102 messages

* fix: remove existing keystore before new registration

* test: magical 20 messages

* fix: omit RLN params for static mode
- update test_valid_payloads_at_slow_rate
- update test_valid_payloads_at_spam_rate

* fix: condition check for rln-relay-dynamic

* fix: update static tests
- update test_valid_payloads_dynamic_at_slow_rate

* fix: add rln-relay-user-message-limit to registration

* fix: on-chain tests

* fix: valid_payloads_n1_with_rln_n2_without_rln_at_spam_rate

* fix: rename lrn method for lightpush setup
- delete test_valid_payloads_mixed_epoch_at_slow_rate

* fix: test_valid_payloads_lightpush_at_spam_rate

* fix: run registration only when necessary

* fix: reorder tests - lightpush first
- test workflow

* fix: use touch instead of unlink

* test: single test only test_valid_payloads_lightpush_at_spam_rate

* test: run 2 tests

* fix: remove reporting part from test workflow

* fix: all tests

* fix: use rmtree on keystore dir_path

* fix: use external rm

* fix: enable all RLN tests

* fix: further optimize number or registrations

* test: single on chain test

* test: two on chain tests

* test: swap order of tests

* test: reduce test logging and output docker log

* fix: rewrite keystore path related logic

* fix: use cache for keystore prefixes

* fix: index in setup_optional_rln_relay_nodes

* fix: delete test workflows
- revert env_vars
2024-08-09 16:13:17 +08:00
fbarbu15
68c4b57c08
lightpush changes ()
* lightpush changes

* lightpush changes
2024-08-05 16:51:48 +03:00
fbarbu15
4e96452119
use docker hub () 2024-07-29 15:51:04 +03:00
fbarbu15
6194c493f7
Chore/store propagation ()
* add store propagation delay

* incerease store propagation delay
2024-07-23 09:16:37 +02:00
fbarbu15
ae43bd4448
add store retry method () 2024-07-18 10:41:20 +02:00
fbarbu15
cfc6aa8f72
rate limit changes () 2024-07-17 13:27:09 +03:00
dependabot[bot]
a6e56885da
Bump setuptools from 69.0.3 to 70.0.0 ()
Bumps [setuptools](https://github.com/pypa/setuptools) from 69.0.3 to 70.0.0.
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](https://github.com/pypa/setuptools/compare/v69.0.3...v70.0.0)

---
updated-dependencies:
- dependency-name: setuptools
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: fbarbu15 <florin@status.im>
2024-07-16 10:05:14 +03:00
fbarbu15
b56a98d8a6
fix lp fails () 2024-07-16 09:43:07 +03:00
Roman Zajic
055541ad0d
fix: cluster_id 0 for peer store related tests ()
* fix: use cluster_id 0 for peer store related tests

* test: simulation for issue

* fix: use cluster_id not 0 and subscribe to static shard for go-waku

* fix: revert env values to original defaults
2024-07-15 15:47:42 +02:00
dependabot[bot]
03e577e558
Bump certifi from 2023.11.17 to 2024.7.4 ()
Bumps [certifi](https://github.com/certifi/python-certifi) from 2023.11.17 to 2024.7.4.
- [Commits](https://github.com/certifi/python-certifi/compare/2023.11.17...2024.07.04)

---
updated-dependencies:
- dependency-name: certifi
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: fbarbu15 <florin@status.im>
2024-07-12 18:01:01 +03:00
fbarbu15
a27c028104
chore: use another cluster id ()
* use another cluster id

* adjust tests
2024-07-11 23:00:18 +03:00
Roman Zajic
d5cd78950a
fix: revert ADDITIONAL_NODES to its original default () 2024-07-10 06:46:58 +02:00
Roman Zajic
6aa7716793
Test/peer exchange ()
* test: establish basic node setup for pe

* test: debug peer retrieval error with nwaku

* fix: disable discovery v5 on the requester node

* fix: assert node3 peer store to exact content

* test: get peers for filter node

* test: get peers after node1 was restarted

* fix: allow tests to run only when Node2 is Go-waku

* fix: revert NODE_1 to its original default
2024-07-09 14:07:48 +02:00
fbarbu15
07f4e1f438
add peer store capacity () 2024-07-04 11:59:54 +03:00