206 Commits

Author SHA1 Message Date
Aya Hassan
0306e6dd5f Merge remote-tracking branch 'origin/master' into E2E_part2 2026-05-11 12:42:09 +02:00
Egor Rachkovskii
30de188c58 Mark test_s15_lightpush_retryable_error_then_recovery as xfail due to broken lightpush peer discovery. 2026-05-11 09:41:54 +01:00
Egor Rachkovskii
841e7d4bee Mark test_s10_edge_lightpush_propagation as xfail due to broken lightpush peer discovery. 2026-05-11 09:41:46 +01:00
Roman Zajic
34092b6efc
chore: Test waku fleet (#175)
* chore: build logos delivery lib locally

* test: soft attachment to waku.test

* chore: node1 node2 bootstrap from test fleet nodes
- selected test cases relay, store

* fix: cleanup artifacts after liblogosdelivery build

* chore: add fleet tests workflow

* fix: trigger on push and test

* fix: register markers

* test: add light_push to fleet tests

* test: add filter to fleet tests

* fix: add more store tests to fleet tests

* fix: add more relay to fleet tests

* fix: wf efficiency

* fix: wf syntax

* test: join fleet with real cluster ID shards RLN on

* fix: stop fleet tests when RLN registration fails

* fix: refactor monkeypatch

* fix: light_push tests

* fix: scoped assertion for store test in fleet mode

* fix: reduce comments

* fix: different propagation delay for fleet test

* fix: add fresh timestamp helper

* fix: reduce comments

* test: change to Waku v0.38.0 image temporarily

* fix: reduce log message

* fix: undo reduce log message

* fix: add scheduled run at 2 am.

* fix: fail fleet tests instead of skip when RLN is not working

* fix: refactor get_sample_timestamps

* fix: remove on push trigger for fleet wf
- reset back to use the latest docker image
2026-05-08 14:59:20 +08:00
Aya Hassan
4ad51bf619 mark the waku tests as docker_required 2026-05-07 15:09:39 +02:00
AYAHASSAN287
8b908ed543
rework old scripts & merge scripts (#138)
* rework old scripts & merge scripts

* Apply  changes to existing scripts

* Add merged scripts

* last test script added

* Fix review point

* Adding new test scenarios after review points

* Adding the second scenario after review comments
2026-05-07 14:35:51 +02:00
Aya Hassan
892ff96fb8 enhance comment on S26 test 2026-05-07 13:58:44 +02:00
Aya Hassan
ccba9ce708 Add assert_event_invariants 2026-05-07 13:43:29 +02:00
Aya Hassan
5d0c2830e1 fix the timeout review comment 2026-05-07 13:34:57 +02:00
Aya Hassan
505d24ff39 Address review comment about delay constant 2026-05-07 13:09:27 +02:00
Aya Hassan
30c426f613 event collector fix 2026-05-07 12:45:17 +02:00
Aya Hassan
92aeeaa378 cleanup unused lines 2026-05-07 12:31:41 +02:00
Aya Hassan
bf1731805b address review comments about xfail 2026-05-07 12:13:23 +02:00
Aya Hassan
2de9b03136 adding xfail mark for failed tests 2026-05-07 11:59:20 +02:00
Aya Hassan
c34148b855 First set of review comments 2026-05-07 11:21:36 +02:00
Aya Hassan
da655b47fb Modify the yml to continue on error 2026-05-05 10:26:42 +02:00
Aya Hassan
c6b5a02a41 remove the /true from yml to allow errors to exist 2026-05-05 10:05:00 +02:00
Aya Hassan
55f9612578 fix portsshift option 2026-05-04 20:34:58 +02:00
Aya Hassan
8e639c1d2a Modify S20 2026-05-04 17:12:18 +02:00
Aya Hassan
b415221859 Fix the ports conflict 2026-05-04 15:10:48 +02:00
Aya Hassan
b0165cef9f Modify the PR 2026-05-04 14:21:10 +02:00
Aya Hassan
7d5fbea89e commenting lightpush 2026-05-04 12:48:14 +02:00
Aya Hassan
9826117c21 revert tag in yml in latest 2026-05-01 21:05:38 +02:00
Aya Hassan
71bea94107 Fix review comments 2026-05-01 20:59:56 +02:00
Aya Hassan
510b2adb16 comment the skipped tests 2026-05-01 20:38:09 +02:00
Aya Hassan
db67d85127 FIx flaky tests 2026-05-01 20:14:56 +02:00
Aya Hassan
c73bdd6040 Merge branch 'temp_bindings_branch' into E2E_part2 2026-05-01 18:30:30 +02:00
Aya Hassan
507ddfab04 rename test file 2026-05-01 18:23:04 +02:00
Aya Hassan
ee6816c507 fix xfail syntax error 2026-05-01 14:51:24 +02:00
Aya Hassan
4aa64c70fe Change image name 2026-05-01 13:33:20 +02:00
Aya Hassan
882b186f3b Ignore s20 / s31 for errors 2026-05-01 00:48:42 +02:00
Aya Hassan
9191be1da9 fix s26 2026-04-30 23:35:10 +02:00
Aya Hassan
5d1614f93b Ignore S19 2026-04-30 19:02:57 +02:00
Egor Rachkovskii
f219c807d5
Add relay-to-lightpush fallback integration tests (S08/S09) (#180)
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
2026-04-30 17:05:06 +01:00
Egor Rachkovskii
a85223a79c
Add S02/S12 send API tests and PR CI pipeline (#174)
* Add tests for auto-subscribe on first send and isolated sender with no peers

* Add PR CI workflow with tiered test strategy

- pr_tests.yml: build job with cache, wrapper-tests, smoke-tests,
  and label-triggered full-suite
- test_common.yml: add deploy_allure/send_discord inputs so PR runs
  skip reporting side effects
- Add docker_required marker to S19 (needs Docker, excluded from
  wrapper-only CI job)
- Register docker_required marker in pytest.ini

* Document PR CI test workflows in README

* Refine PR CI test strategy:
- Exclude `docker_required` tests from smoke set in `pr_tests.yml`.
- Add `wait_for_connected` helper for connection state checks.
- Update S19 test to dynamically create and clean up the store node setup.
- General simplifications and improved test stability.

* Add `wait_for_connected` assertion to ensure sender connection state before propagation test

* Refine tests and CI workflows:
- Replace `ERROR_TIMEOUT_S` with `ERROR_AFTER_CACHE_EXPIRY_TIMEOUT_S` in `test_send_e2e.py`.
- Adjust timeout assertion for better clarity and accuracy.
- Update `pr_tests.yml` to add retries (`--reruns`) and ignore wrapper tests in smoke tests.
- Change `test_common.yml` default Discord reporting to `false`.

* Normalize `portsshift` to `portsShift` in `test_send_e2e.py` configuration definitions.

---------

Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
2026-04-30 16:15:50 +01:00
Aya Hassan
16bef0354b Fix some tests 2026-04-30 13:30:18 +02:00
Egor Rachkovskii
df073119ba
Add S07 and S10 send API tests with event invariants helper (#176)
* Add `assert_event_invariants` to enforce per-request event constraints and integrate into relevant tests

* Integrate `assert_event_invariants` into edge and store tests

* Remove redundant comments from `test_send_e2e.py`

---------

Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
2026-04-29 13:21:56 +01:00
Egor Rachkovskii
4d4bd535c4
Improve wait_for_event loop logic and add assert_event_invariants helper (#178)
- Refactored the `wait_for_event` function for clarity and to ensure proper deadline handling within the loop.
- Introduced `assert_event_invariants` to validate per-request event properties, enforcing invariants like correct `requestId`, no duplicate terminal events, and proper timing between `Propagated` and `Sent`.
- Added tests for `assert_event_invariants` enforcement in `S14` and `S15` lightpush scenarios.

Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
2026-04-28 17:44:27 +01:00
Aya Hassan
8c7979ce67 Add S31 2026-04-27 10:46:47 +02:00
Aya Hassan
f6a558b8e7 Add S30 2026-04-27 10:42:46 +02:00
Aya Hassan
fb957dd8e8 Add S26 2026-04-26 18:10:13 +02:00
Aya Hassan
9e11ccb6bd Adding S24 2026-04-26 16:49:41 +02:00
Aya Hassan
572b50c0b1 Adding S22/S23 2026-04-25 19:18:53 +02:00
Aya Hassan
91a9fc55eb Merge branch 'master' into temp_bindings_branch 2026-04-25 16:29:47 +02:00
AYAHASSAN287
be5d3d19f7
Fix for wrong url of reports (#177)
* Fix for wrong url of reports

* remove the delete hidden file step

* work around for the cleanup of >200k to clean all

* add additional cleanup

* fix clean up

* another fix trail

* restore the number of shards
2026-04-23 12:57:42 +02:00
Aya Hassan
060d50afbb Fix review comments 2026-04-21 18:15:46 +02:00
Aya Hassan
e27d64a1a4 Adding S21 2026-04-21 16:46:00 +02:00
Aya Hassan
34cfb80b5f Modify S19 test 2026-04-21 13:48:24 +02:00
Egor Rachkovskii
df69919a7b
Add S06 relay-only test and fix wrapper helpers (#173)
* - Add S06 relay-only test case for testing message propagation without a store.
- Update `wrapper_helpers` for clearer event type handling and type annotations (`Optional[...]` usage).
- Simplify `get_node_multiaddr` to retrieve addresses via `get_node_info_raw`.
- Refactor `wrappers_manager` to adjust bindings path to `vendor` directory and add `get_node_info_raw` method.
- Update `.gitignore` to exclude `store.sqlite3*`.

* Refactor S06 relay-only test: replace try-finally blocks with context managers for clarity and conciseness.

* Migrate S06 relay-only test to `test_send_e2e.py` and refactor with `StepsCommon` for reusability.

---------

Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
2026-04-20 14:33:42 +03:00
Aya Hassan
73884ee8a5 add S19 2026-04-19 22:01:31 +02:00