226 Commits

Author SHA1 Message Date
Aya Hassan
26db08e2ef removed extra comments 2026-05-14 13:37:45 +02:00
Aya Hassan
85b9976a10 skip S01 again 2026-05-14 12:48:38 +02:00
Aya Hassan
f264573dcc Changing the test files names 2026-05-14 12:42:30 +02:00
Aya Hassan
00580bdec6 remove the wrapped text code from test file 2026-05-14 11:59:29 +02:00
Aya Hassan
46972e8814 restore the xfail mark again 2026-05-12 20:30:28 +02:00
Aya Hassan
7e2a4f8e2c comment the skip line to try S01 again 2026-05-12 20:22:56 +02:00
Aya Hassan
b0c253d134 use skip instead of xfail 2026-05-12 20:06:49 +02:00
Aya Hassan
1b845c73e3 mark the second S01 test as xfail too 2026-05-12 20:02:12 +02:00
Aya Hassan
fd60740c19 mark S01 with xfail 2026-05-12 19:52:16 +02:00
Aya Hassan
6c97ce3bd5 modify the S01 test 2026-05-12 19:28:58 +02:00
Aya Hassan
5259e3c9c5 bump logos-delivery-python-bindings to include destroy_keep_ctx 2026-05-12 19:17:35 +02:00
Aya Hassan
b26ff610ec Add the new test file to the PR job 2026-05-12 18:02:39 +02:00
Aya Hassan
bdee7d62b5 Fix the yml file error 2026-05-12 17:46:10 +02:00
Aya Hassan
8742dfbcf2 Merge remote-tracking branch 'origin/master' into e2e_part3 2026-05-12 17:37:50 +02:00
Aya Hassan
c89ebe653c Adding the new tests in part3 file 2026-05-12 17:27:06 +02:00
Aya Hassan
184610a84c Adding test S05 2026-05-12 16:21:59 +02:00
Aya Hassan
959bda526e modify s11 scenario to pass 2026-05-11 16:44:23 +02:00
AYAHASSAN287
11197db624
e2e_part2 (#179)
* add test s17

* Add temp changes

* Add s17 positive / negative scenarios

* add S19

* Add S06 relay-only test and fix wrapper helpers (#173)

* - Add S06 relay-only test case for testing message propagation without a store.
- Update `wrapper_helpers` for clearer event type handling and type annotations (`Optional[...]` usage).
- Simplify `get_node_multiaddr` to retrieve addresses via `get_node_info_raw`.
- Refactor `wrappers_manager` to adjust bindings path to `vendor` directory and add `get_node_info_raw` method.
- Update `.gitignore` to exclude `store.sqlite3*`.

* Refactor S06 relay-only test: replace try-finally blocks with context managers for clarity and conciseness.

* Migrate S06 relay-only test to `test_send_e2e.py` and refactor with `StepsCommon` for reusability.

---------

Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>

* Modify S19 test

* Adding S21

* Fix review comments

* Adding S22/S23

* Adding S24

* Add S26

* Add S30

* Add S31

* Improve `wait_for_event` loop logic and add `assert_event_invariants` helper (#178)

- Refactored the `wait_for_event` function for clarity and to ensure proper deadline handling within the loop.
- Introduced `assert_event_invariants` to validate per-request event properties, enforcing invariants like correct `requestId`, no duplicate terminal events, and proper timing between `Propagated` and `Sent`.
- Added tests for `assert_event_invariants` enforcement in `S14` and `S15` lightpush scenarios.

Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>

* Add S07 and S10 send API tests with event invariants helper  (#176)

* Add `assert_event_invariants` to enforce per-request event constraints and integrate into relevant tests

* Integrate `assert_event_invariants` into edge and store tests

* Remove redundant comments from `test_send_e2e.py`

---------

Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>

* Fix some tests

* Add S02/S12 send API tests and PR CI pipeline (#174)

* Add tests for auto-subscribe on first send and isolated sender with no peers

* Add PR CI workflow with tiered test strategy

- pr_tests.yml: build job with cache, wrapper-tests, smoke-tests,
  and label-triggered full-suite
- test_common.yml: add deploy_allure/send_discord inputs so PR runs
  skip reporting side effects
- Add docker_required marker to S19 (needs Docker, excluded from
  wrapper-only CI job)
- Register docker_required marker in pytest.ini

* Document PR CI test workflows in README

* Refine PR CI test strategy:
- Exclude `docker_required` tests from smoke set in `pr_tests.yml`.
- Add `wait_for_connected` helper for connection state checks.
- Update S19 test to dynamically create and clean up the store node setup.
- General simplifications and improved test stability.

* Add `wait_for_connected` assertion to ensure sender connection state before propagation test

* Refine tests and CI workflows:
- Replace `ERROR_TIMEOUT_S` with `ERROR_AFTER_CACHE_EXPIRY_TIMEOUT_S` in `test_send_e2e.py`.
- Adjust timeout assertion for better clarity and accuracy.
- Update `pr_tests.yml` to add retries (`--reruns`) and ignore wrapper tests in smoke tests.
- Change `test_common.yml` default Discord reporting to `false`.

* Normalize `portsshift` to `portsShift` in `test_send_e2e.py` configuration definitions.

---------

Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>

* Add relay-to-lightpush fallback integration tests (S08/S09) (#180)

Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>

* Ignore S19

* fix s26

* Ignore s20 / s31 for errors

* Change image name

* fix xfail syntax error

* rename test file

* FIx flaky tests

* comment the skipped tests

* Fix review comments

* revert tag in yml in latest

* commenting lightpush

* Modify the PR

* Fix the ports conflict

* Modify S20

* fix portsshift option

* remove the /true from yml to allow errors to exist

* Modify the yml to continue on error

* First set of review comments

* adding xfail mark for failed tests

* address review comments about xfail

* cleanup unused lines

* event collector fix

* Address review comment about delay constant

* fix the timeout review comment

* Add assert_event_invariants

* enhance comment on S26 test

* mark the waku tests as docker_required

* Mark `test_s10_edge_lightpush_propagation` as xfail due to broken lightpush peer discovery.

* Mark `test_s15_lightpush_retryable_error_then_recovery` as xfail due to broken lightpush peer discovery.

---------

Co-authored-by: Egor Rachkovskii <32649334+at0m1x19@users.noreply.github.com>
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
2026-05-11 15:53:18 +02:00
Aya Hassan
fbfd8dccc7 Adding S11 2026-05-10 23:08:06 +02:00
Aya Hassan
c2ad16aaf5 Add S04 2026-05-09 21:03:31 +02:00
Aya Hassan
a399681a63 Add S03 2026-05-09 20:37:56 +02:00
Aya Hassan
dad5e27a61 add S01 second scenario 2026-05-09 20:32:47 +02:00
Roman Zajic
34092b6efc
chore: Test waku fleet (#175)
* chore: build logos delivery lib locally

* test: soft attachment to waku.test

* chore: node1 node2 bootstrap from test fleet nodes
- selected test cases relay, store

* fix: cleanup artifacts after liblogosdelivery build

* chore: add fleet tests workflow

* fix: trigger on push and test

* fix: register markers

* test: add light_push to fleet tests

* test: add filter to fleet tests

* fix: add more store tests to fleet tests

* fix: add more relay to fleet tests

* fix: wf efficiency

* fix: wf syntax

* test: join fleet with real cluster ID shards RLN on

* fix: stop fleet tests when RLN registration fails

* fix: refactor monkeypatch

* fix: light_push tests

* fix: scoped assertion for store test in fleet mode

* fix: reduce comments

* fix: different propagation delay for fleet test

* fix: add fresh timestamp helper

* fix: reduce comments

* test: change to Waku v0.38.0 image temporarily

* fix: reduce log message

* fix: undo reduce log message

* fix: add scheduled run at 2 am.

* fix: fail fleet tests instead of skip when RLN is not working

* fix: refactor get_sample_timestamps

* fix: remove on push trigger for fleet wf
- reset back to use the latest docker image
2026-05-08 14:59:20 +08:00
Aya Hassan
3b588f878d Add S01 2026-05-07 22:27:39 +02:00
Aya Hassan
4ad51bf619 mark the waku tests as docker_required 2026-05-07 15:09:39 +02:00
AYAHASSAN287
8b908ed543
rework old scripts & merge scripts (#138)
* rework old scripts & merge scripts

* Apply  changes to existing scripts

* Add merged scripts

* last test script added

* Fix review point

* Adding new test scenarios after review points

* Adding the second scenario after review comments
2026-05-07 14:35:51 +02:00
Aya Hassan
892ff96fb8 enhance comment on S26 test 2026-05-07 13:58:44 +02:00
Aya Hassan
ccba9ce708 Add assert_event_invariants 2026-05-07 13:43:29 +02:00
Aya Hassan
5d0c2830e1 fix the timeout review comment 2026-05-07 13:34:57 +02:00
Aya Hassan
505d24ff39 Address review comment about delay constant 2026-05-07 13:09:27 +02:00
Aya Hassan
30c426f613 event collector fix 2026-05-07 12:45:17 +02:00
Aya Hassan
92aeeaa378 cleanup unused lines 2026-05-07 12:31:41 +02:00
Aya Hassan
bf1731805b address review comments about xfail 2026-05-07 12:13:23 +02:00
Aya Hassan
2de9b03136 adding xfail mark for failed tests 2026-05-07 11:59:20 +02:00
Aya Hassan
c34148b855 First set of review comments 2026-05-07 11:21:36 +02:00
Aya Hassan
da655b47fb Modify the yml to continue on error 2026-05-05 10:26:42 +02:00
Aya Hassan
c6b5a02a41 remove the /true from yml to allow errors to exist 2026-05-05 10:05:00 +02:00
Aya Hassan
55f9612578 fix portsshift option 2026-05-04 20:34:58 +02:00
Aya Hassan
8e639c1d2a Modify S20 2026-05-04 17:12:18 +02:00
Aya Hassan
b415221859 Fix the ports conflict 2026-05-04 15:10:48 +02:00
Aya Hassan
b0165cef9f Modify the PR 2026-05-04 14:21:10 +02:00
Aya Hassan
7d5fbea89e commenting lightpush 2026-05-04 12:48:14 +02:00
Aya Hassan
9826117c21 revert tag in yml in latest 2026-05-01 21:05:38 +02:00
Aya Hassan
71bea94107 Fix review comments 2026-05-01 20:59:56 +02:00
Aya Hassan
510b2adb16 comment the skipped tests 2026-05-01 20:38:09 +02:00
Aya Hassan
db67d85127 FIx flaky tests 2026-05-01 20:14:56 +02:00
Aya Hassan
c73bdd6040 Merge branch 'temp_bindings_branch' into E2E_part2 2026-05-01 18:30:30 +02:00
Aya Hassan
507ddfab04 rename test file 2026-05-01 18:23:04 +02:00
Aya Hassan
ee6816c507 fix xfail syntax error 2026-05-01 14:51:24 +02:00
Aya Hassan
4aa64c70fe Change image name 2026-05-01 13:33:20 +02:00