* run CI for latest release
* Fix failing CI tests
* fix: add RLN_CREDENTIALS variable to workflow
* fix: skip RLN tests temporarily
* revert back to latest release
* remove the deleted metric
---------
Co-authored-by: Roman <zajic@zajic.net>
* Add the number of shards fix suggested to address CI issue
* Fix failed auto-shard tests
* add the auto-shard option for the failed tests
* fix the .so build issue
* remove commented line
* fix admin flags tests
* Add docker mark for docker nodes tests
* Add the ports allocation tests
* trigger CI job
* update the .so
* chore: update logos-delivery-python-bindings
* bump bindings submodule for fresh CI build
* bump bindings to pull in logos-delivery #3828
* bump bindings to latest logos-delivery master
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* retrigger CI job
* fix the number of shards issue
* Add tests for other ports
* fix the yml error
* Fix review comments
---------
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* Add docker mark for docker nodes tests
* Add the ports allocation tests
* trigger CI job
* update the .so
* chore: update logos-delivery-python-bindings
* bump bindings submodule for fresh CI build
* bump bindings to pull in logos-delivery #3828
* ci: pin nimble 0.22.3 to fix Nim checksum mismatch on liblogosdelivery build
The "Build liblogosdelivery.so" job ran a bare `nimble install -y` inside
the logos-delivery checkout, resolving the package's locked deps with
whatever nimble choosenim ships. That nimble recomputes the locked Nim
package checksum differently from the nimble that generated nimble.lock
(0.22.3), so the build aborted with:
Downloaded package checksum does not correspond to that in the lock file:
Package: nim@v.2.2.4@r.911e0dbb...
Expected checksum: 68bb85cb...
Mirror logos-delivery's own CI: pin nimble 0.22.3 after installing Nim, and
drop the redundant `nimble install -y` / no-op `make setup`. `make
liblogosdelivery` already resolves the locked deps via its build-deps
prerequisite (`nimble setup --localdeps`).
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* Bump bindings submodule to pull in logos-delivery latest master
Points vendor/logos-delivery-python-bindings at the bump-logos-delivery-master
branch (logos-delivery-python-bindings#6), which advances logos-delivery to
master 4099ff26. Merge that bindings PR before this one so the pointer lands
on bindings master.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
---------
Co-authored-by: Aya Hassan <ayahassan2877@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: AYAHASSAN287 <49167455+AYAHASSAN287@users.noreply.github.com>
* add test s17
* Add temp changes
* Add s17 positive / negative scenarios
* add S19
* Add S06 relay-only test and fix wrapper helpers (#173)
* - Add S06 relay-only test case for testing message propagation without a store.
- Update `wrapper_helpers` for clearer event type handling and type annotations (`Optional[...]` usage).
- Simplify `get_node_multiaddr` to retrieve addresses via `get_node_info_raw`.
- Refactor `wrappers_manager` to adjust bindings path to `vendor` directory and add `get_node_info_raw` method.
- Update `.gitignore` to exclude `store.sqlite3*`.
* Refactor S06 relay-only test: replace try-finally blocks with context managers for clarity and conciseness.
* Migrate S06 relay-only test to `test_send_e2e.py` and refactor with `StepsCommon` for reusability.
---------
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
* Modify S19 test
* Adding S21
* Fix review comments
* Adding S22/S23
* Adding S24
* Add S26
* Add S30
* Add S31
* Improve `wait_for_event` loop logic and add `assert_event_invariants` helper (#178)
- Refactored the `wait_for_event` function for clarity and to ensure proper deadline handling within the loop.
- Introduced `assert_event_invariants` to validate per-request event properties, enforcing invariants like correct `requestId`, no duplicate terminal events, and proper timing between `Propagated` and `Sent`.
- Added tests for `assert_event_invariants` enforcement in `S14` and `S15` lightpush scenarios.
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
* Add S07 and S10 send API tests with event invariants helper (#176)
* Add `assert_event_invariants` to enforce per-request event constraints and integrate into relevant tests
* Integrate `assert_event_invariants` into edge and store tests
* Remove redundant comments from `test_send_e2e.py`
---------
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
* Fix some tests
* Add S02/S12 send API tests and PR CI pipeline (#174)
* Add tests for auto-subscribe on first send and isolated sender with no peers
* Add PR CI workflow with tiered test strategy
- pr_tests.yml: build job with cache, wrapper-tests, smoke-tests,
and label-triggered full-suite
- test_common.yml: add deploy_allure/send_discord inputs so PR runs
skip reporting side effects
- Add docker_required marker to S19 (needs Docker, excluded from
wrapper-only CI job)
- Register docker_required marker in pytest.ini
* Document PR CI test workflows in README
* Refine PR CI test strategy:
- Exclude `docker_required` tests from smoke set in `pr_tests.yml`.
- Add `wait_for_connected` helper for connection state checks.
- Update S19 test to dynamically create and clean up the store node setup.
- General simplifications and improved test stability.
* Add `wait_for_connected` assertion to ensure sender connection state before propagation test
* Refine tests and CI workflows:
- Replace `ERROR_TIMEOUT_S` with `ERROR_AFTER_CACHE_EXPIRY_TIMEOUT_S` in `test_send_e2e.py`.
- Adjust timeout assertion for better clarity and accuracy.
- Update `pr_tests.yml` to add retries (`--reruns`) and ignore wrapper tests in smoke tests.
- Change `test_common.yml` default Discord reporting to `false`.
* Normalize `portsshift` to `portsShift` in `test_send_e2e.py` configuration definitions.
---------
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
* Add relay-to-lightpush fallback integration tests (S08/S09) (#180)
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
* Ignore S19
* fix s26
* Ignore s20 / s31 for errors
* Change image name
* fix xfail syntax error
* rename test file
* FIx flaky tests
* comment the skipped tests
* Fix review comments
* revert tag in yml in latest
* commenting lightpush
* Modify the PR
* Fix the ports conflict
* Modify S20
* fix portsshift option
* remove the /true from yml to allow errors to exist
* Modify the yml to continue on error
* First set of review comments
* adding xfail mark for failed tests
* address review comments about xfail
* cleanup unused lines
* event collector fix
* Address review comment about delay constant
* fix the timeout review comment
* Add assert_event_invariants
* enhance comment on S26 test
* mark the waku tests as docker_required
* Add S01
* add S01 second scenario
* Add S03
* Add S04
* Adding S11
* modify s11 scenario to pass
* Adding test S05
* Adding the new tests in part3 file
* Fix the yml file error
* Add the new test file to the PR job
* bump logos-delivery-python-bindings to include destroy_keep_ctx
* modify the S01 test
* mark S01 with xfail
* mark the second S01 test as xfail too
* use skip instead of xfail
* comment the skip line to try S01 again
* restore the xfail mark again
* remove the wrapped text code from test file
* Changing the test files names
* skip S01 again
* removed extra comments
* Update logos-delivery-python-bindings submodule
---------
Co-authored-by: Egor Rachkovskii <32649334+at0m1x19@users.noreply.github.com>
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
* add test s17
* Add temp changes
* Add s17 positive / negative scenarios
* add S19
* Add S06 relay-only test and fix wrapper helpers (#173)
* - Add S06 relay-only test case for testing message propagation without a store.
- Update `wrapper_helpers` for clearer event type handling and type annotations (`Optional[...]` usage).
- Simplify `get_node_multiaddr` to retrieve addresses via `get_node_info_raw`.
- Refactor `wrappers_manager` to adjust bindings path to `vendor` directory and add `get_node_info_raw` method.
- Update `.gitignore` to exclude `store.sqlite3*`.
* Refactor S06 relay-only test: replace try-finally blocks with context managers for clarity and conciseness.
* Migrate S06 relay-only test to `test_send_e2e.py` and refactor with `StepsCommon` for reusability.
---------
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
* Modify S19 test
* Adding S21
* Fix review comments
* Adding S22/S23
* Adding S24
* Add S26
* Add S30
* Add S31
* Improve `wait_for_event` loop logic and add `assert_event_invariants` helper (#178)
- Refactored the `wait_for_event` function for clarity and to ensure proper deadline handling within the loop.
- Introduced `assert_event_invariants` to validate per-request event properties, enforcing invariants like correct `requestId`, no duplicate terminal events, and proper timing between `Propagated` and `Sent`.
- Added tests for `assert_event_invariants` enforcement in `S14` and `S15` lightpush scenarios.
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
* Add S07 and S10 send API tests with event invariants helper (#176)
* Add `assert_event_invariants` to enforce per-request event constraints and integrate into relevant tests
* Integrate `assert_event_invariants` into edge and store tests
* Remove redundant comments from `test_send_e2e.py`
---------
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
* Fix some tests
* Add S02/S12 send API tests and PR CI pipeline (#174)
* Add tests for auto-subscribe on first send and isolated sender with no peers
* Add PR CI workflow with tiered test strategy
- pr_tests.yml: build job with cache, wrapper-tests, smoke-tests,
and label-triggered full-suite
- test_common.yml: add deploy_allure/send_discord inputs so PR runs
skip reporting side effects
- Add docker_required marker to S19 (needs Docker, excluded from
wrapper-only CI job)
- Register docker_required marker in pytest.ini
* Document PR CI test workflows in README
* Refine PR CI test strategy:
- Exclude `docker_required` tests from smoke set in `pr_tests.yml`.
- Add `wait_for_connected` helper for connection state checks.
- Update S19 test to dynamically create and clean up the store node setup.
- General simplifications and improved test stability.
* Add `wait_for_connected` assertion to ensure sender connection state before propagation test
* Refine tests and CI workflows:
- Replace `ERROR_TIMEOUT_S` with `ERROR_AFTER_CACHE_EXPIRY_TIMEOUT_S` in `test_send_e2e.py`.
- Adjust timeout assertion for better clarity and accuracy.
- Update `pr_tests.yml` to add retries (`--reruns`) and ignore wrapper tests in smoke tests.
- Change `test_common.yml` default Discord reporting to `false`.
* Normalize `portsshift` to `portsShift` in `test_send_e2e.py` configuration definitions.
---------
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
* Add relay-to-lightpush fallback integration tests (S08/S09) (#180)
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
* Ignore S19
* fix s26
* Ignore s20 / s31 for errors
* Change image name
* fix xfail syntax error
* rename test file
* FIx flaky tests
* comment the skipped tests
* Fix review comments
* revert tag in yml in latest
* commenting lightpush
* Modify the PR
* Fix the ports conflict
* Modify S20
* fix portsshift option
* remove the /true from yml to allow errors to exist
* Modify the yml to continue on error
* First set of review comments
* adding xfail mark for failed tests
* address review comments about xfail
* cleanup unused lines
* event collector fix
* Address review comment about delay constant
* fix the timeout review comment
* Add assert_event_invariants
* enhance comment on S26 test
* mark the waku tests as docker_required
* Mark `test_s10_edge_lightpush_propagation` as xfail due to broken lightpush peer discovery.
* Mark `test_s15_lightpush_retryable_error_then_recovery` as xfail due to broken lightpush peer discovery.
---------
Co-authored-by: Egor Rachkovskii <32649334+at0m1x19@users.noreply.github.com>
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
* Add logos-delivery-python-bindings submodule
* Adding wrapper manager modifications
* Add unit test for wrappers
* ignore third paty
* Ignore third party
* Add thin wrapper layer to be used in tests
* Add last API
* Add needed helpers
* basic tests added
* Fix minor points
* Add dependency to the requirements
* Fix the yml file
* add debug info
* Add logos-delivery submodule
* Add logos-delivery-python-bindings submodule
* Remove old logos-delivery submodule
* fix the import path issue
* add cffi
* add .so build step
* add nim
* remove nimble
* fix the nimble error
* Add rest of libraries
* Fix the nim version issue
* Add nimble install command
* Make real setup for the nimple
* change nim version
* Ignore vendor files
* fix for review points
* remove stubs file
* merge master & add comment about wrapper_manager usage
* Add REST API traffic bypass for network conditions manipulation
- Introduced methods to apply packet loss only to P2P traffic, excluding REST API traffic.
- Simplified test cases to leverage new differentiated packet loss handling.
- Removed unused and legacy metrics/tests for cleaner configuration and coverage.
* Refactor network conditions setup to streamline command execution
* Pin priomap so libp2p traffic actually hits netem
The default prio qdisc priomap routes SO_PRIORITY 6 and 7 to band 0,
which is our REST bypass class 1:1. libp2p/gossipsub packets set a high
SO_PRIORITY on their sockets, so they were silently escaping the netem
impairment via the priomap rather than through the u32 filter. The
result: test_relay_packet_loss_correlated_vs_uncorrelated became green
by accident because no loss was ever applied to relay traffic.
Forcing priomap to 1 1 1 1 ... on all 16 slots routes every SO_PRIORITY
value to band 1 (netem). The u32 filter remains the only path to 1:1,
so REST stays isolated and libp2p now takes the configured loss.
Verified in alpine netns: with SO_PRIORITY=6, 50 packets to a non-REST
port ended up in 1:1 under the old rules (0 drops); with the forced
priomap they land in 1:2 and see the expected ~50% drop rate.
* Refactor P2P traffic loss handling; isolate REST API traffic
- Added `_p2p_iface` to dynamically detect libp2p interface tied to the Waku network.
- Introduced `add_packet_loss_p2p_only` and `add_packet_loss_correlated_p2p_only` for targeted packet loss on libp2p traffic.
- Replaced REST API traffic bypass logic with simplified P2P interface-based tc rules.
- Updated tests to use `clear_p2p` for cleanup, ensuring REST traffic remains unaffected.
---------
Co-authored-by: Egor Rachkovskii <egorrachkovskii@status.im>
* Fix auto and static sharding subscribe/unsubscribe tests - use a safe un-used cluster-id ever (cluster id 2 is now defaults to logos.dev with its settings), also adapted static sharding unsubscribe to PR#3732
* Adjust cluster_id to pubsub_topics
* Fix uncertain rate limit hit of filter subscribes - this is a planned behavior of current rate limiting, as we are trying our best to serve requests within reasonanble flexibility, thus we mint new tokens over time, so it can be seen as we are able to serve more requests as configured, those are not hard limits.
* fix test_relay_2_nodes_bandwidth_low_vs_high_drain_time flaky result, eliminate jitter and localhost test optimization can appear on docker networking.
* Adding bandwidth tests
* Adding more bandwidth tests
* bandwidth &packet reorder
* Add packet loss new test
* comments enhancements
* Fix error in test
* Fix CI issue
* rename waku_px_peers_cached to waku_px_peers to match current software
* Fix CI issues
* Fix additional failing tests
* make relay = true
* Adding first test
* Adding more latency tests
* packet loss tests & fix old tests
* Adding packet loss tests
* new patch of packet loss tests
* Making PR ready for review
* remove docker.io from required packages
* work on the rest of tests
* Add debug tests
* Add rest debug levels tests
* Add rest APIs tests
* Fix non working tests
* Adding more tests
* Add final set of tests
* Add changes to enable sync
* Adding new test
* Make changes to allow store-sync to work
* Checkout the image with the bug fix
* Ad change to make test work
* Adding store-sync test scenarios
* Adding more tests
* Adding new set of tests
* Adding extensive tests
* Make PR ready for review
* revert changes
* Change number of threads for CI runners to 8
* change number of threads to 12
* Change number of threads to auto select
* change number of threads to logical instead of auto
* change number of threads to 150
* change total workers to 40
* Adding workflow_call in on section
* remove "remove_unwanted_software" from yml
* change path of requirements.txt
* modify path of .txt file again
* Change repo name
* Create docker volume
* Merge master to branch
* Revert changes done in the branch
* try the sharding option
* Add pytest-shard 0.1.2 to requirements.txt
* reduce shards to 2
* Fix max number of shards error
* Modify pytest run command
* change number of shards to =1
* increase shards to 4
* Modify pytest command
* Change shards to 4
* skip 3 tests
* skip rln tests
* skip test metric
* skip rln tests
* fix skipif mark
* Fix linters
* Fix linters 2
* run pre-commit command to fix linters
* Make each shard upload seperate report using artifacts
* Change number of shards to 5
* CHange artifacts version to 4
* increase shards to 8
* Increase shards to 11
* Make test_get_multiple_2000_store_messages run in seperate shard
* Mark test_get_multiple_2000_store_messages to run in shard 1
* using logic in yml file to run test_cursor.py in seperate file
* Fix logic to run test_cursor.py in seperate shard
* Adding path of file instead of file name in yml file
* Fix error in pytest command
* rerun test test_get_multiple_2000_store_messages
* run test_get_multiple_2000_store_messages in separate shard
* Fix error in pytest command
* Fix command again by using -k instead of test name
* Add test_rln.py again to job and increase shards to 13
* Run test_rln.py in single shard
* Fix pytest command
* Fix syntax error in pytest command
* Increase workers to 4
* Create new test file for test_get_multiple_2000_store_messages
* Collect reports into 1 report
* Modify aggregate reports
* Make changes to reports collecting
* Add more reporting ways
* Add send reports to discord again
* Fix command syntax error
* Revert changes
* Make changes to fix not executed tests issue
* remove 12 from matrix shards
* Try to fix missing test issue by adding collect-only
* Modify pytest command " remove collect only "
* Increate timeout for test test_get_multiple_2000_store_messages
* Reduce shards again to 8
* remove loadfile option
* Increase shards to 22
* increase shards to 42
* Increase shards to 49
* Increase shards to 63
* Modify test command to have 16 shards
* Change shards to 9
* Fix command of pytest
* Using ignore instead of -m
* Fix syntax error
* Modify test file path
* Increase shards to 16
* Modify test command
* fix: add multiple machines
* fix: prevent fail fast
* Remove multiple skips
* Revert changes in test_rln file
* Modify test command
fix: add multiple machines
fix: prevent fail fast
checkout on smoke_tests tag (#96)
* checkout on smoke_tests tag
* MOdify pytest command
* Update README.md
Add steps on how to use new tag for PR tests in readme file
Remove multiple skips
Revert changes in test_rln file
* Adding timeout to test test_on_empty_postgress_db
* Add comments in workflow for shards
---------
Co-authored-by: fbarbu15 <florin@status.im>
Co-authored-by: Florin Barbu <barbu_florin_adrian@yahoo.com>
AYAHASSAN287