Commit Graph

305 Commits

Author SHA1 Message Date
Anastasiya Semenkevich 2a5684a2f7 chore: fix references for test cases in test rail (remove experimental stuff) 2024-01-17 13:22:30 +03:00
Valentina Novgorodtceva a467cbf9f9 chore: test edit network fixed 2024-01-16 15:26:18 +07:00
Valentina Novgorodtceva f2721bc0b1 chore: fixes for saved addresses tests, edit network tests disabled for now 2024-01-16 14:42:27 +07:00
Valentina Novgorodtceva a529dd04b7 test: test clicking category added 2024-01-15 16:07:59 +07:00
Valentina Novgorodtceva 1d09ffba48 chore: reporting test to 2 different test cases in Testrail 2024-01-15 16:07:26 +07:00
Anastasiya Semenkevich 6f9b8e5313 chore: replace methods of waiting views with methods of checking elements on these views
- added verify_account_popup_present() function
- added verify_profile_view_present() function
- added verify_emojihash_view_present()

Mostly done as an attempt to fix flaky navigation in new keys test. (see https://ci.status.im/job/status-desktop/job/e2e/job/prs/1136/allure/#suites/c48b221cdcfecf89e1eb75d0b8e79672/f41783642f763391/)

So the test clicks Next button twice and then thinks he is already on next screen when it is not. So i added a verification for Profile and Emoji screens that when we returning these views, we first check screen titles and if they are correct - then proceed further

Same function is added for Add Account popup earlier, i forgot to add a call for it

Uncomment the test of adding watch only address, related issue seems to be fixed
2024-01-12 15:54:26 +03:00
Valentina Novgorodtceva c7757a4bee chore: marked several tests with xfail mark because of bug with contact requests 2024-01-12 15:17:57 +03:00
Valentina Novgorodtceva 72a8d9e396 chore: test_edit_community_channel fix 2024-01-12 15:17:57 +03:00
Valentina Novgorodtceva f8ee8f08bc chore: fixes for wallet tests 2024-01-12 15:17:57 +03:00
Anastasiya Semenkevich e45da2c9b6 test: adding test for ability to add saved address from wallet settings 2024-01-11 17:49:36 +03:00
Anastasiya Semenkevich 7b1e303156 chore: add multiple references for tests 2024-01-10 18:17:38 +03:00
Anastasiya Semenkevich 0cdadf063e chore: remove change password test from critical suite
Remove `@pytest.critical` mark from `test_settings_profile_change_password.py`. The test is timing out very often now (addressed in https://github.com/status-im/status-desktop/issues/13013)

This test will be still executed in nightly runs
2024-01-10 11:56:50 +03:00
Anastasiya Semenkevich 4db703f2b3 chore: fix saved addresses test according to new designs 2024-01-10 10:39:54 +03:00
Anastasiya Semenkevich 234974ac44 chore: toast messages verifications 2024-01-10 10:39:54 +03:00
Anastasiya Semenkevich 8c38cb1616 chore: update error message
Error message has been changed in ff9062a1b0 (diff-4ac30c280b7ceca7b505ab0551b9e009295aae3147253c43ae8821e9d6c0ed69R682)
2024-01-09 16:03:31 +03:00
Anastasiya Semenkevich 8321066a63 chore: combine tests for community screens to reduce total run time 2023-12-29 17:48:03 +03:00
Anastasiya Semenkevich 9ea888891c chore: add another verification which will take a bit of time so the UI wont be frozen 2023-12-29 16:42:34 +03:00
Anastasiya Semenkevich be835506fb chore: fix test for creating permissions 2023-12-29 11:47:48 +03:00
Valentina Novgorodtceva acdbdbe7f1 test: member role tests added 2023-12-28 15:37:02 +03:00
Valentina Novgorodtceva d941bc031a test: edit_community_category 2023-12-28 13:58:52 +03:00
Valentina Novgorodtceva e6d752ba4c chore: fix join community test according changes in UI 2023-12-28 13:58:22 +03:00
Anastasiya Semenkevich 55ebd85637 chore: change locator for InsertDetailsView 2023-12-27 17:42:34 +03:00
Anastasiya Semiankevich 1356df4838 chore: add timeout for group chat 2023-12-27 11:44:01 +03:00
Anastasiya Semenkevich fe4325b5e1 chore: introduce timeout mark and update requirements 2023-12-26 19:14:36 +03:00
Anton Iakimov fa5a0cbfb2 ci: remove debug 2023-12-25 13:07:09 +01:00
Anastasiya Semenkevich 81a7727f09 chore: replace is_visible 2023-12-23 11:02:58 +03:00
Anton Iakimov 4e13916d89 ci: set TEST_SCOPE_FLAG conditionally on JOB_NAME 2023-12-22 20:39:02 +03:00
Anastasiya Semenkevich b791930546 chore: fix syncing test and move it to critical suite 2023-12-22 19:13:41 +03:00
Anastasiya Semenkevich 1cc8807174 chore: replace waitFor with waitForObjectExists
There is a problem with is_visible method now, it is not raising any assertions in case it did not find any object, therefore i suspect it as a potential endless loop (always returns True it seems). I will try to fix that, however it is being used across all the framework so it takes time.

The main idea here is to get rid of endless loop and 15 minutes if waiting for nothing in this certain test
2023-12-22 16:52:55 +03:00
Anastasiya Semenkevich 0e96fd0e57 chore: add validation for emoji hash across screens 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich b59590aa1f chore: better init for online identifier 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich 3deeeda620 chore: add verification for identicon ring on the profile screen 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich 838c916fc2 chore: added random selection of pictures (diff types) 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich f31ffc21f5 chore: add randomisation for password 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich 875e8869b5 chore: add randomisation for display name generation 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich 1d3994f720 chore: add smaller steps and asserts, rename method 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich ba3626e017 chore: update marks and readMe file
Fixes https://github.com/status-im/desktop-qa-automation/issues/391

1. replaced all the skip marks for tests that are linked to status-desktop tickets to xfail
2. updated readme to explain marks
2023-12-20 17:38:27 +03:00
Anastasiya Semenkevich 767f388b57 chore: raise exceptions when needed 2023-12-20 15:46:15 +03:00
Anastasiya Semenkevich a75d09fc5d chore: disable join community test until it is fixed 2023-12-19 14:24:50 +03:00
Anastasiya Semenkevich 099a199e1f ci: run critical tests by default 2023-12-18 16:22:27 +03:00
Anastasiya Semenkevich 8b65d1ca43 chore: mark password change test as flaky
Reason: https://github.com/status-im/status-desktop/issues/13013
2023-12-18 11:52:57 +03:00
Anastasiya Semenkevich 0edf28f14d chore: add asserts for change password test 2023-12-18 11:52:57 +03:00
Anastasiya Semenkevich caef79d2ee chore: select tests to run against PRs
Selected a few to run by critical mark in PRs
2023-12-18 11:52:57 +03:00
Anastasiya Semenkevich 467f65ac1a chore: introduce flaky mark
A “flaky” test is a test that usually pass but sometimes it fails.
If a flaky test pass it will be reported normally as test succeed. If the test fails, instead of being reported as failure it will be reported as a xfail.
2023-12-15 16:07:13 +03:00
Anastasiya Semenkevich f5f7734769 chore: update readme 2023-12-14 10:45:45 +03:00
Magnus 706e60ca0c Add priority pytest marks 2023-12-13 17:53:24 +03:00
Magnus e982cfe389 Introduce priority pytest marks 2023-12-13 17:53:24 +03:00
Magnus b900ee72d6 set up pytest marks for different sections of the app 2023-12-13 17:53:24 +03:00
Anastasiya Semiankevich 8fe9b4731c chore: move the TEST MODE back off for now and add some more fixes 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich 0573a1ea29 chore: fix delete account test according new designs 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich 4f73e0eb52 chore: refactor edit account test a bit 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich a45de2c28e chore: add attempts to click Delete button and removed awaiting 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich 87bcc83717 chore: skip Send test (https://github.com/status-im/status-desktop/issues/12987) 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich 01382bd16e chore: fix community channel tests in test mode 2023-12-13 17:20:30 +03:00
Anastasiya Semenkevich bce460abf8 chore: test test mode 2023-12-13 17:20:30 +03:00
Anastasiya Semenkevich 427682f143 chore: skip ENS name test because of bug
https://github.com/status-im/status-desktop/issues/12988
2023-12-12 14:29:41 +03:00
Anastasiya Semenkevich d91eae246e chore: skip balance test because of cryptocompare API limit
I logged https://github.com/status-im/status-desktop/issues/12987 which has some details
2023-12-12 14:29:41 +03:00
Valentina Novgorodtceva 4f69111778 test: test_ens_name_purchase added 2023-12-12 10:43:20 +07:00
Valentina Novgorodtceva eeaba5822d chore: test_join_community was separated from others 2023-12-12 10:40:39 +07:00
Valentina Novgorodtceva 53717439f7 chore: communities tests enabled and fixed, replaced image comparison 2023-12-12 10:40:39 +07:00
Anastasiya Semenkevich 6614475ddc chore: wait until appears removed 2023-12-11 18:31:08 +03:00
Magnus dd60992b22 speed up password strength indicator tests 2023-12-11 12:20:36 +03:00
Anastasiya Semenkevich 49ccfc5b8f chore: remove restart from import seed phrase
perhaps it was put there by mistake. we dont need the app restart in this test
2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich b8202244b3 chore: extend the limit for balance to appear up to 10 seconds 2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich 0ce2a1abb3 chore: skip add account and restart test because of bug
https://github.com/status-im/status-desktop/issues/12973
2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich 92bb9d1bcc chore: skip sync test because of bug
https://github.com/status-im/status-desktop/issues/12972
2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich d953db7a31 chore: add attempts for clicking sign out button 2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich 5a6d35fde2 chore: add attempts to click the cross button
1. test_toggle_testnet_toggle_on_and_close_the_confirmation fails now in nightly. I added attempts to click the cross button and removed wait_untll_appears (and related assert)
2023-12-08 19:50:19 +03:00
Valentina Novgorodtceva 5afb3b6811 test: tests create and remove community category added 2023-12-08 14:46:20 +07:00
Jakub Sokołowski 124f482d31 feat(aut): wait for AUT comms port to become available
This avoids issues on slower systems where `startaut` does not have the
port ready when the `squishserver` tries to connect to it, resulting in:
```
Warning: Could not connect to attachable AUT at localhost:61500: Connection refused
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-07 10:28:57 +01:00
Valentina Novgorodtceva ea7089dedc chore: container for search text edit field changed 2023-12-07 16:24:38 +07:00
Valentina Novgorodtceva 7e967e286c test: test_wallet_send_0_eth added 2023-12-07 16:24:38 +07:00
Valentina Novgorodtceva fa48dad825 test: test_wallet_send_0_eth added 2023-12-07 16:24:38 +07:00
Anastasiya Semenkevich 2ad53d7599 chore: increase timeout for logout up to 10 seconds 2023-12-07 09:38:47 +03:00
Anastasiya Semenkevich 4214103a6a chore: enable back balance test 2023-12-07 09:38:47 +03:00
Jakub Sokołowski 2fab5ca720 chore(ci): remove obsolete desktop-e2e-old CI label
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-06 15:03:15 +01:00
Jakub Sokołowski 6418fcd6c6 feat(conftest): set log level using LOG_LEVEL env var
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-05 23:31:44 +01:00
Jakub Sokołowski 920b54e94c chore(all) rename _logger to LOG to match refactor
Related to:
https://github.com/status-im/desktop-qa-automation/pull/352

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-05 22:56:49 +01:00
Jakub Sokołowski c00707cdd8 chore(conftest): improve log format for pytest.log
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-05 22:56:48 +01:00
Anastasiya Semenkevich ae0b9d4d55 chore: remove unnecessary assert, timeout should do its job 2023-12-05 16:54:29 +03:00
Anastasiya c2ac1db048 chore: add timeout and assert for the sign out test (#361) 2023-12-04 18:23:49 +03:00
Valentina1133 4500d0fb1d chore: removed skip mark from syncing and messaging tests, these tests are passing now (#360) 2023-12-04 14:18:06 +03:00
Anastasiya eb45281f2d chore: change Squish version and disable flaky tests (#359)
* chore: use newer squish

* chore: test tests with squish 7.2.1
2023-12-01 22:04:11 +03:00
Jakub Sokołowski 255f88fbb0 chore(all): rename _logger to LOG to match changes
Some of them were renamed in:
https://github.com/status-im/desktop-qa-automation/pull/352

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:58:22 +01:00
Jakub Sokołowski 76c04968fe feat(ci): add LOG_LEVEL parameter for Jenkins jobs
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:57:36 +01:00
Jakub Sokołowski 8351ae80ca fix(logs): send logs to a single file
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:54 +01:00
Jakub Sokołowski 7eab188b32 feat(all): logging to files for drivers and fixtures
Otherwise it's very hard to debug anything at all.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:53 +01:00
Jakub Sokołowski ca984fa7a0 chore(testrail): refactor init_testrail_api
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:52 +01:00
Jakub Sokołowski 1d1a0b7d44 feat(configs): add assert for SQUISH_DIR env var
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:52 +01:00
Jakub Sokołowski 128ae59d72 choer(driver): consistent formatting of server flags
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:51 +01:00
Jakub Sokołowski 9ae8173a0b fix(driver): drop retries from AUT launch method
The retries are just adding complexity and not helping.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:50 +01:00
Jakub Sokołowski 861af374cd feat(ci): archive AUT logs generated by tests
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:49 +01:00
Jakub Sokołowski 47f7a092b0 feat(driver): redirect AUT logs to files
Send application logs to `aut_stdout.log` and `aut_stderr.log` files.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:48 +01:00
Jakub Sokołowski 5d8d7aaa39 fix(all): rename APP_DIR to AUT_PATH to reflect purpose
The name APP_DIR suggests the path is a directory, but it's not.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:47 +01:00
Jakub Sokołowski bbc81717ce fix(all): refactor killing processes and waiting
* Use `psutils.pid_exists()` instead of iterating processes for no reason.
* Drop use of recursion which is completely unnecessarily complex. Use loop.
* Remove checking of `returncode` right away after process starts, it's too soon.
* Lower `PROCESS_TIMEOUT_SEC` to 5 seconds to avoid needless delays.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:46 +01:00
Jakub Sokołowski 6c91ebef11 feat(driver): add squish.ini config file to repo
Creating it by calling `squishserver` is a waste of time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:45 +01:00
Jakub Sokołowski eec2e382d8 feat(driver): wait for Squish server port to listen
Doing silly retries is just not reliable, this is.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:44 +01:00
Jakub Sokołowski fc665cf5ec fix(driver): killing process using pid not port number
* Drop unnecessary killing of processes by port, we have the PID.
* Split `stop()` method into `_detach_context()` and `_kill_process()`.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:43 +01:00
Jakub Sokołowski 917a4bfde1 fix(driver): remove pointless ATTACH_MODE config value
Removing `ATTACH_MODE` since as far as I can tell it's always `true`.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:42 +01:00
Jakub Sokołowski 81fe247d5a feat(gitignore): add .venv folder to .gitignore
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:41 +01:00