Commit Graph

278 Commits

Author SHA1 Message Date
Anastasiya Semenkevich b791930546 chore: fix syncing test and move it to critical suite 2023-12-22 19:13:41 +03:00
Anastasiya Semenkevich 1cc8807174 chore: replace waitFor with waitForObjectExists
There is a problem with is_visible method now, it is not raising any assertions in case it did not find any object, therefore i suspect it as a potential endless loop (always returns True it seems). I will try to fix that, however it is being used across all the framework so it takes time.

The main idea here is to get rid of endless loop and 15 minutes if waiting for nothing in this certain test
2023-12-22 16:52:55 +03:00
Anastasiya Semenkevich 0e96fd0e57 chore: add validation for emoji hash across screens 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich b59590aa1f chore: better init for online identifier 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich 3deeeda620 chore: add verification for identicon ring on the profile screen 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich 838c916fc2 chore: added random selection of pictures (diff types) 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich f31ffc21f5 chore: add randomisation for password 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich 875e8869b5 chore: add randomisation for display name generation 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich 1d3994f720 chore: add smaller steps and asserts, rename method 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich ba3626e017 chore: update marks and readMe file
Fixes https://github.com/status-im/desktop-qa-automation/issues/391

1. replaced all the skip marks for tests that are linked to status-desktop tickets to xfail
2. updated readme to explain marks
2023-12-20 17:38:27 +03:00
Anastasiya Semenkevich 767f388b57 chore: raise exceptions when needed 2023-12-20 15:46:15 +03:00
Anastasiya Semenkevich a75d09fc5d chore: disable join community test until it is fixed 2023-12-19 14:24:50 +03:00
Anastasiya Semenkevich 099a199e1f ci: run critical tests by default 2023-12-18 16:22:27 +03:00
Anastasiya Semenkevich 8b65d1ca43 chore: mark password change test as flaky
Reason: https://github.com/status-im/status-desktop/issues/13013
2023-12-18 11:52:57 +03:00
Anastasiya Semenkevich 0edf28f14d chore: add asserts for change password test 2023-12-18 11:52:57 +03:00
Anastasiya Semenkevich caef79d2ee chore: select tests to run against PRs
Selected a few to run by critical mark in PRs
2023-12-18 11:52:57 +03:00
Anastasiya Semenkevich 467f65ac1a chore: introduce flaky mark
A “flaky” test is a test that usually pass but sometimes it fails.
If a flaky test pass it will be reported normally as test succeed. If the test fails, instead of being reported as failure it will be reported as a xfail.
2023-12-15 16:07:13 +03:00
Anastasiya Semenkevich f5f7734769 chore: update readme 2023-12-14 10:45:45 +03:00
Magnus 706e60ca0c Add priority pytest marks 2023-12-13 17:53:24 +03:00
Magnus e982cfe389 Introduce priority pytest marks 2023-12-13 17:53:24 +03:00
Magnus b900ee72d6 set up pytest marks for different sections of the app 2023-12-13 17:53:24 +03:00
Anastasiya Semiankevich 8fe9b4731c chore: move the TEST MODE back off for now and add some more fixes 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich 0573a1ea29 chore: fix delete account test according new designs 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich 4f73e0eb52 chore: refactor edit account test a bit 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich a45de2c28e chore: add attempts to click Delete button and removed awaiting 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich 87bcc83717 chore: skip Send test (https://github.com/status-im/status-desktop/issues/12987) 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich 01382bd16e chore: fix community channel tests in test mode 2023-12-13 17:20:30 +03:00
Anastasiya Semenkevich bce460abf8 chore: test test mode 2023-12-13 17:20:30 +03:00
Anastasiya Semenkevich 427682f143 chore: skip ENS name test because of bug
https://github.com/status-im/status-desktop/issues/12988
2023-12-12 14:29:41 +03:00
Anastasiya Semenkevich d91eae246e chore: skip balance test because of cryptocompare API limit
I logged https://github.com/status-im/status-desktop/issues/12987 which has some details
2023-12-12 14:29:41 +03:00
Valentina Novgorodtceva 4f69111778 test: test_ens_name_purchase added 2023-12-12 10:43:20 +07:00
Valentina Novgorodtceva eeaba5822d chore: test_join_community was separated from others 2023-12-12 10:40:39 +07:00
Valentina Novgorodtceva 53717439f7 chore: communities tests enabled and fixed, replaced image comparison 2023-12-12 10:40:39 +07:00
Anastasiya Semenkevich 6614475ddc chore: wait until appears removed 2023-12-11 18:31:08 +03:00
Magnus dd60992b22 speed up password strength indicator tests 2023-12-11 12:20:36 +03:00
Anastasiya Semenkevich 49ccfc5b8f chore: remove restart from import seed phrase
perhaps it was put there by mistake. we dont need the app restart in this test
2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich b8202244b3 chore: extend the limit for balance to appear up to 10 seconds 2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich 0ce2a1abb3 chore: skip add account and restart test because of bug
https://github.com/status-im/status-desktop/issues/12973
2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich 92bb9d1bcc chore: skip sync test because of bug
https://github.com/status-im/status-desktop/issues/12972
2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich d953db7a31 chore: add attempts for clicking sign out button 2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich 5a6d35fde2 chore: add attempts to click the cross button
1. test_toggle_testnet_toggle_on_and_close_the_confirmation fails now in nightly. I added attempts to click the cross button and removed wait_untll_appears (and related assert)
2023-12-08 19:50:19 +03:00
Valentina Novgorodtceva 5afb3b6811 test: tests create and remove community category added 2023-12-08 14:46:20 +07:00
Jakub Sokołowski 124f482d31 feat(aut): wait for AUT comms port to become available
This avoids issues on slower systems where `startaut` does not have the
port ready when the `squishserver` tries to connect to it, resulting in:
```
Warning: Could not connect to attachable AUT at localhost:61500: Connection refused
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-07 10:28:57 +01:00
Valentina Novgorodtceva ea7089dedc chore: container for search text edit field changed 2023-12-07 16:24:38 +07:00
Valentina Novgorodtceva 7e967e286c test: test_wallet_send_0_eth added 2023-12-07 16:24:38 +07:00
Valentina Novgorodtceva fa48dad825 test: test_wallet_send_0_eth added 2023-12-07 16:24:38 +07:00
Anastasiya Semenkevich 2ad53d7599 chore: increase timeout for logout up to 10 seconds 2023-12-07 09:38:47 +03:00
Anastasiya Semenkevich 4214103a6a chore: enable back balance test 2023-12-07 09:38:47 +03:00
Jakub Sokołowski 2fab5ca720 chore(ci): remove obsolete desktop-e2e-old CI label
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-06 15:03:15 +01:00
Jakub Sokołowski 6418fcd6c6 feat(conftest): set log level using LOG_LEVEL env var
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-05 23:31:44 +01:00
Jakub Sokołowski 920b54e94c chore(all) rename _logger to LOG to match refactor
Related to:
https://github.com/status-im/desktop-qa-automation/pull/352

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-05 22:56:49 +01:00
Jakub Sokołowski c00707cdd8 chore(conftest): improve log format for pytest.log
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-05 22:56:48 +01:00
Anastasiya Semenkevich ae0b9d4d55 chore: remove unnecessary assert, timeout should do its job 2023-12-05 16:54:29 +03:00
Anastasiya c2ac1db048 chore: add timeout and assert for the sign out test (#361) 2023-12-04 18:23:49 +03:00
Valentina1133 4500d0fb1d chore: removed skip mark from syncing and messaging tests, these tests are passing now (#360) 2023-12-04 14:18:06 +03:00
Anastasiya eb45281f2d chore: change Squish version and disable flaky tests (#359)
* chore: use newer squish

* chore: test tests with squish 7.2.1
2023-12-01 22:04:11 +03:00
Jakub Sokołowski 255f88fbb0 chore(all): rename _logger to LOG to match changes
Some of them were renamed in:
https://github.com/status-im/desktop-qa-automation/pull/352

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:58:22 +01:00
Jakub Sokołowski 76c04968fe feat(ci): add LOG_LEVEL parameter for Jenkins jobs
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:57:36 +01:00
Jakub Sokołowski 8351ae80ca fix(logs): send logs to a single file
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:54 +01:00
Jakub Sokołowski 7eab188b32 feat(all): logging to files for drivers and fixtures
Otherwise it's very hard to debug anything at all.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:53 +01:00
Jakub Sokołowski ca984fa7a0 chore(testrail): refactor init_testrail_api
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:52 +01:00
Jakub Sokołowski 1d1a0b7d44 feat(configs): add assert for SQUISH_DIR env var
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:52 +01:00
Jakub Sokołowski 128ae59d72 choer(driver): consistent formatting of server flags
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:51 +01:00
Jakub Sokołowski 9ae8173a0b fix(driver): drop retries from AUT launch method
The retries are just adding complexity and not helping.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:50 +01:00
Jakub Sokołowski 861af374cd feat(ci): archive AUT logs generated by tests
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:49 +01:00
Jakub Sokołowski 47f7a092b0 feat(driver): redirect AUT logs to files
Send application logs to `aut_stdout.log` and `aut_stderr.log` files.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:48 +01:00
Jakub Sokołowski 5d8d7aaa39 fix(all): rename APP_DIR to AUT_PATH to reflect purpose
The name APP_DIR suggests the path is a directory, but it's not.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:47 +01:00
Jakub Sokołowski bbc81717ce fix(all): refactor killing processes and waiting
* Use `psutils.pid_exists()` instead of iterating processes for no reason.
* Drop use of recursion which is completely unnecessarily complex. Use loop.
* Remove checking of `returncode` right away after process starts, it's too soon.
* Lower `PROCESS_TIMEOUT_SEC` to 5 seconds to avoid needless delays.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:46 +01:00
Jakub Sokołowski 6c91ebef11 feat(driver): add squish.ini config file to repo
Creating it by calling `squishserver` is a waste of time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:45 +01:00
Jakub Sokołowski eec2e382d8 feat(driver): wait for Squish server port to listen
Doing silly retries is just not reliable, this is.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:44 +01:00
Jakub Sokołowski fc665cf5ec fix(driver): killing process using pid not port number
* Drop unnecessary killing of processes by port, we have the PID.
* Split `stop()` method into `_detach_context()` and `_kill_process()`.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:43 +01:00
Jakub Sokołowski 917a4bfde1 fix(driver): remove pointless ATTACH_MODE config value
Removing `ATTACH_MODE` since as far as I can tell it's always `true`.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:42 +01:00
Jakub Sokołowski 81fe247d5a feat(gitignore): add .venv folder to .gitignore
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:41 +01:00
Anastasiya c112b0492b chore: reorganise wallet tests (#355)
* chore: reorganise wallet tests

* chore: enable wallet tests that have parametrization
2023-12-01 15:56:57 +03:00
Jakub Sokołowski 05ad2ebadb fix: remove windows carrige returns from files
Drives me crazy.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 10:00:56 +03:00
Anastasiya 2a9d8a4c29 chore: fix sign out test (#353) 2023-12-01 07:32:44 +03:00
Anastasiya 1232ff5ba8 Disable wallet tests and syncing test (#351)
* chore: skip wallets tests temp

Possible reason: https://github.com/status-im/status-desktop/issues/12914 is causing crashes, which we don't yet identify as crashes

* chore: skip syncing test temp

https://github.com/status-im/desktop-qa-automation/issues/350
2023-11-30 14:27:35 +03:00
Anastasiya Semenkevich 0d85a8e1de chore: comment out messaging tests because of bug 2023-11-28 17:10:38 +03:00
Valentina1133 44c3af82e5 Test/test settings messaging identity verification (#341)
* test: test_messaging_settings_identity_verification added

* chore: skipped test_settings_include_in_total_balance
2023-11-28 15:26:05 +03:00
Valentina1133 848fca521d chore: commented steps for toast message verification in accept request test (#345) 2023-11-28 15:22:49 +03:00
Valentina1133 f94f176bd3 test: test_messaging_settings accepting and rejecting request added (#336) 2023-11-27 14:44:42 +04:00
Valentina1133 7db3e94a96 test: test_cancel_setup_syncing added (#334) 2023-11-27 14:44:30 +04:00
Valentina1133 50ada60385 Chore/onboarding tests (#331)
* chore: added clicking on back button and checking correct views appear during onboarding

* chore: click clear button on profile view and checking field is empty added

* chore: show and hide password verifications added to test_check_password_strength_and_login
2023-11-27 14:44:08 +04:00
Anastasiya b74ba4f7eb chore: stabilise test (#333)
* chore: fix testnet toggle test and total balace wallet test

* chore: increase timeout for syncing test

* chore: disable test mode and remove keycard hide steps
2023-11-22 13:42:26 +03:00
Anastasiya 85b0aa1509 chore: update jenkins config (#326) 2023-11-20 23:43:09 +03:00
Anastasiya bfa8000591 chore: make the verification of banner conditional in back up seed phrase test (#321)
We don't have banners when running the app in test mode. I added condition to check the test mode and verify banner when not in test mode, otherwise skip
2023-11-20 16:06:02 +03:00
Valentina1133 8c933e75bd test: test_unlock_keycard with correct and incorrect PUK added (#312) 2023-11-17 17:54:57 +03:00
Valentina1133 fc2e6c3287 chore: keycard_tests fixes (#318) 2023-11-17 17:54:44 +03:00
Anastasiya d7908775f0 chore: several changes for wallet settings tests (#317)
* chore: fix several wallet tests

* disable account ordering because of bug

* remove test self as not needed anymore

* add log level

* click the revert button 2 times
2023-11-17 17:27:51 +03:00
Vladimir Druzhinin 5eeac9226a chore: Fix create community test (#315) 2023-11-17 12:36:59 +03:00
Vladimir Druzhinin 62bf869602 Chore/key card handler (#314)
* chore: fix seed phrase test and edit status account test

* chore: change the locator for profile layout

* chore: close Keycard Controller

---------

Co-authored-by: Anastasiya Semenkevich <anastasija.ig@gmail.com>
2023-11-17 08:53:17 +03:00
Anastasiya 41d431c136 chore: add object names to beta consent popup and test mode env variable condition (#308)
* chore: add object names to beta popup

* chore: add check for env variable
2023-11-16 13:48:17 +03:00
Valentina1133 5be0364ec4 chore: test_create_keycard_account_with_new_seed_phrase improved (#307) 2023-11-16 13:48:04 +03:00
Anastasiya a8d6cd6382 chore: add env variable (#310) 2023-11-16 12:05:39 +03:00
Valentina1133 f0dd365dcc test: test_factory_reset_keycard and test_factory_reset_keycard_incorrect_pin added (#303) 2023-11-15 19:28:11 +03:00
Vladimir Druzhinin 78733d8d9d chore: Revert getattr (#304)
Co-authored-by: vlado@status.im <Vladimir Druzhinin>
2023-11-15 11:42:17 +03:00
Vladimir Druzhinin ecd9067551 chore: Dependence on Jenkins Job name removed in TestRail configs (#287)
#276

Co-authored-by: vlado@status.im <Vladimir Druzhinin>
2023-11-15 11:42:02 +03:00
Anastasiya 34add5b08e chore: add waiting condition for total balance test so it is not failing on CI (#299) 2023-11-13 16:42:55 +03:00
Valentina1133 7d4356b5c5 chore: image verifications added to keycard tests (#297) 2023-11-13 13:46:48 +03:00
Jakub Sokołowski d44a4b9968 ci: don't run on agents with desktop-e2e-old label (#298)
A temporary attempt to debug apparent delays possibly caused by running
both old and new e2e tests on the same host.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-11-13 12:29:47 +03:00