Commit Graph

271 Commits

Author SHA1 Message Date
Anastasiya Semenkevich 875e8869b5 chore: add randomisation for display name generation 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich 1d3994f720 chore: add smaller steps and asserts, rename method 2023-12-21 23:10:47 +03:00
Anastasiya Semenkevich ba3626e017 chore: update marks and readMe file
Fixes https://github.com/status-im/desktop-qa-automation/issues/391

1. replaced all the skip marks for tests that are linked to status-desktop tickets to xfail
2. updated readme to explain marks
2023-12-20 17:38:27 +03:00
Anastasiya Semenkevich 767f388b57 chore: raise exceptions when needed 2023-12-20 15:46:15 +03:00
Anastasiya Semenkevich a75d09fc5d chore: disable join community test until it is fixed 2023-12-19 14:24:50 +03:00
Anastasiya Semenkevich 099a199e1f ci: run critical tests by default 2023-12-18 16:22:27 +03:00
Anastasiya Semenkevich 8b65d1ca43 chore: mark password change test as flaky
Reason: https://github.com/status-im/status-desktop/issues/13013
2023-12-18 11:52:57 +03:00
Anastasiya Semenkevich 0edf28f14d chore: add asserts for change password test 2023-12-18 11:52:57 +03:00
Anastasiya Semenkevich caef79d2ee chore: select tests to run against PRs
Selected a few to run by critical mark in PRs
2023-12-18 11:52:57 +03:00
Anastasiya Semenkevich 467f65ac1a chore: introduce flaky mark
A “flaky” test is a test that usually pass but sometimes it fails.
If a flaky test pass it will be reported normally as test succeed. If the test fails, instead of being reported as failure it will be reported as a xfail.
2023-12-15 16:07:13 +03:00
Anastasiya Semenkevich f5f7734769 chore: update readme 2023-12-14 10:45:45 +03:00
Magnus 706e60ca0c Add priority pytest marks 2023-12-13 17:53:24 +03:00
Magnus e982cfe389 Introduce priority pytest marks 2023-12-13 17:53:24 +03:00
Magnus b900ee72d6 set up pytest marks for different sections of the app 2023-12-13 17:53:24 +03:00
Anastasiya Semiankevich 8fe9b4731c chore: move the TEST MODE back off for now and add some more fixes 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich 0573a1ea29 chore: fix delete account test according new designs 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich 4f73e0eb52 chore: refactor edit account test a bit 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich a45de2c28e chore: add attempts to click Delete button and removed awaiting 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich 87bcc83717 chore: skip Send test (https://github.com/status-im/status-desktop/issues/12987) 2023-12-13 17:20:30 +03:00
Anastasiya Semiankevich 01382bd16e chore: fix community channel tests in test mode 2023-12-13 17:20:30 +03:00
Anastasiya Semenkevich bce460abf8 chore: test test mode 2023-12-13 17:20:30 +03:00
Anastasiya Semenkevich 427682f143 chore: skip ENS name test because of bug
https://github.com/status-im/status-desktop/issues/12988
2023-12-12 14:29:41 +03:00
Anastasiya Semenkevich d91eae246e chore: skip balance test because of cryptocompare API limit
I logged https://github.com/status-im/status-desktop/issues/12987 which has some details
2023-12-12 14:29:41 +03:00
Valentina Novgorodtceva 4f69111778 test: test_ens_name_purchase added 2023-12-12 10:43:20 +07:00
Valentina Novgorodtceva eeaba5822d chore: test_join_community was separated from others 2023-12-12 10:40:39 +07:00
Valentina Novgorodtceva 53717439f7 chore: communities tests enabled and fixed, replaced image comparison 2023-12-12 10:40:39 +07:00
Anastasiya Semenkevich 6614475ddc chore: wait until appears removed 2023-12-11 18:31:08 +03:00
Magnus dd60992b22 speed up password strength indicator tests 2023-12-11 12:20:36 +03:00
Anastasiya Semenkevich 49ccfc5b8f chore: remove restart from import seed phrase
perhaps it was put there by mistake. we dont need the app restart in this test
2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich b8202244b3 chore: extend the limit for balance to appear up to 10 seconds 2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich 0ce2a1abb3 chore: skip add account and restart test because of bug
https://github.com/status-im/status-desktop/issues/12973
2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich 92bb9d1bcc chore: skip sync test because of bug
https://github.com/status-im/status-desktop/issues/12972
2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich d953db7a31 chore: add attempts for clicking sign out button 2023-12-08 19:50:19 +03:00
Anastasiya Semenkevich 5a6d35fde2 chore: add attempts to click the cross button
1. test_toggle_testnet_toggle_on_and_close_the_confirmation fails now in nightly. I added attempts to click the cross button and removed wait_untll_appears (and related assert)
2023-12-08 19:50:19 +03:00
Valentina Novgorodtceva 5afb3b6811 test: tests create and remove community category added 2023-12-08 14:46:20 +07:00
Jakub Sokołowski 124f482d31 feat(aut): wait for AUT comms port to become available
This avoids issues on slower systems where `startaut` does not have the
port ready when the `squishserver` tries to connect to it, resulting in:
```
Warning: Could not connect to attachable AUT at localhost:61500: Connection refused
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-07 10:28:57 +01:00
Valentina Novgorodtceva ea7089dedc chore: container for search text edit field changed 2023-12-07 16:24:38 +07:00
Valentina Novgorodtceva 7e967e286c test: test_wallet_send_0_eth added 2023-12-07 16:24:38 +07:00
Valentina Novgorodtceva fa48dad825 test: test_wallet_send_0_eth added 2023-12-07 16:24:38 +07:00
Anastasiya Semenkevich 2ad53d7599 chore: increase timeout for logout up to 10 seconds 2023-12-07 09:38:47 +03:00
Anastasiya Semenkevich 4214103a6a chore: enable back balance test 2023-12-07 09:38:47 +03:00
Jakub Sokołowski 2fab5ca720 chore(ci): remove obsolete desktop-e2e-old CI label
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-06 15:03:15 +01:00
Jakub Sokołowski 6418fcd6c6 feat(conftest): set log level using LOG_LEVEL env var
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-05 23:31:44 +01:00
Jakub Sokołowski 920b54e94c chore(all) rename _logger to LOG to match refactor
Related to:
https://github.com/status-im/desktop-qa-automation/pull/352

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-05 22:56:49 +01:00
Jakub Sokołowski c00707cdd8 chore(conftest): improve log format for pytest.log
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-05 22:56:48 +01:00
Anastasiya Semenkevich ae0b9d4d55 chore: remove unnecessary assert, timeout should do its job 2023-12-05 16:54:29 +03:00
Anastasiya c2ac1db048 chore: add timeout and assert for the sign out test (#361) 2023-12-04 18:23:49 +03:00
Valentina1133 4500d0fb1d chore: removed skip mark from syncing and messaging tests, these tests are passing now (#360) 2023-12-04 14:18:06 +03:00
Anastasiya eb45281f2d chore: change Squish version and disable flaky tests (#359)
* chore: use newer squish

* chore: test tests with squish 7.2.1
2023-12-01 22:04:11 +03:00
Jakub Sokołowski 255f88fbb0 chore(all): rename _logger to LOG to match changes
Some of them were renamed in:
https://github.com/status-im/desktop-qa-automation/pull/352

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:58:22 +01:00
Jakub Sokołowski 76c04968fe feat(ci): add LOG_LEVEL parameter for Jenkins jobs
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:57:36 +01:00
Jakub Sokołowski 8351ae80ca fix(logs): send logs to a single file
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:54 +01:00
Jakub Sokołowski 7eab188b32 feat(all): logging to files for drivers and fixtures
Otherwise it's very hard to debug anything at all.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:53 +01:00
Jakub Sokołowski ca984fa7a0 chore(testrail): refactor init_testrail_api
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:52 +01:00
Jakub Sokołowski 1d1a0b7d44 feat(configs): add assert for SQUISH_DIR env var
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:52 +01:00
Jakub Sokołowski 128ae59d72 choer(driver): consistent formatting of server flags
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:51 +01:00
Jakub Sokołowski 9ae8173a0b fix(driver): drop retries from AUT launch method
The retries are just adding complexity and not helping.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:50 +01:00
Jakub Sokołowski 861af374cd feat(ci): archive AUT logs generated by tests
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:49 +01:00
Jakub Sokołowski 47f7a092b0 feat(driver): redirect AUT logs to files
Send application logs to `aut_stdout.log` and `aut_stderr.log` files.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:48 +01:00
Jakub Sokołowski 5d8d7aaa39 fix(all): rename APP_DIR to AUT_PATH to reflect purpose
The name APP_DIR suggests the path is a directory, but it's not.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:47 +01:00
Jakub Sokołowski bbc81717ce fix(all): refactor killing processes and waiting
* Use `psutils.pid_exists()` instead of iterating processes for no reason.
* Drop use of recursion which is completely unnecessarily complex. Use loop.
* Remove checking of `returncode` right away after process starts, it's too soon.
* Lower `PROCESS_TIMEOUT_SEC` to 5 seconds to avoid needless delays.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:46 +01:00
Jakub Sokołowski 6c91ebef11 feat(driver): add squish.ini config file to repo
Creating it by calling `squishserver` is a waste of time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:45 +01:00
Jakub Sokołowski eec2e382d8 feat(driver): wait for Squish server port to listen
Doing silly retries is just not reliable, this is.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:44 +01:00
Jakub Sokołowski fc665cf5ec fix(driver): killing process using pid not port number
* Drop unnecessary killing of processes by port, we have the PID.
* Split `stop()` method into `_detach_context()` and `_kill_process()`.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:43 +01:00
Jakub Sokołowski 917a4bfde1 fix(driver): remove pointless ATTACH_MODE config value
Removing `ATTACH_MODE` since as far as I can tell it's always `true`.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:42 +01:00
Jakub Sokołowski 81fe247d5a feat(gitignore): add .venv folder to .gitignore
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:41 +01:00
Anastasiya c112b0492b chore: reorganise wallet tests (#355)
* chore: reorganise wallet tests

* chore: enable wallet tests that have parametrization
2023-12-01 15:56:57 +03:00
Jakub Sokołowski 05ad2ebadb fix: remove windows carrige returns from files
Drives me crazy.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 10:00:56 +03:00
Anastasiya 2a9d8a4c29 chore: fix sign out test (#353) 2023-12-01 07:32:44 +03:00
Anastasiya 1232ff5ba8 Disable wallet tests and syncing test (#351)
* chore: skip wallets tests temp

Possible reason: https://github.com/status-im/status-desktop/issues/12914 is causing crashes, which we don't yet identify as crashes

* chore: skip syncing test temp

https://github.com/status-im/desktop-qa-automation/issues/350
2023-11-30 14:27:35 +03:00
Anastasiya Semenkevich 0d85a8e1de chore: comment out messaging tests because of bug 2023-11-28 17:10:38 +03:00
Valentina1133 44c3af82e5 Test/test settings messaging identity verification (#341)
* test: test_messaging_settings_identity_verification added

* chore: skipped test_settings_include_in_total_balance
2023-11-28 15:26:05 +03:00
Valentina1133 848fca521d chore: commented steps for toast message verification in accept request test (#345) 2023-11-28 15:22:49 +03:00
Valentina1133 f94f176bd3 test: test_messaging_settings accepting and rejecting request added (#336) 2023-11-27 14:44:42 +04:00
Valentina1133 7db3e94a96 test: test_cancel_setup_syncing added (#334) 2023-11-27 14:44:30 +04:00
Valentina1133 50ada60385 Chore/onboarding tests (#331)
* chore: added clicking on back button and checking correct views appear during onboarding

* chore: click clear button on profile view and checking field is empty added

* chore: show and hide password verifications added to test_check_password_strength_and_login
2023-11-27 14:44:08 +04:00
Anastasiya b74ba4f7eb chore: stabilise test (#333)
* chore: fix testnet toggle test and total balace wallet test

* chore: increase timeout for syncing test

* chore: disable test mode and remove keycard hide steps
2023-11-22 13:42:26 +03:00
Anastasiya 85b0aa1509 chore: update jenkins config (#326) 2023-11-20 23:43:09 +03:00
Anastasiya bfa8000591 chore: make the verification of banner conditional in back up seed phrase test (#321)
We don't have banners when running the app in test mode. I added condition to check the test mode and verify banner when not in test mode, otherwise skip
2023-11-20 16:06:02 +03:00
Valentina1133 8c933e75bd test: test_unlock_keycard with correct and incorrect PUK added (#312) 2023-11-17 17:54:57 +03:00
Valentina1133 fc2e6c3287 chore: keycard_tests fixes (#318) 2023-11-17 17:54:44 +03:00
Anastasiya d7908775f0 chore: several changes for wallet settings tests (#317)
* chore: fix several wallet tests

* disable account ordering because of bug

* remove test self as not needed anymore

* add log level

* click the revert button 2 times
2023-11-17 17:27:51 +03:00
Vladimir Druzhinin 5eeac9226a chore: Fix create community test (#315) 2023-11-17 12:36:59 +03:00
Vladimir Druzhinin 62bf869602 Chore/key card handler (#314)
* chore: fix seed phrase test and edit status account test

* chore: change the locator for profile layout

* chore: close Keycard Controller

---------

Co-authored-by: Anastasiya Semenkevich <anastasija.ig@gmail.com>
2023-11-17 08:53:17 +03:00
Anastasiya 41d431c136 chore: add object names to beta consent popup and test mode env variable condition (#308)
* chore: add object names to beta popup

* chore: add check for env variable
2023-11-16 13:48:17 +03:00
Valentina1133 5be0364ec4 chore: test_create_keycard_account_with_new_seed_phrase improved (#307) 2023-11-16 13:48:04 +03:00
Anastasiya a8d6cd6382 chore: add env variable (#310) 2023-11-16 12:05:39 +03:00
Valentina1133 f0dd365dcc test: test_factory_reset_keycard and test_factory_reset_keycard_incorrect_pin added (#303) 2023-11-15 19:28:11 +03:00
Vladimir Druzhinin 78733d8d9d chore: Revert getattr (#304)
Co-authored-by: vlado@status.im <Vladimir Druzhinin>
2023-11-15 11:42:17 +03:00
Vladimir Druzhinin ecd9067551 chore: Dependence on Jenkins Job name removed in TestRail configs (#287)
#276

Co-authored-by: vlado@status.im <Vladimir Druzhinin>
2023-11-15 11:42:02 +03:00
Anastasiya 34add5b08e chore: add waiting condition for total balance test so it is not failing on CI (#299) 2023-11-13 16:42:55 +03:00
Valentina1133 7d4356b5c5 chore: image verifications added to keycard tests (#297) 2023-11-13 13:46:48 +03:00
Jakub Sokołowski d44a4b9968 ci: don't run on agents with desktop-e2e-old label (#298)
A temporary attempt to debug apparent delays possibly caused by running
both old and new e2e tests on the same host.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-11-13 12:29:47 +03:00
Valentina1133 1dd73a0f92 test: test_check_whats_on_keycard added (#294) 2023-11-10 16:30:47 +01:00
Anastasiya 828b7fc02e Test: exclude from total balance (#288)
* chore: added verification for keypair name in status account and added steps

* test: test to check total balance for watched addresses added

* chore: added verification for keypair name in status account and added steps

* test: test to check total balance for watched addresses added

* review addressed
2023-11-10 18:04:49 +03:00
Jakub Sokołowski 3587f94106 ci: don't call startsWith on a null
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-11-10 14:57:46 +01:00
Jakub Sokołowski 4d6c90acb3 ci: fix filename parsing, add sane fallback (#296)
Depends on:
https://github.com/status-im/status-jenkins-lib/pull/79

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-11-10 16:00:52 +03:00
Anastasiya 9d2b9b547e chore: managing accounts tests are having the toast verification for deletion (#286) 2023-11-10 15:59:17 +03:00
Valentina1133 7358849af2 test: test_setup_keycard_with_existing_account added (#282) 2023-11-10 12:34:49 +01:00
Valentina1133 026d0ebb06 test: test_import_restore_keycard_via_seed_phrase added (#258) 2023-11-08 15:33:16 +01:00