Commit Graph

35 Commits

Author SHA1 Message Date
Anastasiya Semenkevich 467f65ac1a chore: introduce flaky mark
A “flaky” test is a test that usually pass but sometimes it fails.
If a flaky test pass it will be reported normally as test succeed. If the test fails, instead of being reported as failure it will be reported as a xfail.
2023-12-15 16:07:13 +03:00
Anastasiya Semiankevich 8fe9b4731c chore: move the TEST MODE back off for now and add some more fixes 2023-12-13 17:20:30 +03:00
Anastasiya Semenkevich bce460abf8 chore: test test mode 2023-12-13 17:20:30 +03:00
Jakub Sokołowski 2fab5ca720 chore(ci): remove obsolete desktop-e2e-old CI label
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-06 15:03:15 +01:00
Anastasiya eb45281f2d chore: change Squish version and disable flaky tests (#359)
* chore: use newer squish

* chore: test tests with squish 7.2.1
2023-12-01 22:04:11 +03:00
Jakub Sokołowski 76c04968fe feat(ci): add LOG_LEVEL parameter for Jenkins jobs
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:57:36 +01:00
Jakub Sokołowski 861af374cd feat(ci): archive AUT logs generated by tests
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:49 +01:00
Jakub Sokołowski 5d8d7aaa39 fix(all): rename APP_DIR to AUT_PATH to reflect purpose
The name APP_DIR suggests the path is a directory, but it's not.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-12-01 14:48:47 +01:00
Anastasiya b74ba4f7eb chore: stabilise test (#333)
* chore: fix testnet toggle test and total balace wallet test

* chore: increase timeout for syncing test

* chore: disable test mode and remove keycard hide steps
2023-11-22 13:42:26 +03:00
Anastasiya 85b0aa1509 chore: update jenkins config (#326) 2023-11-20 23:43:09 +03:00
Anastasiya a8d6cd6382 chore: add env variable (#310) 2023-11-16 12:05:39 +03:00
Vladimir Druzhinin ecd9067551 chore: Dependence on Jenkins Job name removed in TestRail configs (#287)
#276

Co-authored-by: vlado@status.im <Vladimir Druzhinin>
2023-11-15 11:42:02 +03:00
Jakub Sokołowski d44a4b9968 ci: don't run on agents with desktop-e2e-old label (#298)
A temporary attempt to debug apparent delays possibly caused by running
both old and new e2e tests on the same host.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-11-13 12:29:47 +03:00
Jakub Sokołowski 3587f94106 ci: don't call startsWith on a null
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-11-10 14:57:46 +01:00
Jakub Sokołowski 4d6c90acb3 ci: fix filename parsing, add sane fallback (#296)
Depends on:
https://github.com/status-im/status-jenkins-lib/pull/79

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-11-10 16:00:52 +03:00
Jakub Sokołowski 5902bbbeee ci: improve build names and descriptions
Currently the logic is a bit messy and results are not great.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-11-08 14:52:44 +01:00
Jakub Sokołowski 791ff10114 ci: default to using nightly build for QA PR builds
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-11-07 14:30:03 +01:00
Vladimir Druzhinin dbf485f669 chore: add reporting of nightly results to test rail (#228)
* chore: Rerun failed test added

* chore: Create Test Run in TestRail if it not exists

#227
2023-11-02 17:08:22 +01:00
Jakub Sokołowski b25cbb5ce3 ci: handle nightly build naming better
Nightly builds just don't provide enough info in the path itself.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-10-27 16:45:30 +02:00
Jakub Sokołowski fa939e2cf7 ci: set short build name and better description (#217)
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-10-26 14:18:33 +03:00
Jakub Sokołowski 7c02011373 ci: fix missing bracket for timeout
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-10-24 18:50:59 +02:00
Jakub Sokołowski 814f8f1470 ci: bump number of builds to keep
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-10-24 18:34:55 +02:00
Jakub Sokołowski 613d5db7a4 ci: add timeouts per each stage
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-10-24 18:34:54 +02:00
Jakub Sokołowski 678331de28 ci: update GitHub check status at job start too
This way we'll see in GitHub PRs that the new job is in progress.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-10-24 16:35:57 +02:00
Jakub Sokołowski 3c48317ce2 ci: add GitHub check status update for desktop repo
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-10-24 14:08:38 +02:00
Jakub Sokołowski 0a09b141df ci: update build name to be more descriptive
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-10-24 14:08:37 +02:00
Jakub Sokołowski df6c0a3b9a ci: replace BUILD_URL with BUILD_SOURCE parameter
This parameter can take both URL or a path to Jenkins job.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-10-24 13:59:24 +02:00
Jakub Sokołowski ebf0f819ac ci: refactor Jenkinsfile for clarity
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-10-24 13:59:23 +02:00
Jakub Sokołowski 8362b93734 config: use filenames that end in .py
They are Python files, changing their file extension is a bad idea.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-10-24 13:59:22 +02:00
Vladimir Druzhinin 0f3742631e Improving jenkinsfile (#175) 2023-10-13 16:37:06 +02:00
Vladimir Druzhinin 243f8f5e20 Jenkinsfiles were merged (#164)
#163
2023-10-13 13:22:50 +02:00
Vladimir Druzhinin 4e22a69423 Ci/144 jenkins file (#158)
* Jenkins file for nightly regression added

* Downloading build by URL added

#144
2023-10-10 10:30:56 +02:00
Vladimir Druzhinin e768492703 Fix/143 image comparison (#150)
* Attach squish server config to test report

* Fix image comparison on CI 

#143

* Fix failed image comparison

#143

* List branches added

#144
2023-10-09 11:38:48 +02:00
Vladimir Druzhinin 0c63fc6f93 Ci/74 jenkins file (#142)
* OS native dialog replaced on Qt dialog

* Starting fluxbox added to make File Dialog visible
2023-10-06 10:33:42 +02:00
Vladimir Druzhinin fd64142295 Ci/74 jenkins file (#118)
* Set up Jenkins file

#74

* Fix Allure trend

* Display resolution changed on CI

* TestRail integration

* Fix test on create community

* Fix wallet tests

* Fix field description in jenkinsfile

* Test name and test scope parameters were split in Jenkinsfile

* Clean up moved in post stage

* Environment variables set up changed in JenkinsFile

* Fix test ID

* Fix warnings in JenkinsFile

* Copy artifacts directory changed

* Fix of two space indentations in Jenkinsfile

* Extra environment variable removed

* Move tests wallet in one folder

---------

Co-authored-by: Valentina Novgorodtceva <valentina@status.im>
2023-09-28 14:44:13 +02:00