Commit Graph

78 Commits

Author SHA1 Message Date
Igor Sirotin ea290d97ef
feat_: Integrate Codecov (#5796)
* feat_: added `codecov-cli` nix derivation

* feat_: added simple codecov configuration

* feat_: add UNIT_TEST_REPORT_CODECOV ci flag

* feat_: upload logs and reports to codecov
2024-09-05 10:11:16 +01:00
Igor Sirotin 6287b5fcf7
fix(run_unit_tests.sh)_: proper exit code on test fail (#5797) 2024-09-04 11:24:26 +01:00
Igor Sirotin 7623f68679
fix_: nightly test runs (#5791)
* fix_: run nightly protocol tests as separate processes

* fix_: calculate timeout

* fix_: TEST_WITH_COVERAGE_REPORTS_DIR

* fix_: proper filter protocol package

* chore_: log run_unit_tests stages

* fix_: coverage reports merging

* chore_: more logs

* chore_: fix typo

* chore_: increase test timeouts

* fix_: properly filter packages

* feat_: UNIT_TEST_DRY_RUN flag for tests run

* fix_: UNIT_TEST_PACKAGES_FILTERED calculation

* fix_: remove the force-run waku test first

* fix_: delete unused file
2024-09-03 12:50:09 +01:00
Igor Sirotin 28e7a364c7
chore(test_stats)_: better stats, print skipped tests (#5781)
* chore(test_stats)_: better stats, list skipped tests

* chore_: add skip reasons to some tests
2024-08-29 21:09:26 +01:00
Igor Sirotin 666f07fe1e
fix_: nightly tests report (#5779) 2024-08-29 11:48:32 +01:00
Igor Sirotin 8491e76a34
fix_: separate commit message check (#5773)
* chore_: add github action conventional commits

* chore_: remove commit check from tests run

* fix_: continue checking commits when breaking change found

* fix_: don't run check on pr edit
2024-08-27 22:42:06 +01:00
Igor Sirotin cc722359b5
chore_: run tests concurrently (#5731)
* chore_: fake flaky tests

* chore_: run tests in parallel (wip)

* chore_: test-with-coverage-old

* chore_: lint-fix fake flaky tests

* chore_: cleanup

* chore_:

* chore_: lint-fix fake flaky tests

* chore_: enable running some tests sequentially

* chore_: enable back all tests

* chore_: no sequential packages

* chore_: cleanup

* chore_: remove fake flaky packages

* chore_: cleanup

* chore_: attempt UNIT_TEST_COUNT as test count

* chore_: spawn multiple processes

* fix_: don't spawn multiple processes

* chore_: revert redirect_stdout changes

* fix_: update Jenkinsfile

* fix_: use env variables

* fix_: typo
2024-08-26 10:03:26 +01:00
Igor Sirotin ef85895f65
fix_: pass proper version to params (#5735)
* fix_: pass proper version to params

* fix_: use --dirty flag

* fix_: delete version_test

* fix_: pass proper version to artifacts
2024-08-19 16:47:11 +01:00
richΛrd a6645bd209
chore_: remove `status.test` fleet (#5702) 2024-08-16 14:26:35 -04:00
Igor Sirotin 93bb77f303
chore_: change patch version to 0 when incrementing minor (#5719) 2024-08-15 18:36:52 +01:00
Andrea Maria Piana 771f26210a Set BASE_BRANCH to develop if not defined 2024-08-14 19:55:09 +01:00
Igor Sirotin dd443b030d
fix(commit_check)_: use proper base branch (#5700) 2024-08-13 10:58:48 +01:00
Mykhailo Prakhov 58a9557c58
fix: reject handling requests to join without revealed accounts (#5549)
* fix(requestToJoin)_: request to join must have revealed addresses with signature

* fix(tests)_: fix tests

* chore(tests)_: increase tests timeout
2024-08-07 17:57:02 +02:00
frank 79d9262430
fix_:increase timeout on unit test (#5553) 2024-07-22 19:08:47 +08:00
Igor Sirotin 325429b218
chore_: add test-coverage.html report (#5490) 2024-07-10 13:37:50 +01:00
Igor Sirotin e2846f3936
chore_: exclude cmd from test coverage (#5427) 2024-06-26 17:16:16 +02:00
Andrea Maria Piana 5cfaa00195 chore_: Add script for extracting logs 2024-06-24 11:56:57 +01:00
Igor Sirotin 61322b8dab fix_: catching gotestsum exit code 2024-06-21 12:10:44 +01:00
Igor Sirotin a049f0b688
fix_: include coverage from all packages (#5390) 2024-06-20 21:35:35 +01:00
Igor Sirotin d00df557c7
fix_: final coverage reports merging (#5384) 2024-06-19 17:57:44 +01:00
Igor Sirotin d2f4cae18f
fix: merge coverage reports from each test rerun (#5360)
* fix_: fix test coverage when rerunning tests

* fix_: make lint-fix

* chore_: change test coverage report artifact name

* chore_: added codeclimate.json to artifacts

* chore_: bring in gocovmerge util

---------

Co-authored-by: Siddarth Kumar <siddarthkay@gmail.com>
2024-06-19 11:40:52 +01:00
Siddarth Kumar 8e53f62331
chore_: set $GIT_COMMIT for codeclimate (#5315)
When Jenkins creates a build, it can sometimes run the build on a detached HEAD, causing the commit SHA to be different from the SHA of your branch. This will cause issues when reporting test coverage to Code Climate.

Setting `GIT_COMMIT` fixes code climate upload errors.

ref -> https://docs.codeclimate.com/docs/jenkins#jenkins-ci-builds

Closes #5294
2024-06-10 07:30:10 +05:30
Patryk Osmaczko c2f5bdb907 chore(scripts)_: extend tests timeout to 35mins 2024-06-07 23:46:20 +02:00
Patryk Osmaczko 568e07d2eb chore(scripts)_: add HEAD logging to run_unit_tests.sh
To check if #4993 is really resolved.
2024-05-22 19:44:25 +02:00
Jakub Sokołowski c7397e18dd
chore(all)_: remove obsolete eth.staging fleet
And leftovers of `eth.test` fleet which no longer exists.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-17 20:21:00 +02:00
Anton Iakimov 92ef58d420
chore_: drop wakuv2 fleets, use waku fleets
See https://github.com/status-im/infra-nim-waku/issues/91 for details.

Mostly done automatically. Some parts manually.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-17 18:53:40 +02:00
Igor Sirotin 0dde5a3b17
chore_: enable nightly codeclimate reports (#5127)
* chore_: enable nightly codeclimate reports
* fix_: report codeclimate before exiting
2024-05-08 21:57:50 +01:00
Igor Sirotin 068ae3b67c
chore_: setup ci codeclimate coverage reports (#5101)
* chore_: nix derivation with cc-test-reporter
2024-05-08 09:25:01 +01:00
Andrea Maria Piana fc846211b7
fix_: make sure tag version works if no args are passed 2024-04-10 12:18:30 +01:00
Andrea Maria Piana a9228df085
fix_: ignore description in commit check 2024-04-10 12:04:55 +01:00
Andrea Maria Piana 8c7a6aa54d chore_: Add tag-version command 2024-04-10 11:43:13 +01:00
Alexis Pentori f9df853e4a
nix: Updating Nix Shell and Makefile to use nix-shell
Signed-off-by: Alexis Pentori <alexis@status.im>
2024-04-09 12:49:06 +03:00
Andrea Maria Piana c7533a7dab Extend migration check 2024-03-06 23:37:06 +00:00
Patryk Osmaczko 86ae80b108 fix: respect exit code from package run
Fixes the issue where the job succeeds even when there are always
failing tests.
2024-03-06 18:05:40 +01:00
Patryk Osmaczko abfaa3cf8d chore: run nightly tests in parallel 2024-02-29 18:23:20 +01:00
Patryk Osmaczko a068b64d5e chore: run nightly tests one by one
fixes: #4585
fixes: #4586
2024-02-28 22:00:26 +01:00
Patryk Osmaczko fdd979096c chore: add capability to rerun failed tests
- Use `gotestsum` to generate junit test reports and re-run failed tests.
- Archive re-run reports in `${package_dir}/report_rerun_fails.txt`.
2024-02-27 11:00:29 +01:00
Patryk Osmaczko e29332a374 chore: set extended timeout only for `protocol` package
It mitigates #4585 until the root cause is fixed.
2024-01-26 12:27:57 +01:00
Anton Iakimov 2d251e9a08
ci: increase nightly runs and add more info to test stats (#4378) 2023-11-24 17:42:44 +01:00
Anton Iakimov e67bee6e7b
fix: nightly test runs timeout (#4358)
Need to multiply 30m by test runs to make sure it fill be enough.
2023-11-22 17:48:04 +01:00
Anton Iakimov c62957f621
feat: publish test_stats report (#4349)
Let's publish test_stats as a Jenkins report instead of printing to the
build log.
2023-11-22 11:37:05 +01:00
Anton Iakimov d1a9ad599c
feat: detect flaky tests
This reverts commit f12803ec95.
2023-11-21 17:03:37 +01:00
Anton Iakimov f12803ec95
Revert "feat: detect flaky tests"
There are signs that test runs became unstable.
Might be related to this commit.

This reverts commit 9f168eacea.
2023-11-21 16:34:43 +01:00
Anton Iakimov 9f168eacea
feat: detect flaky tests 2023-11-20 15:08:51 +01:00
Jakub Sokołowski 5aa9eb913d
fix: drop unnecessary wrappers, fix shebangs
Also make the hook installation run by default.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-11-07 18:02:06 +01:00
Anton Iakimov 7a9845c6e2
ci: hide `go test` output to the file on CI
Let's hide stdout of go tests to the files.
In case of failed test - it should be included in junit report anyway and shown in Jenkins.

Closes #3543
2023-09-13 10:53:38 +02:00
Andrea Maria Piana 5f55a7bcc8 fetch develop before checking 2023-06-28 19:58:21 +01:00
Andrea Maria Piana 75c9374420 Add migration check script 2023-06-23 12:01:30 +01:00
Andrea Maria Piana 959e370389 config: add new Push notifications fleet
Also drop no longer existing `eth.test` fleet.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-19 17:29:18 +01:00
Richard Ramos 11e432d341
feat: allow passing variables to docker-compose and fix var name (#2821) 2022-09-15 15:41:00 -04:00