open-bounty/doc/core_testing_workflow.md

2.9 KiB
Raw Blame History

Testing pull requests in Open Bounty

All new functionality and features both are being delivered by pull requests (hereinafter PRs). How to test PR? Steps below could help a bit!

Prerequisites

Requirements for PRs to be tested:

  • should be in To test column in Pipeline For Pull Requests project
  • should be updated to last develop. If button Update is avaivable on particular PR, click it and wait until it will be built.
  • shouldn't have conflicts with develop branch
  • should have a successful build in Jenkins status-openbounty-app

Deployment

In order to deploy feature to testing env you should rebuild PR you are about to test (all open PRs are in Jenkins).

When PR is successfully build and deployed, testing env with deployed PR is accessible in 2-3 mins.

Only one at one time PR can be deployed on testing env

Fresh develop branch with last changes is deployed automatically on staging env

Testing

  1. Move appropriate PR card to IN TESTING on the Board and let people know you are on it - assign it to yourself! :)
  2. Сheck the functionality current PR fixes / delivers (positive/negative tests related to the feature). In curtain cases it's worth to look in 'Files changed' tab in GitHub to check the list of what was changed to get understanding of the test coverage or "weak" places that have to be covered. Ask PR-author in #openbounty channel in slack what was changed if it's not clear from the notes in PR.
  3. Check reasonable regression using SOB-general test suite
  4. No issues? Perfect! Put appropriate label to the PR (Tested - OK), merge it to develop (using Rebase-Merge) and move the PR instance to Merged to develop.
  5. Found issues? Check for duplicates before adding one. Hint: make sure the issue is really introduced by current PR - check latest develop branch on staging env . Issue exists in develop? Check existing issues list and make sure you are not adding duplicates before creating your own bug :)
    All PR-specific issues should be added as comments to tested PR. Once all issues are logged put label Tested-issues to the PR and notify developer that there are several problems that are preventing the PR to merge. Move the PR to Reviewing, waiting for contributor on the board if PR is developed by external contributor, and to Developing - if it is presented by core contributor.