Test results tracking

We developed the gitlab_quality-test_tooling gem that includes several commands to automate test results tracking.

The goal of this gem is to have a consolidated set of tooling that we use across our various test suite (for example, GitLab Rails & E2E test suites).

The initial motivation and development was tracked by this epic.

Rails test results tracking

The relate-failure-issue command from the gem creates or updates issues in the Test Failure Issues project. For more information about the command, see the gem’s README.

End-to-end test results tracking

This is described specifically in Test results tracking.

For the E2E test suite, we use the following commands from the gem (see the gem’s README for details about each command):

  • prepare-stage-reports
  • generate-test-session
  • report-results
  • update-screenshot-paths
  • relate-failure-issue