Skip to content

Include filename from test in the artifact-based CI View test report

Problem to solve

The new artifact-based CI View (#24792 (closed)) is fantastic, and we (Quality) would love to use it, but there are a couple of UI/UX issues that prevent us from getting the most out of it.

One of those issues is that the CI View is missing the file associated with the test.

We refer to tests primarily via their file path in issues and Slack and any other communication, so it's would be extremely helpful if that information were faithfully represented in the CI View.

Intended users

Anyone involved in reviewing test reports, but especially:

Further details

This is an example of an issue reporting a failure in one of our QA tests: #118473 (closed)

Note the test file path is included in the title: Transient failure in qa/specs/features/ee/browser_ui/3_create/merge_request/add_batch_comments_in_merge_request_spec.rb

The engineer investigating the failure can easily copy that file path then open the file locally.

The current view shows the class name and the test name, so we have the information we need to search for the relevant test file, but that's less efficient than having the full file path.

Proposal

Include the filename in the CI View. That information is already included in JUnit XML files, e.g.:

<testcase 
  classname="qa.specs.features.browser_ui.3_create.web_ide.add_file_template_spec"
  name="Create Web IDE file templates user adds .gitignore via file template Android" 
  file="./qa/specs/features/browser_ui/3_create/web_ide/add_file_template_spec.rb"
  time="15.766099">
</testcase>

Designs for the change are in the design area of this issue.

Edited by James Heimbuck