Differentiate between errors/failures in xUnit result

Problem to solve

In solving #25358 (closed) we arrived at the conclusion stated at gitlab-foss!32749 (comment 216360352). The original state did not evaluate errors next to failures for xUnit results, when #25358 (closed) is closed it will, however, the copy inside of the merge request widget does not yet differentiate between those two types.

Intended users

  • Sasha (Software Developer)
  • QE / SDET

Further details

  • When a test is ran that generates an error scenario like a test written incorrectly, I want to see that reported separate from tests that fail so that I debug the proper issue. ** This is probably a scenario when new tests are introduced hastily and the issue is in the test not the code.
  • When a test is ran that fails, I want to see that reported separate from tests that error out, so that I can debug the proper issue.

Proposal

Convert copy X failed/error test results out of X total tests to X failed, X errors out of X total tests

Permissions and Security

Documentation

  • Update the JUnit test report documentation about the new / extra information provided.

Testing

What does success look like, and how can we measure that?

Acceptance Criteria

  • New copy in the widget is produced at the appropriate time (see #25358 (closed) from some examples of failures/errors).
  • Parsing speed is still performant (no noticeable slow down).

What is the type of buyer?

Links / references

Edited Nov 18, 2019 by James Heimbuck
Assignee Loading
Time tracking Loading