Differentiate between errors/failures in xUnit result
Problem to solve
In solving #25358 (closed) we arrived at the conclusion stated at gitlab-foss!32749 (comment 216360352). The original state did not evaluate errors next to failures for xUnit results, when #25358 (closed) is closed it will, however, the copy inside of the merge request widget does not yet differentiate between those two types.
Intended users
- Sasha (Software Developer)
- QE / SDET
Further details
- When a test is ran that generates an error scenario like a test written incorrectly, I want to see that reported separate from tests that fail so that I debug the proper issue. ** This is probably a scenario when new tests are introduced hastily and the issue is in the test not the code.
- When a test is ran that fails, I want to see that reported separate from tests that error out, so that I can debug the proper issue.
Proposal
Convert copy X failed/error test results out of X total tests to X failed, X errors out of X total tests
Permissions and Security
Documentation
- Update the JUnit test report documentation about the new / extra information provided.
Testing
What does success look like, and how can we measure that?
Acceptance Criteria
- New copy in the widget is produced at the appropriate time (see #25358 (closed) from some examples of failures/errors).
- Parsing speed is still performant (no noticeable slow down).
What is the type of buyer?
Links / references
Edited by James Heimbuck