xUnit result is not evaluated correctly - "Test summary contained no changed test results out of x total test"

Summary

In our on-premise GitLab Community Edition 11.4.5 installation, no matter whether our test fails or succeeds, GitLab CI/CD always reports that test results didn't change:

Test_results

Steps to reproduce

Here are two different error log files we generated. One reports a success and the other is reporting a failure:

Test_20181121_160732.rxlog.junit.xml

Test_20181121_162705.rxlog.junit.xml

Example Project

Excerpt from the .gitlab-ci.yml file:

test:ranorex:
  variables:
    CI_DEBUG_TRACE: "true"
  stage: ranorex
  tags:
  - windows
  script:
    - rmdir /s /q C:\Temp\Reports
    - "D:"
    - cd "D:\Documents\Visual Studio-Projekte\Ranorex\xxx-Test\xxx-Test\bin\Release"
    - xxx-Test.exe
  after_script:
    - xcopy C:\Temp\Reports\*.xml C:\Temp\GitLab\builds\884d1827\0\brand\xxx\Reports\
  artifacts:
    when: always
    reports:
      junit: C:\Temp\GitLab\builds\884d1827\0\brand\xxx\Reports\*.xml

What is the current bug behavior?

Changes in test results are not reflected correctly.

What is the expected correct behavior?

Changes in test results should show up correctly.

Assignee Loading
Time tracking Loading