Extend "show passed tests" toggle to also hide skipped tests

Miroslav Vadkertirequested to merge
filter-skipped-tests into main

Problem

For large runs (e.g. xfstests) many tests are legitimately skipped or notrun. Because only passed tests were filtered, the screen was flooded with skipped results, burying the handful of tests that actually failed.

Reported by esandeen: a toggle to hide skipped tests (like the one for passed tests) would make it easy to see only the tests that failed.

Change

The existing "Show passed tests" toggle now also governs skipped tests:

  • new isSkipped / isHiddenWhenPassedOff helpers drive the testcase/testsuite filters
  • failedTestsCount ignores skipped tests too, so a flood of skips no longer collapses the real failures
  • the toggle appears when there are passed or skipped tests
  • the label gets a title tooltip: "Also shows skipped test results"

By default only tests that need attention are shown; toggling reveals both passed and skipped.

Tests

New scenarios/tmt-skipped (failed + passed + skipped testcases) and a Cypress test covering the default filtering, the toggle revealing passed and skipped, and the tooltip.

Independent of !98 (merged) (the "Tests failed to run" / no-logs fix), though both address esandeen's feedback on the results view.

Edited by Miroslav Vadkerti

Merge request reports