Skip to content

Define and document acceptable thresholds for rspec tests

Related discussion &8729 (comment 1103759355)

Using /rspec_profiling_stats to determine a threshold. We can start with the average number of the top 50 slow tests per file

  • Average time for top 50 slow spec files: 577.0309535077 seconds
  • Average time for top 50 slow individual tests: 79.41 seconds

This is 5% of the top slow 1000 tests.

With this issue, we have:

Even if at first there is nothing preventing adding slower test, this could bring the first awareness for engineers

With next iterations, we can come up with thresholds for different example types. This MR could help

Edited by Alina Mihaila