[Feedback] Auto-quarantining of flaky tests

This is a feedback issue to gather feedback on the auto-quarantining process that was communicated with !181 (merged).