v2 => Improve burn-in process for potential deployment-blocking QE tests

Problem to Solve

It is currently a manual process to track the addition of tests in the Quality E2E test suite that block deployments. These tests are specifically tagged as smoke, reliable, and mixed_env. To allow for appropriate burn in periods of tests, SETs currently manually track the test status.

Proposal

Improve the burn in process for potential deployment-blocking tests by adding a corresponding tag.

Adding additional metadata to tests undergoing a burn in period to check for stability will allow us to follow up with potential automation to further reduce the manual overhead of related test management.

Tasks

• Investigate other QE endeavors to automate promotion and demotion of automated tests
• Add metadata documentation to the approved list
• Update blocking test process documentation in Quality Engineering handbook