Promote the Agent QA test to :smoke or :reliable
Problem
The gitlab-com/gl-infra/production#6139 (closed) incident happened because the Agent QA test was not set to run on :smoke
and :reliable
test suites.
These tests run more often in staging since it is a much smaller subset of tests (faster deployments). Tests can be actively promoted due to their non-flaky behavior and we now collect data to inform this decision.
The KAS test wasn't in either of these suites so it did not run, but from previous runs, this has been a test historically stable so it could make sense to consider promoting it after it gets fixed and runs for some time to observe its reliability.
Proposal
Add them to either :smoke
or :reliable
test suite.
Since KAS is a deployment blocker, I think this should be considered a Smoke Test.
Issue Blocked
The issue is currently blocked as we need to first fix #349708 (closed). After that, we need to wait for a period until the test is considered stable, as explained in the Problem
section.
FYI @ash2k @dcroft @hfyngvason @nagyv-gitlab @nmezzopera @skarbek @svistas @tigerwnz