Promote stable E2E specs to reliable in batches
Promote E2E specs to reliable in batches and monitor.
-
Check reliable report (preferably last 2 reports) from #quality-reports channel. -
Select a batch of 10 examples to promote to :reliable
-
Perform a quick audit on if E2E spec can be removed completely(if there is test coverage already in lower level specs) -
Open MR -
Monitor GDK pipeline(master) dashboard for a week after MR is merged. -
Monitor gdk-qa-reliable
job runtimes after promotion https://app.periscopedata.com/app/gitlab/912649/Quality-End-to-End-Test-Duration?widget=16703026&udv=0 -
If there is a failure in the reliable test on master, follow fast quarantine process.
Stage | SET |
---|---|
Govern | @hmuralidhar |
Verify | @hmuralidhar |
Create | @a_mcdonald |
Package | @hmuralidhar |
Data Stores | |
Plan |
Edited by Harsha Muralidhar