RefsService.FindAllBranches acceptance testing
~Conversation: #389 (closed)
Feature Toggle Name: gitaly_branches
Required Gitaly Version: v0.25.0
Required GitLab Version: v9.5
1. Preparation
-
Routes: what routes use this migration? - ?
-
Sentry: -
Ensure that all gitaly_migrate
issues in theGitLab.com
tracker are either assigned or resolved: https://sentry.gitlap.com/gitlab/gitlabcom/?query=is%3Aunresolved+is%3Aunassigned+gitaly_migrate -
Ensure that all issues in the Gitaly Production
tracker are either assigned or resolved: https://sentry.gitlap.com/gitlab/gitaly-production/?query=is%3Aunresolved+is%3Aunassigned
-
-
Grafana -
Kibana
2. Development Trial
-
Check Dev Server Versions: Ensure that the environments have the correct Gitaly and GitLab versions running -
Enable on dev.gitlab.org
:-
ssh into dev.gitlab.org
and enable the feature running by runningFeature.get('gitaly_FEATURE_NAME').enable
on a rails console. -
Perform some testing and leave the feature enabled
-
3. Staging Trial
-
Check Staging Server Versions: Ensure that the environments have the correct Gitaly and GitLab versions running -
Enable on staging.gitlab.com
in#development
-
Perform some testing and leave the feature enabled
-
4. Production Server Version Check
-
Gitaly: https://performance.gitlab.net/dashboard/db/gitaly-version-tracker?orgId=1&var-job=gitaly-production -
GitLab: https://gitlab.com/help
5. Initial Impact Check
-
Set Gitaly to 1% using the command !feature-set gitaly_FEATURE_NAME 1
in#production
-
Leave running for at least 15 minutes - Monitor sentry, grafana and kibaba links above, every 5 minutes but preferably in "real-time"
-
On usual activity, disable trial with !feature-set gitaly_FEATURE_NAME false
in#production
-
6. Low Impact Trial
-
Set Gitaly to 5% using the command !feature-set gitaly_FEATURE_NAME 5
in#production
-
Leave running for at least 2 hours - Monitor sentry, grafana and kibaba links above, every 30 minutes
-
On usual activity, disable trial with !feature-set gitaly_FEATURE_NAME false
in#production
-
7. Mid Impact Trial
-
Set Gitaly to 50% using the command !feature-set gitaly_FEATURE_NAME 50
in#production
-
Leave running for at least 24 hours - Monitor sentry, grafana and kibaba links above, every few hours
-
On usual activity, disable trial with !feature-set gitaly_FEATURE_NAME false
in#production
-
8. Full Impact Trial
-
Set Gitaly to 100% using the command !feature-set gitaly_FEATURE_NAME 50
in#production
-
Leave running for at least a week - Monitor sentry, grafana and kibaba links above daily
-
On usual activity, disable trial with !feature-set gitaly_FEATURE_NAME false
in#production
-
9. Outcome
-
Report on the outcome of the tests (leave comments on this issue)
-
Did the migration perform as expected? -
Did the code have reasonable performance characteristics? -
Did error rates jump to an unacceptable level?
-
-
Additional Runbook information required? -
If so, was it added? (link to MR)
-
-
Prometheus Alerts Added -
If so, was it added? (link to MR)
-