Mixed-deployment scenario for end-to-end tests
Problem
We want to be able to detect mixed deployment issues during development, not during staging / production deployment
Related issues: gitlab-org/quality/quality-engineering/team-tasks#1815 (closed)
Proposal
Introduce end-to-end mixed-deployment scenario that always runs when there's a migration that is added in the MR.
The scenario should do something like:
- Check out merge base
- Setup server
- Basic cache warm to ensure schema cache is loaded for all models
- Check out merged result
- Run migration
- Run smoke end-to-end tests
It could look something like !122980 (merged), using GDK QA
/cc @niskhakova @DylanGriffith @OmarQunsulGitlab @zeffmorgan
Edited by Thong Kuah