Automatic background verification of geo replicas

In support of providing a robust disaster recovery solution for GitLab we are building verification tools. These can be run manually currently. To make sure that verification isn't overlooked we should automatically run verification tasks in the background to check the health of secondaries.

Proposal

• Automatically run upload verification tasks in the background moved to https://gitlab.com/gitlab-org/gitlab-ee/issues/5591
• Automatically run repository verification tasks in the background
• Provide basic feedback in GitLab interface about last run stats
• Provide feedback that can be consumed by external monitoring system to verify checks run and pass

Links

• https://gitlab.com/gitlab-org/gitlab-ee/issues/4862