Large number of overdue pull mirror jobs due to requiring licenses for private projects to be mirrored
Due to a change in what projects can be submitted to sidekiq for mirroring, many repositories configured to replicate, will not be replicated.
- Change issue: gitlab-org/gitlab#10361 (closed)
- Code change: https://gitlab.com/gitlab-org/gitlab/-/blob/9f881b2e6acf62baa2227d26918f5c8156d74fbe/ee/app/workers/update_all_mirrors_worker.rb#L50
This change was made at 2020-03-22 15:06 UTC in production.
It appears that we do account for the plan and public/private setting of the repo being mirrored in the gitlab exporter. So, this appears to be a real issue where we are spending too much time looking into repos we shouldn't be migrating: https://gitlab.com/gitlab-com/gl-infra/infrastructure/-/issues/9587#note_309189231
This slowdown was pushing very few mirrors jobs, and causing a slowdown for all the mirrors.
Edited by 🤖 GitLab Bot 🤖