Pull mirroring process is stuck for mirror gitlab-org/gitlab on JH
This condition raise from 06-02, We're not sure if it's temporary or if some change is causing the problem.
background
https://gitlab.com/gitlab-jh/jh-team/gitlab/-/commits/master
From 06-03，mirror gitlab-org/gitlab started failed on jihulab.com
06-05
we remove mirror and retry. We got Import timed out error.
06-05 Afternoon
The we try reset ProjectImportState data and remove project_id from sidekiq redis.
And set gitaly medium timeout set 45s (default is 30s) https://docs.gitlab.com/ee/user/admin_area/settings/gitaly_timeouts.html#available-timeouts
Note that extending the timeout doesn't resolve the problem but decreases the chance of failures, because most of the time the duration of
ListLFSPointersis around 42 seconds. Once the gitaly grpc methodListLFSPointersis canceled due to timeout, the subsequential operations won't be executed, and the mirror process fails.
Now can mirror success. See here https://jihulab.com/gitlab-cn/gitlab/-/commits/main-jh
The command that running at gitlab-console
project_id = xxxx # https://jihulab.com/gitlab-cn/gitlab
project = Project.find(project_id)
state = ProjectImportState.find_by(project_id: project_id)
project.reset_cache_and_import_attrs
Gitlab::Mirror.available_capacity
Project.mirrors_to_sync(Time.now)
# ProjectImportState.with_status([:scheduled, :started]).where.not(jid: nil).select(:jid)
state.jid
Gitlab::Redis::SharedState.with { |r| r.smembers(Gitlab::Mirror::PULL_CAPACITY_KEY) }
Gitlab::Mirror.decrement_capacity(project_id)Other repo raise error
https://gitlab.com/gitlab-jh/jh-team/gitlab/-/commits/master
This project is mirrored from https://gitlab.com/gitlab-org/gitlab.git. Pull mirroring failed 3 hours ago.
Last successful update 2 days ago.Other user report this error
other users report the same bug. Pull mirroring process is stuck for some projects (#414003 - closed)
Relation MR or issue
Review ten days issues and mr list, maybe some mr affect this question