Sometimes GCS returns 5XX (Server error) status code

GitLab-rails have the object storage integration feature. It's used by various kind of areas, such as LFS, Avatar, Job artifacts, etc.

It seems sometimes GCS returns 5XX status code (Server error) when GitLab-rails tried to access to it. You can see a bunch of errors happen on our servers.

• Production: https://sentry.gitlap.com/gitlab/gitlabcom/?query=Google%3A%3AApis%3A%3AServerError
• Staging: https://sentry.gitlap.com/gitlab/staginggitlabcom/?query=Google%3A%3AApis%3A%3AServerError
• dev.gitab.org: https://sentry.gitlap.com/gitlab/devgitlaborg/?query=Google%3A%3AApis%3A%3AServerError

From what I saw, this happens transiently. At the moment, we don't have any clues of the cause.

We don't know which this issue falls into Infrastructure or GitLab-CE. For now, we create this on infrastrcture project.