OAuth Token requests sometimes take up to 60 seconds
We have some reports from Hashicorp where Terraform users sometimes see OAuth token refresh requests take up to 60 seconds. This may cause a race condition on the client side that results in #243844 (comment 555366609).
We need to identify whether this is a bug in GitLab, an infrastructure issue, etc. so we can reduce the occurrences of long request times on this endpoint. It will reduce the race condition.
Kibana shows over the 4 preceding days we had 43 requests that exceeded 5 seconds, and 160 requests that exceeded 1 second. This endpoint normally responds in about a tenth of a second. https://log.gprd.gitlab.net/goto/0d5c8950f7f3176925e2013504688b65