GitHub import n+1 is occasionally generating a huge amount of Gitaly traffic
https://log.gitlab.net/goto/a7f7eb4996bb34deec75923bd206b0b9
See slack channel for repository name: https://gitlab.slack.com/archives/CCR9GMMR7/p1539797476000100
An unknown n+1, called via Sidekiq is occasionally hitting Gitaly at a tremendous rate: for a single repo, for a three minute period, whatever job it is will generated tens of thousands of Gitaly requests per minute.
Within a short period of ~3 minutes, the following calls were issued:
json.grpc.method.keyword Count
-------------------------------------------------
RefExists 31,044
FindCommit 12,940
FindMergeBase 10,335
WriteRef 7,488
CommitsBetween 5,166
CommitDiff 5,161
GetCommitMessages 414
FetchRemote 2
AddRemote 1
All of these came from Sidekiq, so were not caused by abuse
Edited by Andrew Newdigate