file-45-stor-gprd AddRemote timeouts
- Slack thread 1: https://gitlab.slack.com/archives/CD6HFD1L0/p1595931620175800
- Slack thread 2: https://gitlab.slack.com/archives/C3ER3TQBT/p1595941332151500
We receive high error rate alerts for file-45-stor-gprd
(eg: https://gitlab.slack.com/archives/CD6HFD1L0/p1595931620175800)
@hphilipps investigated and spotted that the problem was AddRemote
calls.
Further investigation seems to indicate that for some reason, there are a steady stream of AddRemote
calls failing on this particular host.
The timeout for AddRemote
is 10s, but this should be enough to perform the necessary local writes to perform the change. (iirc, AddRemote
does not contact the remote, just adds the metadata)