Private runners outage
Yesterday (20.07) I deployed a new version rc.2 of GitLab Runner to our private-runners-manager-X. This version introduces timeouts: https://gitlab.com/gitlab-org/gitlab-ci-multi-runner/merge_requests/616. We started noticing strange behavior:
- builds being started, but no changes being uploaded to GitLab,
- seeing:
couldn't execute PUT against https://gitlab.com/api/v4/jobs/23414071: Put https://gitlab.com/api/v4/jobs/23414071: net/http: timeout awaiting response headers- people noticing that behavior: https://gitlab.slack.com/archives/C0SFP840G/p1500591544569786, https://gitlab.slack.com/archives/C0SFP840G/p1500624007068613.
For now, I reverted rc2 on private to rc1 to possibly re-think and re-test the change.