Broken pipe on HTTP requests on certain repos
OS: Debian Wheezy Version: gitlab omnibus 8.3.4
I am getting failures on over http on certain repositories. SSH works fine, but ci uses HTTP, so this and a couple other projects fail to clone. The failure is immediate, so it doesn't seem like a timeout. I tried increasing the unicorn timeout as some other tickets suggested, but that didn't work.
Client Error:
remote: Counting objects: 5614, done.
remote: Compressing objects: 100% (1167/1167), done.
fatal: The remote end hung up unexpectedly MiB | 22.59 MiB/s
fatal: early EOF
fatal: index-pack failed
I found this error in gitlab-workhorse, so it seems related to it:
2016-01-22_17:22:58.71568 2016/01/22 12:22:58 error: handlePostRPC read from [git upload-pack --stateless-rpc /srv/gitlab/git-data/repositories/user/project.git]: write unix /var/opt/gitlab/gitlab-workhorse/socket->@: write: broken pipe
2016-01-22_17:22:58.71599 scm @ - - [2016-01-22 12:22:57.386248267 -0500 EST] "POST /user/project.git/git-upload-pack HTTP/1.1" 200 227770572 "" "git/1.9.1" 1.329723
I am also getting a lot of these, don't know if it is related:
2016-01-22_17:23:00.60821 scm @ - - [2016-01-22 12:23:00.581733272 -0500 EST] "POST /ci/api/v1/builds/register.json HTTP/1.1" 404 27 "" "Go 1.1 package http" 0.026375
HTTP works for some other projects fine, and this project worked last night, so something changed.