Import Project no longer appears to works with larger imports due to error NotFound
Testing recently has found that project import appears to no longer work on the latest version. The error unfortunately is a vague NotFound
error seemingly suggesting that the project didn't seem to make it to the Gitaly node:
{"correlation_id":"YkXmO5Swl06","error":"rpc error: code = NotFound desc = GetRepoPath: not a git repository '/var/opt/gitlab/git-data/repositories/@hashed/d4/73/d4735e3a265e16eee03f59718b9b5d03019c07d8b6c51f90da3a666eec13ab35.git'","grpc.code":"NotFound","grpc.meta.auth_version":"v2","grpc.meta.client_name":"gitlab-web","grpc.meta.deadline_type":"regular","grpc.method":"FindDefaultBranchName","grpc.request.deadline":"2020-08-13T10:17:55Z","grpc.request.fullMethod":"/gitaly.RefService/FindDefaultBranchName","grpc.request.glProjectPath":"qa-perf-testing/gitlabhq2","grpc.request.glRepository":"project-2","grpc.request.repoPath":"@hashed/d4/73/d4735e3a265e16eee03f59718b9b5d03019c07d8b6c51f90da3a666eec13ab35.git","grpc.request.repoStorage":"default","grpc.request.topLevelGroup":"@hashed","grpc.service":"gitaly.RefService","grpc.start_time":"2020-08-13T10:17:45Z","grpc.time_ms":0.237,"level":"info","msg":"finished unary call with code NotFound","peer.address":"@","pid":1303,"span.kind":"server","system":"grpc","time":"2020-08-13T10:17:45.606Z"}
This only appears to happen for larger projects as (very) small imports did seem to work as expected. In testing the project attempted with Quality copy of gitlabhq
, both in json and ndjson form.
Investigation found this was occurring in Nightly images but also unfortunately on version 13.2.4
. This was both on multi-node test environments and clean docker images. There is also a test pipeline for project import that, against staging, looks to have started failing silently after 13.2.4
was released. A further test on 13.2.0
showed import working fine.