json unmarshal: unknown field "glProjectPath" in gitaly.Repository fatal

After I upgraded to v 11.11.7, 503 was prompted when the project merged Error reported in the log Json unmarshal: unknown field "glProjectPath" in gitaly.Repository fatal:

##cat production.log Started GET "/xx/client_sdk/merge_requests/new?utf8=%E2%9C%93&merge_request%5Bsource_project_id%5D=5167&merge_request%5Bsource_branch%5D=dev_vms&merge_request%5Btarget_project_id%5D=1926&merge_request%5Btarget_branch%5D=dev_vms" for 10.168.0.106 at 2019-09-21 10:42:34 -0400 Processing by Projects::MergeRequests::CreationsController#new as HTML Parameters: {"utf8"=>"✓", "merge_request"=>{"source_project_id"=>"5167", "source_branch"=>"dev_vms", "target_project_id"=>"1926", "target_branch"=>"dev_vms"}, "namespace_id"=>"xx", "project_id"=>"client_sdk"}

Gitlab::Git::CommandError (2:Gitlab::Git::CommandError: 2019/09/21 10:42:34 upload-pack: json unmarshal: unknown field "glProjectPath" in gitaly.Repository fatal: Could not read from remote repository.

Please make sure you have the correct access rights and the repository exists. ): lib/gitlab/git/wraps_gitaly_errors.rb:13:in rescue in wrapped_gitaly_errors' lib/gitlab/git/wraps_gitaly_errors.rb:6:inwrapped_gitaly_errors' lib/gitlab/git/repository.rb:740:in fetch_source_branch!' lib/gitlab/git/repository.rb:764:incompare_source_branch' app/models/repository.rb:972:in compare_source_branch' app/services/compare_service.rb:16:inexecute' app/services/merge_requests/build_service.rb:108:in compare_branches' app/services/merge_requests/build_service.rb:30:inexecute' app/controllers/projects/merge_requests/creations_controller.rb:95:in block in build_merge_request' lib/gitlab/gitaly_client.rb:309:inallow_n_plus_1_calls' app/controllers/projects/merge_requests/creations_controller.rb:94:in build_merge_request' lib/gitlab/session.rb:11:inwith_session' app/controllers/application_controller.rb:439:in set_session_storage' lib/gitlab/i18n.rb:55:inwith_locale' lib/gitlab/i18n.rb:61:in with_user_locale' app/controllers/application_controller.rb:435:inset_locale' lib/gitlab/middleware/multipart.rb:103:in call' lib/gitlab/request_profiler/middleware.rb:16:incall' lib/gitlab/middleware/go.rb:20:in call' lib/gitlab/etag_caching/middleware.rb:13:incall' lib/gitlab/middleware/correlation_id.rb:16:in block in call' lib/gitlab/middleware/correlation_id.rb:15:incall' lib/gitlab/middleware/read_only/controller.rb:40:in call' lib/gitlab/middleware/read_only.rb:18:incall' lib/gitlab/middleware/basic_health_check.rb:25:in call' lib/gitlab/request_context.rb:26:incall' lib/gitlab/metrics/requests_rack_middleware.rb:29:in call' lib/gitlab/middleware/release_env.rb:12:incall'

Completed 503 Service Unavailable in 105ms (Views: 6.0ms | ActiveRecord: 5.3ms)

##cat gitaly.log

time="2019-09-21T11:31:05-04:00" level=info msg="GRPC-RUBY: WARN: failed handler: #GRPC::ActiveCall:0x000055f8e1308ce0; sending status:UNKNOWN" supervisor.args="[bundle exec bin/ruby-cd /home/git/gitlab /home/git/gitaly/ruby/bin/gitaly-ruby 14238 /tmp/gitaly-ruby367553994/socket.1]" supervisor.name=gitaly-ruby.1

time="2019-09-21T11:31:05-04:00" level=info msg="GRPC-RUBY: WARN: 2019/09/21 11:30:37 upload-pack: json unmarshal: unknown field "glProjectPath" in gitaly.Repository" supervisor.args="[bundle exec bin/ruby-cd /home/git/gitlab /home/git/gitaly/ruby/bin/gitaly-ruby 14238 /tmp/gitaly-ruby367553994/socket.1]" supervisor.name=gitaly-ruby.1

time="2019-09-21T11:31:05-04:00" level=info msg="fatal: Could not read from remote repository." supervisor.args="[bundle exec bin/ruby-cd /home/git/gitlab /home/git/gitaly/ruby/bin/gitaly-ruby 14238 /tmp/gitaly-ruby367553994/socket.1]" supervisor.name=gitaly-ruby.1

time="2019-09-21T11:31:05-04:00" level=info supervisor.args="[bundle exec bin/ruby-cd /home/git/gitlab /home/git/gitaly/ruby/bin/gitaly-ruby 14238 /tmp/gitaly-ruby367553994/socket.1]" supervisor.name=gitaly-ruby.1 time="2019-09-21T11:31:05-04:00" level=info msg="Please make sure you have the correct access rights" supervisor.args="[bundle exec bin/ruby-cd /home/git/gitlab /home/git/gitaly/ruby/bin/gitaly-ruby 14238 /tmp/gitaly-ruby367553994/socket.1]" supervisor.name=gitaly-ruby.1

time="2019-09-21T11:31:05-04:00" level=info msg="and the repository exists." supervisor.args="[bundle exec bin/ruby-cd /home/git/gitlab /home/git/gitaly/ruby/bin/gitaly-ruby 14238 /tmp/gitaly-ruby367553994/socket.1]" supervisor.name=gitaly-ruby.1

time="2019-09-21T11:31:05-04:00" level=info supervisor.args="[bundle exec bin/ruby-cd /home/git/gitlab /home/git/gitaly/ruby/bin/gitaly-ruby 14238 /tmp/gitaly-ruby367553994/socket.1]" supervisor.name=gitaly-ruby.1

time="2019-09-21T11:31:05-04:00" level=error msg="finished unary call with code Unknown" correlation_id=aTA0MI1af53 error="rpc error: code = Unknown desc = Gitlab::Git::CommandError: 2019/09/21 11:31:05 upload-pack: json unmarshal: unknown field "glProjectPath" in gitaly.Repository\nfatal: Could not read from remote repository.\n\nPlease make sure you have the correct access rights\nand the repository exists.\n" grpc.code=Unknown grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.method=FetchSourceBranch grpc.request.deadline="2019-09-21T11:32:00-04:00" grpc.request.fullMethod=/gitaly.RepositoryService/FetchSourceBranch grpc.request.glProjectPath=pc_software/windows_client_sdk grpc.request.glRepository=project-1926 grpc.request.repoPath=pc_software/windows_client_sdk.git grpc.request.repoStorage=default grpc.request.topLevelGroup=pc_software grpc.service=gitaly.RepositoryService grpc.start_time="2019-09-21T11:31:05-04:00" grpc.time_ms=38.445 peer.address=@ span.kind=server system=grpc

Asking for help, thank you very much!!

Edited Sep 21, 2019 by Tait
Assignee Loading
Time tracking Loading