Transfer project namespace connection timeout

Summary

When transferring a project to a different namespace, error code 500 is returned.

Steps to reproduce

  • Open a project
  • Go to general settings
  • Select a namespace
  • Click on Transfer Project

Relevant logs and/or screenshots

Expand for error stack trace 
Net::OpenTimeout: execution expired
  from net/http.rb:947:in `initialize'
  from net/http.rb:947:in `open'
  from net/http.rb:947:in `block in connect'
  from timeout.rb:103:in `timeout'
  from net/http.rb:945:in `connect'
  from net/http.rb:930:in `do_start'
  from net/http.rb:919:in `start'
  from net/http.rb:1470:in `request'
  from net/http.rb:1228:in `get'
  from faraday/adapter/net_http.rb:78:in `perform_request'
  from faraday/adapter/net_http.rb:38:in `block in call'
  from faraday/adapter/net_http.rb:85:in `with_net_http_connection'
  from faraday/adapter/net_http.rb:33:in `call'
  from faraday_middleware/response_middleware.rb:31:in `call'
  from faraday_middleware/response_middleware.rb:31:in `call'
  from faraday_middleware/response_middleware.rb:31:in `call'
  from faraday_middleware/response_middleware.rb:31:in `call'
  from faraday_middleware/response_middleware.rb:31:in `call'
  from faraday/request/authorization.rb:37:in `call'
  from faraday_middleware/request/encode_json.rb:24:in `call'
  from faraday/rack_builder.rb:141:in `build_response'
  from faraday/connection.rb:386:in `run_request'
  from faraday/connection.rb:149:in `get'
  from container_registry/client.rb:23:in `repository_tags'
  from container_repository.rb:42:in `manifest'
  from container_repository.rb:46:in `tags'
  from container_repository.rb:60:in `has_tags?'
  from project.rb:2323:in `has_root_container_repository_tags?'
  from project.rb:718:in `has_container_registry_tags?'
  from projects/transfer_service.rb:51:in `transfer'
  from projects/transfer_service.rb:27:in `execute'
  from projects_controller.rb:98:in `transfer'
  from action_controller/metal/basic_implicit_render.rb:6:in `send_action'
  from abstract_controller/base.rb:194:in `process_action'
  from action_controller/metal/rendering.rb:30:in `process_action'
  from abstract_controller/callbacks.rb:42:in `block in process_action'
  from active_support/callbacks.rb:109:in `block in run_callbacks'
  from gitlab/session.rb:11:in `with_session'
  from application_controller.rb:450:in `set_session_storage'
  from active_support/callbacks.rb:118:in `block in run_callbacks'
  from gitlab/i18n.rb:55:in `with_locale'
  from gitlab/i18n.rb:61:in `with_user_locale'
  from application_controller.rb:444:in `set_locale'
  from active_support/callbacks.rb:118:in `block in run_callbacks'
  from raven/integrations/rails/controller_transaction.rb:7:in `block in included'
  from active_support/callbacks.rb:118:in `instance_exec'
  from active_support/callbacks.rb:118:in `block in run_callbacks'
  from active_support/callbacks.rb:136:in `run_callbacks'
  from abstract_controller/callbacks.rb:41:in `process_action'
  from action_controller/metal/rescue.rb:22:in `process_action'
  from action_controller/metal/instrumentation.rb:34:in `block in process_action'
  from active_support/notifications.rb:168:in `block in instrument'
  from active_support/notifications/instrumenter.rb:23:in `instrument'
  from active_support/notifications.rb:168:in `instrument'
  from action_controller/metal/instrumentation.rb:32:in `process_action'
  from action_controller/metal/params_wrapper.rb:256:in `process_action'
  from active_record/railties/controller_runtime.rb:24:in `process_action'
  from abstract_controller/base.rb:134:in `process'
  from action_view/rendering.rb:32:in `process'
  from action_controller/metal.rb:191:in `dispatch'
  from action_controller/metal.rb:252:in `dispatch'
  from action_dispatch/routing/route_set.rb:52:in `dispatch'
  from action_dispatch/routing/route_set.rb:34:in `serve'
  from action_dispatch/routing/mapper.rb:18:in `block in '
  from action_dispatch/routing/mapper.rb:48:in `serve'
  from action_dispatch/journey/router.rb:52:in `block in serve'
  from action_dispatch/journey/router.rb:35:in `each'
  from action_dispatch/journey/router.rb:35:in `serve'
  from action_dispatch/routing/route_set.rb:840:in `call'
  from omniauth/strategy.rb:192:in `call!'
  from omniauth/strategy.rb:169:in `call'
  from gitlab/request_profiler/middleware.rb:17:in `call'
  from gitlab/middleware/go.rb:20:in `call'
  from gitlab/etag_caching/middleware.rb:13:in `call'
  from gitlab/middleware/correlation_id.rb:16:in `block in call'
  from labkit/correlation/correlation_id.rb:18:in `use_id'
  from gitlab/middleware/correlation_id.rb:15:in `call'
  from batch_loader/middleware.rb:11:in `call'
  from apollo_upload_server/middleware.rb:20:in `call'
  from gitlab/middleware/multipart.rb:117:in `call'
  from rack/attack.rb:107:in `call'
  from warden/manager.rb:36:in `block in call'
  from warden/manager.rb:35:in `catch'
  from warden/manager.rb:35:in `call'
  from rack/cors.rb:97:in `call'
  from rack/tempfile_reaper.rb:15:in `call'
  from rack/etag.rb:25:in `call'
  from rack/conditional_get.rb:38:in `call'
  from rack/head.rb:12:in `call'
  from action_dispatch/http/content_security_policy.rb:18:in `call'
  from gitlab/middleware/read_only/controller.rb:42:in `call'
  from gitlab/middleware/read_only.rb:18:in `call'
  from rack/session/abstract/id.rb:232:in `context'
  from rack/session/abstract/id.rb:226:in `call'
  from action_dispatch/middleware/cookies.rb:670:in `call'
  from action_dispatch/middleware/callbacks.rb:28:in `block in call'
  from active_support/callbacks.rb:98:in `run_callbacks'
  from action_dispatch/middleware/callbacks.rb:26:in `call'
  from action_dispatch/middleware/debug_exceptions.rb:61:in `call'
  from action_dispatch/middleware/show_exceptions.rb:33:in `call'
  from gitlab/middleware/basic_health_check.rb:25:in `call'
  from rails/rack/logger.rb:38:in `call_app'
  from rails/rack/logger.rb:26:in `block in call'
  from active_support/tagged_logging.rb:71:in `block in tagged'
  from active_support/tagged_logging.rb:28:in `tagged'
  from active_support/tagged_logging.rb:71:in `tagged'
  from rails/rack/logger.rb:26:in `call'
  from action_dispatch/middleware/remote_ip.rb:81:in `call'
  from gitlab/request_context.rb:26:in `call'
  from request_store/middleware.rb:9:in `call'
  from action_dispatch/middleware/request_id.rb:27:in `call'
  from rack/method_override.rb:22:in `call'
  from rack/runtime.rb:22:in `call'
  from action_dispatch/middleware/executor.rb:14:in `call'
  from rack/sendfile.rb:111:in `call'
  from gitlab/metrics/requests_rack_middleware.rb:29:in `call'
  from raven/integrations/rack.rb:51:in `call'
  from rails/engine.rb:524:in `call'
  from rails/railtie.rb:190:in `public_send'
  from rails/railtie.rb:190:in `method_missing'
  from gitlab/middleware/release_env.rb:12:in `call'
  from rack/urlmap.rb:68:in `block in call'
  from rack/urlmap.rb:53:in `each'
  from rack/urlmap.rb:53:in `call'
  from unicorn/http_server.rb:606:in `process_client'
  from unicorn/worker_killer.rb:52:in `process_client'
  from unicorn/http_server.rb:701:in `worker_loop'
  from unicorn/http_server.rb:549:in `spawn_missing_workers'
  from unicorn/http_server.rb:142:in `start'
  from /opt/gitlab/embedded/lib/ruby/gems/2.6.0/gems/unicorn-5.4.1/bin/unicorn:126:in `'
  from /opt/gitlab/embedded/bin/unicorn:23:in `load'
  from /opt/gitlab/embedded/bin/unicorn:23:in `'
  from bundler/cli/exec.rb:74:in `load'
  from bundler/cli/exec.rb:74:in `kernel_load'
  from bundler/cli/exec.rb:28:in `run'
  from bundler/cli.rb:463:in `exec'
  from bundler/vendor/thor/lib/thor/command.rb:27:in `run'
  from bundler/vendor/thor/lib/thor/invocation.rb:126:in `invoke_command'
  from bundler/vendor/thor/lib/thor.rb:387:in `dispatch'
  from bundler/cli.rb:27:in `dispatch'
  from bundler/vendor/thor/lib/thor/base.rb:466:in `start'
  from bundler/cli.rb:18:in `start'
  from /opt/gitlab/embedded/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/exe/bundle:30:in `block in '
  from bundler/friendly_errors.rb:124:in `with_friendly_errors'
  from /opt/gitlab/embedded/lib/ruby/gems/2.6.0/gems/bundler-1.17.3/exe/bundle:22:in `'
  from /opt/gitlab/embedded/bin/bundle:23:in `load'
  from /opt/gitlab/embedded/bin/bundle:23:in `'

Output of checks

(If you are reporting a bug on GitLab.com, write: This bug happens on GitLab.com)

Results of GitLab environment info

Expand for output related to GitLab environment info 
System information
System:		Debian 8.11
Current User:	git
Using RVM:	no
Ruby Version:	2.6.3p62
Gem Version:	2.7.9
Bundler Version:1.17.3
Rake Version:	12.3.2
Redis Version:	3.2.12
Git Version:	2.22.0
Sidekiq Version:5.2.7
Go Version:	unknown

GitLab information
Version:	12.3.0
Revision:	7099ecf77cb
Directory:	/opt/gitlab/embedded/service/gitlab-rails
DB Adapter:	PostgreSQL
DB Version:	10.9
URL:		https://gitlab.acid.fr
HTTP Clone URL:	https://gitlab.acid.fr/some-group/some-project.git
SSH Clone URL:	git@gitlab.acid.fr:some-group/some-project.git
Using LDAP:	no
Using Omniauth:	yes
Omniauth Providers: bitbucket


GitLab Shell
Version:	10.0.0
Repository storage paths:
  • default: /var/opt/gitlab/git-data/repositories GitLab Shell path: /opt/gitlab/embedded/service/gitlab-shell Git: /opt/gitlab/embedded/bin/git

Results of GitLab application Check

Expand for output related to the GitLab application check 
Checking GitLab subtasks ...


Checking GitLab Shell ...


GitLab Shell: ... GitLab Shell version >= 10.0.0 ? ... OK (10.0.0)
Running /opt/gitlab/embedded/service/gitlab-shell/bin/check
Check GitLab API access: OK
Redis available via internal API: OK


gitlab-shell self-check successful


Checking GitLab Shell ... Finished


Checking Gitaly ...


Gitaly: ... default ... OK


Checking Gitaly ... Finished


Checking Sidekiq ...


Sidekiq: ... Running? ... yes
Number of Sidekiq processes ... 1


Checking Sidekiq ... Finished


Checking Incoming Email ...


Incoming Email: ... Reply by email is disabled in config/gitlab.yml


Checking Incoming Email ... Finished


Checking LDAP ...


LDAP: ... LDAP is disabled in config/gitlab.yml


Checking LDAP ... Finished


Checking GitLab App ...


Git configured correctly? ... yes
Database config exists? ... yes
All migrations up? ... yes
Database contains orphaned GroupMembers? ... no
GitLab config exists? ... yes
GitLab config up to date? ... yes
Log directory writable? ... yes
Tmp directory writable? ... yes
Uploads directory exists? ... yes
Uploads directory has correct permissions? ... yes
Uploads directory tmp has correct permissions? ... yes
Init script exists? ... skipped (omnibus-gitlab has no init script)
Init script up-to-date? ... skipped (omnibus-gitlab has no init script)
Projects have namespace: ...
2/1 ... yes
4/3 ... yes
5/5 ... yes
4/6 ... yes
4/7 ... yes
4/8 ... yes
3/9 ... yes
4/10 ... yes
5/11 ... yes
3/12 ... yes
5/13 ... yes
3/14 ... yes
3/15 ... yes
5/16 ... yes
9/17 ... yes
9/18 ... yes
4/19 ... yes
5/20 ... yes
3/21 ... yes
3/22 ... yes
9/27 ... yes
3/28 ... yes
3/29 ... yes
3/30 ... yes
3/31 ... yes
3/32 ... yes
9/34 ... yes
4/42 ... yes
91/43 ... yes
3/46 ... yes
4/47 ... yes
91/48 ... yes
4/49 ... yes
5/50 ... yes
3/51 ... yes
2/52 ... yes
2/53 ... yes
2/54 ... yes
3/55 ... yes
4/56 ... yes
4/57 ... yes
5/59 ... yes
5/60 ... yes
9/61 ... yes
24/62 ... yes
24/63 ... yes
16/64 ... yes
24/66 ... yes
16/68 ... yes
16/70 ... yes
24/71 ... yes
25/72 ... yes
9/73 ... yes
4/75 ... yes
16/77 ... yes
5/78 ... yes
4/79 ... yes
16/80 ... yes
3/82 ... yes
16/83 ... yes
31/84 ... yes
16/88 ... yes
3/89 ... yes
16/90 ... yes
16/93 ... yes
16/95 ... yes
16/96 ... yes
24/97 ... yes
3/98 ... yes
9/99 ... yes
9/102 ... yes
3/103 ... yes
3/104 ... yes
3/105 ... yes
9/107 ... yes
16/108 ... yes
9/109 ... yes
39/110 ... yes
3/111 ... yes
9/112 ... yes
16/114 ... yes
9/115 ... yes
9/116 ... yes
9/118 ... yes
3/119 ... yes
3/120 ... yes
3/121 ... yes
3/122 ... yes
3/123 ... yes
3/124 ... yes
3/125 ... yes
3/126 ... yes
3/127 ... yes
3/128 ... yes
3/129 ... yes
3/130 ... yes
3/131 ... yes
3/132 ... yes
3/133 ... yes
3/134 ... yes
3/136 ... yes
3/137 ... yes
3/139 ... yes
3/140 ... yes
3/141 ... yes
3/142 ... yes
3/143 ... yes
3/144 ... yes
3/145 ... yes
3/147 ... yes
3/148 ... yes
3/149 ... yes
2/150 ... yes
3/151 ... yes
9/152 ... yes
3/153 ... yes
3/155 ... yes
2/156 ... yes
3/157 ... yes
3/158 ... yes
3/159 ... yes
3/160 ... yes
3/161 ... yes
3/162 ... yes
2/164 ... yes
3/165 ... yes
3/166 ... yes
3/167 ... yes
16/169 ... yes
3/170 ... yes
16/171 ... yes
3/172 ... yes
16/173 ... yes
16/174 ... yes
16/175 ... yes
16/176 ... yes
16/177 ... yes
16/178 ... yes
16/179 ... yes
3/180 ... yes
3/181 ... yes
3/182 ... yes
3/183 ... yes
99/184 ... yes
16/185 ... yes
3/186 ... yes
3/188 ... yes
3/189 ... yes
16/190 ... yes
9/191 ... yes
16/192 ... yes
24/193 ... yes
3/194 ... yes
24/195 ... yes
3/196 ... yes
3/198 ... yes
3/199 ... yes
3/200 ... yes
3/201 ... yes
3/202 ... yes
3/203 ... yes
3/204 ... yes
3/205 ... yes
3/208 ... yes
3/209 ... yes
3/210 ... yes
3/211 ... yes
3/212 ... yes
3/213 ... yes
3/214 ... yes
3/215 ... yes
3/216 ... yes
3/217 ... yes
3/218 ... yes
3/219 ... yes
3/220 ... yes
3/221 ... yes
3/222 ... yes
3/223 ... yes
3/224 ... yes
24/226 ... yes
3/227 ... yes
3/228 ... yes
3/239 ... yes
3/240 ... yes
91/242 ... yes
24/243 ... yes
91/244 ... yes
24/245 ... yes
91/246 ... yes
9/247 ... yes
99/248 ... yes
3/249 ... yes
9/250 ... yes
24/251 ... yes
3/252 ... yes
16/254 ... yes
16/255 ... yes
3/256 ... yes
3/257 ... yes
16/258 ... yes
3/259 ... yes
9/260 ... yes
3/261 ... yes
16/262 ... yes
16/263 ... yes
91/264 ... yes
3/265 ... yes
59/267 ... yes
16/268 ... yes
59/270 ... yes
3/272 ... yes
16/273 ... yes
3/275 ... yes
3/276 ... yes
16/277 ... yes
3/282 ... yes
59/283 ... yes
3/284 ... yes
99/285 ... yes
99/286 ... yes
91/287 ... yes
99/288 ... yes
3/289 ... yes
16/290 ... yes
9/291 ... yes
16/293 ... yes
59/294 ... yes
91/295 ... yes
3/297 ... yes
16/298 ... yes
16/299 ... yes
16/300 ... yes
16/301 ... yes
9/303 ... yes
3/305 ... yes
3/306 ... yes
24/307 ... yes
24/308 ... yes
24/309 ... yes
16/314 ... yes
16/315 ... yes
3/318 ... yes
16/319 ... yes
3/322 ... yes
65/323 ... yes
3/325 ... yes
16/326 ... yes
3/327 ... yes
16/328 ... yes
16/329 ... yes
9/330 ... yes
66/331 ... yes
16/332 ... yes
24/334 ... yes
3/336 ... yes
68/337 ... yes
16/339 ... yes
68/340 ... yes
68/341 ... yes
33/345 ... yes
68/346 ... yes
16/347 ... yes
68/349 ... yes
70/352 ... yes
16/353 ... yes
59/355 ... yes
99/356 ... yes
16/358 ... yes
16/359 ... yes
68/360 ... yes
68/361 ... yes
24/363 ... yes
99/364 ... yes
72/365 ... yes
16/366 ... yes
24/367 ... yes
68/368 ... yes
3/370 ... yes
9/371 ... yes
72/373 ... yes
16/374 ... yes
16/375 ... yes
16/377 ... yes
68/379 ... yes
68/380 ... yes
16/381 ... yes
16/382 ... yes
16/384 ... yes
3/385 ... yes
74/388 ... yes
16/390 ... yes
68/391 ... yes
74/392 ... yes
68/394 ... yes
68/395 ... yes
9/396 ... yes
74/398 ... yes
9/399 ... yes
9/400 ... yes
68/401 ... yes
74/402 ... yes
16/403 ... yes
16/405 ... yes
16/406 ... yes
74/407 ... yes
74/408 ... yes
3/409 ... yes
3/411 ... yes
74/413 ... yes
96/416 ... yes
96/417 ... yes
16/418 ... yes
96/419 ... yes
16/420 ... yes
16/421 ... yes
9/422 ... yes
3/423 ... yes
78/429 ... yes
16/430 ... yes
33/433 ... yes
78/436 ... yes
84/437 ... yes
78/439 ... yes
16/441 ... yes
16/442 ... yes
16/443 ... yes
3/444 ... yes
16/445 ... yes
91/446 ... yes
3/447 ... yes
16/448 ... yes
59/449 ... yes
16/450 ... yes
16/451 ... yes
16/452 ... yes
91/454 ... yes
16/455 ... yes
16/457 ... yes
94/460 ... yes
94/461 ... yes
96/462 ... yes
16/463 ... yes
92/464 ... yes
95/465 ... yes
16/466 ... yes
96/467 ... yes
91/468 ... yes
16/469 ... yes
91/470 ... yes
92/471 ... yes
99/472 ... yes
16/474 ... yes
92/475 ... yes
91/476 ... yes
16/477 ... yes
99/478 ... yes
24/479 ... yes
3/480 ... yes
16/481 ... yes
92/482 ... yes
Redis version >= 2.8.0? ... yes
Ruby version >= 2.5.3 ? ... yes (2.6.3)
Git version >= 2.22.0 ? ... yes (2.22.0)
Git user has default SSH configuration? ... yes
Active users: ... 45
Is authorized keys file accessible? ... yes


Checking GitLab App ... Finished


Checking GitLab subtasks ... Finished

Possible fixes

From what I can see in the error stack trace, the error seems to be linked with a call to the v2 API.

https://gitlab.com/gitlab-org/gitlab/blob/master/lib%2Fcontainer_registry%2Fclient.rb#L26

Edited by Daniel Lucas