External MinIO: SocketError
Summary
When changing uploads from local storage to MinIO, uploads cannot be saved in issues anymore. Also, the migration stays queued:
root@gitlab-bundle-6b7d9c646-qkr4h:/# gitlab-rake gitlab:uploads:migrate:all
I, [2020-07-23T16:42:54.949103 #1922] INFO -- : {:message=>"[Uploads migration] Enqueued upload migration job", :index=>1, :job_id=>"904d1aed42f08a0f6f0b1743"}
I, [2020-07-23T16:42:54.973517 #1922] INFO -- : {:message=>"[Uploads migration] Enqueued upload migration job", :index=>1, :job_id=>"d9dfd2df8058935eda350ef3"}
I, [2020-07-23T16:42:54.979915 #1922] INFO -- : {:message=>"[Uploads migration] Enqueued upload migration job", :index=>1, :job_id=>"34a8a21f53e348bd80b92cd0"}
I, [2020-07-23T16:42:55.020962 #1922] INFO -- : {:message=>"[Uploads migration] Enqueued upload migration job", :index=>1, :job_id=>"76611aeb736f31e7bd044e8e"}
I, [2020-07-23T16:42:55.035020 #1922] INFO -- : {:message=>"[Uploads migration] Enqueued upload migration job", :index=>2, :job_id=>"787d2b97619b6c040c201c84"}
I, [2020-07-23T16:42:55.043827 #1922] INFO -- : {:message=>"[Uploads migration] Enqueued upload migration job", :index=>3, :job_id=>"b1807af39349536c59bdc292"}
I, [2020-07-23T16:42:55.059899 #1922] INFO -- : {:message=>"[Uploads migration] Enqueued upload migration job", :index=>4, :job_id=>"2f7820f6ffe3987644a7c549"}
I, [2020-07-23T16:42:55.070268 #1922] INFO -- : {:message=>"[Uploads migration] Enqueued upload migration job", :index=>5, :job_id=>"38efb8544271f9372e07c9a1"}
I, [2020-07-23T16:42:55.083895 #1922] INFO -- : {:message=>"[Uploads migration] Enqueued upload migration job", :index=>6, :job_id=>"789da927911842f74b5ac255"}
I, [2020-07-23T16:42:55.092879 #1922] INFO -- : {:message=>"[Uploads migration] Enqueued upload migration job", :index=>7, :job_id=>"979c8b5191ae36fe1e54eb1a"}
I, [2020-07-23T16:42:55.097916 #1922] INFO -- : {:message=>"[Uploads migration] Enqueued upload migration job", :index=>8, :job_id=>"cd6ba60fcc717286dc39590a"}Migrating uploads from local storage (GitLab in Docker) to self hosted Object Storage fails with:
Excon::Error::Socket (getaddrinfo: Name or service not known (SocketError)):
lib/object_storage/direct_upload.rb:188:in `block in upload_id'
lib/gitlab/utils/strong_memoize.rb:30:in `strong_memoize'
lib/object_storage/direct_upload.rb:187:in `upload_id'
lib/object_storage/direct_upload.rb:127:in `multipart_part_upload_url'
lib/object_storage/direct_upload.rb:117:in `block in multipart_part_urls'
lib/object_storage/direct_upload.rb:116:in `initialize'
lib/object_storage/direct_upload.rb:116:in `new'
lib/object_storage/direct_upload.rb:116:in `multipart_part_urls'
lib/object_storage/direct_upload.rb:58:in `multipart_upload_hash'
lib/object_storage/direct_upload.rb:47:in `to_hash'
app/uploaders/object_storage.rb:205:in `workhorse_remote_upload_options'
app/uploaders/object_storage.rb:186:in `workhorse_authorize'
app/controllers/concerns/uploads_actions.rb:58:in `authorize'
ee/lib/gitlab/ip_address_state.rb:10:in `with'
ee/app/controllers/ee/application_controller.rb:44:in `set_current_ip_address'
app/controllers/application_controller.rb:491:in `set_current_admin'
lib/gitlab/session.rb:11:in `with_session'
app/controllers/application_controller.rb:482:in `set_session_storage'
lib/gitlab/i18n.rb:55:in `with_locale'
lib/gitlab/i18n.rb:61:in `with_user_locale'
app/controllers/application_controller.rb:476:in `set_locale'
lib/gitlab/error_tracking.rb:50:in `with_context'
app/controllers/application_controller.rb:541:in `sentry_context'
app/controllers/application_controller.rb:469:in `block in set_current_context'
lib/gitlab/application_context.rb:52:in `block in use'
lib/gitlab/application_context.rb:52:in `use'
lib/gitlab/application_context.rb:20:in `with_context'
app/controllers/application_controller.rb:462:in `set_current_context'
lib/gitlab/request_profiler/middleware.rb:17:in `call'
ee/lib/gitlab/jira/middleware.rb:19:in `call'
lib/gitlab/middleware/go.rb:20:in `call'
lib/gitlab/etag_caching/middleware.rb:13:in `call'
lib/gitlab/middleware/multipart.rb:140:in `call'
lib/gitlab/middleware/read_only/controller.rb:51:in `call'
lib/gitlab/middleware/read_only.rb:18:in `call'
lib/gitlab/middleware/same_site_cookies.rb:27:in `call'
lib/gitlab/middleware/basic_health_check.rb:25:in `call'
lib/gitlab/middleware/handle_ip_spoof_attack_error.rb:25:in `call'
lib/gitlab/middleware/request_context.rb:23:in `call'
config/initializers/fix_local_cache_middleware.rb:9:in `call'
lib/gitlab/metrics/requests_rack_middleware.rb:60:in `call'
lib/gitlab/middleware/release_env.rb:12:in `call'Steps to reproduce
- Create a minio-instance (in my case a fork of https://github.com/helm/charts/tree/master/stable/minio) and be sure it is reachable by LoadBalancerIP or internal DNS.
- Run the Docker Image
12.10.7-ee.0, upgrade to13.0.10-ee.0 - Upgrade to
13.2.0-ee.0with the config changed like this:
# Consolidated object storage configuration
gitlab_rails['object_store']['enabled'] = true
gitlab_rails['object_store_direct_upload'] = true
gitlab_rails['object_store']['proxy_download'] = true
gitlab_rails['object_store']['connection'] = {
'provider' => 'AWS',
'aws_access_key_id' => 'gitlab-staging',
'aws_secret_access_key' => 'minio-minio',
'endpoint' => 'http://10.139.0.210:9000'
}
gitlab_rails['object_store']['objects']['artifacts']['bucket'] = 'artifacts'
gitlab_rails['object_store']['objects']['external_diffs']['bucket'] = 'external-diffs'
gitlab_rails['object_store']['objects']['lfs']['bucket'] = 'lfs-objects'
gitlab_rails['object_store']['objects']['uploads']['bucket'] = 'uploads'
gitlab_rails['object_store']['objects']['packages']['bucket'] = 'packages'
gitlab_rails['object_store']['objects']['dependency_proxy']['bucket'] = 'dependency-proxy'
gitlab_rails['object_store']['objects']['terraform_state']['bucket'] = 'terraform-state'What is the current bug behavior?
When trying to upload a picture in an issue, it is ignored. Also, the migration stays queued.
What is the expected correct behavior?
Uploads are migrated to the minio-ObjectStorage
Results of GitLab environment info
# gitlab-rake gitlab:env:info
System information
System:
Proxy: no
Current User: git
Using RVM: no
Ruby Version: 2.6.6p146
Gem Version: 2.7.10
Bundler Version:1.17.3
Rake Version: 12.3.3
Redis Version: 5.0.9
Git Version: 2.27.0
Sidekiq Version:5.2.9
Go Version: unknown
GitLab information
Version: 13.2.0-ee
Revision: ce28f708ec5
Directory: /opt/gitlab/embedded/service/gitlab-rails
DB Adapter: PostgreSQL
DB Version: 11.7
URL: https://git-old.rdx-dev.com
HTTP Clone URL: https://git-old.rdx-dev.com/some-group/some-project.git
SSH Clone URL: ssh://git@git-old.rdx-dev.com:32222/some-group/some-project.git
Elasticsearch: no
Geo: no
Using LDAP: no
Using Omniauth: yes
Omniauth Providers:
GitLab Shell
Version: 13.3.0
Repository storage paths:
- default: /var/opt/gitlab/git-data/repositories
GitLab Shell path: /opt/gitlab/embedded/service/gitlab-shell
Git: /opt/gitlab/embedded/bin/gitOther logs
==> /var/log/gitlab/sidekiq/current <==
{"severity":"WARN","time":"2020-07-23T15:00:22.092Z","class":"ObjectStorage::MigrateUploadsWorker","retry":3,"queue":"object_storage:object_storage_migrate_uploads","queue_namespace":"object_storage","jid":"e9af389220cb61d55f25e18e","created_at":"2020-07-23T14:58:38.361Z","correlation_id":"4781f86659e977baa66f3bc3693228e6","enqueued_at":"2020-07-23T15:00:19.716Z","failed_at":"2020-07-23T14:58:51.154Z","retry_count":1,"retried_at":"2020-07-23T14:59:15.508Z","pid":553,"message":"ObjectStorage::MigrateUploadsWorker JID-e9af389220cb61d55f25e18e: fail: 2.372253 sec","job_status":"fail","scheduling_latency_s":0.003749,"duration_s":2.372253,"cpu_s":0.975837,"completed_at":"2020-07-23T15:00:22.092Z","error_message":"Sidekiq::JobRetry::Skip","error_class":"Sidekiq::JobRetry::Skip","db_duration_s":0.009198}
{"severity":"WARN","time":"2020-07-23T15:00:22.094Z","error_class":"ObjectStorage::MigrateUploadsWorker::Report::MigrationFailures","error_message":"getaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)","context":"Job raised exception","class":"ObjectStorage::MigrateUploadsWorker","args":["[562, 563, 564, 565, 566, 567, 568, 570, 571, 572, 573, 579, 539, 540, 541, 542, 543, 544, 545, 546, 547, 548, 549, 550, 551, 552, 553, 554, 555, 556, 557, 558, 559, 560, 561, 575, 576, 577, 578, 580, 583, 584, 585, 586, 587, 588, 589, 590, 591, 592, 593, 594, 595, 596, 620, 625, 626, 647, 205, 36, 242, 243, 244, 245, 246, 247, 248, 249, 250, 263, 264, 891, 324, 325, 326, 327, 328, 329, 330, 331, 332, 333, 334, 335, 336, 1262, 342, 343, 344, 351, 354, 362, 885, 441, 443, 444, 476, 521, 523, 527, 535, 536, 537, 925, 1293, 1041, 1081, 1082, 1083, 1084, 1101, 1102, 1103, 1294, 1282, 1304, 1305, 1331, 1332, 1333, 1334, 1335, 1336, 1337, 1350, 1505, 1521, 1522, 1538, 1543, 1566, 1571]","Project","avatar","2"],"retry":3,"queue":"object_storage:object_storage_migrate_uploads","queue_namespace":"object_storage","jid":"e9af389220cb61d55f25e18e","created_at":"2020-07-23T14:58:38.361Z","correlation_id":"4781f86659e977baa66f3bc3693228e6","enqueued_at":"2020-07-23T15:00:19.716Z","failed_at":"2020-07-23T14:58:51.154Z","retry_count":1,"retried_at":"2020-07-23T14:59:15.508Z","error_backtrace":["app/workers/object_storage/migrate_uploads_worker.rb:51:in `report!'","app/workers/object_storage/migrate_uploads_worker.rb:104:in `perform'","lib/gitlab/with_request_store.rb:17:in `enabling_request_store'","lib/gitlab/with_request_store.rb:10:in `with_request_store'","lib/gitlab/sidekiq_daemon/monitor.rb:49:in `within_job'"]}==> /var/log/gitlab/sidekiq/current <==
{"severity":"INFO","time":"2020-07-23T15:00:23.000Z","class":"ObjectStorage::MigrateUploadsWorker","retry":3,"queue":"object_storage:object_storage_migrate_uploads","queue_namespace":"object_storage","jid":"7224d9a9d22d2eb37adc10cf","created_at":"2020-07-23T14:58:38.543Z","correlation_id":"4e0dc3a537aee180fafaa3da4d7a003f","enqueued_at":"2020-07-23T15:00:22.997Z","failed_at":"2020-07-23T14:58:43.139Z","retry_count":1,"retried_at":"2020-07-23T14:59:22.435Z","pid":553,"message":"ObjectStorage::MigrateUploadsWorker JID-7224d9a9d22d2eb37adc10cf: start","job_status":"start","scheduling_latency_s":0.003335}
{"severity":"WARN","time":"2020-07-23T15:00:23.102Z","class":"ObjectStorage::MigrateUploadsWorker","retry":3,"queue":"object_storage:object_storage_migrate_uploads","queue_namespace":"object_storage","jid":"7224d9a9d22d2eb37adc10cf","created_at":"2020-07-23T14:58:38.543Z","correlation_id":"4e0dc3a537aee180fafaa3da4d7a003f","enqueued_at":"2020-07-23T15:00:22.997Z","failed_at":"2020-07-23T14:58:43.139Z","retry_count":1,"retried_at":"2020-07-23T14:59:22.435Z","pid":553,"message":"ObjectStorage::MigrateUploadsWorker JID-7224d9a9d22d2eb37adc10cf: fail: 0.101459 sec","job_status":"fail","scheduling_latency_s":0.003335,"duration_s":0.101459,"cpu_s":0.04889,"completed_at":"2020-07-23T15:00:23.102Z","error_message":"Sidekiq::JobRetry::Skip","error_class":"Sidekiq::JobRetry::Skip","db_duration_s":0.006319}
{"severity":"WARN","time":"2020-07-23T15:00:23.103Z","error_class":"ObjectStorage::MigrateUploadsWorker::Report::MigrationFailures","error_message":"getaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)\ngetaddrinfo: Name or service not known (SocketError)","context":"Job raised exception","class":"ObjectStorage::MigrateUploadsWorker","args":["[1579, 1580, 1581, 1582, 1583]","Project","","2"],"retry":3,"queue":"object_storage:object_storage_migrate_uploads","queue_namespace":"object_storage","jid":"7224d9a9d22d2eb37adc10cf","created_at":"2020-07-23T14:58:38.543Z","correlation_id":"4e0dc3a537aee180fafaa3da4d7a003f","enqueued_at":"2020-07-23T15:00:22.997Z","failed_at":"2020-07-23T14:58:43.139Z","retry_count":1,"retried_at":"2020-07-23T14:59:22.435Z","error_backtrace":["app/workers/object_storage/migrate_uploads_worker.rb:51:in `report!'","app/workers/object_storage/migrate_uploads_worker.rb:104:in `perform'","lib/gitlab/with_request_store.rb:17:in `enabling_request_store'","lib/gitlab/with_request_store.rb:10:in `with_request_store'","lib/gitlab/sidekiq_daemon/monitor.rb:49:in `within_job'"]}Results of GitLab application Check
# gitlab-rake gitlab:check SANITIZE=true
Checking GitLab subtasks ...
Checking GitLab Shell ...
GitLab Shell: ... GitLab Shell version >= 13.3.0 ? ... OK (13.3.0)
Running /opt/gitlab/embedded/service/gitlab-shell/bin/check
Internal API available: OK
Redis available via internal API: OK
gitlab-shell self-check successful
Checking GitLab Shell ... Finished
Checking Gitaly ...
Gitaly: ... default ... OK
Checking Gitaly ... Finished
Checking Sidekiq ...
Sidekiq: ... Running? ... yes
Number of Sidekiq processes ... 1
Checking Sidekiq ... Finished
Checking Incoming Email ...
Incoming Email: ... Reply by email is disabled in config/gitlab.yml
Checking Incoming Email ... Finished
Checking LDAP ...
LDAP: ... LDAP is disabled in config/gitlab.yml
Checking LDAP ... Finished
Checking GitLab App ...
Git configured correctly? ... yes
Database config exists? ... yes
All migrations up? ... yes
Database contains orphaned GroupMembers? ... no
GitLab config exists? ... yes
GitLab config up to date? ... yes
Log directory writable? ... yes
Tmp directory writable? ... yes
Uploads directory exists? ... yes
Uploads directory has correct permissions? ... yes
Uploads directory tmp has correct permissions? ... yes
Init script exists? ... skipped (omnibus-gitlab has no init script)
Init script up-to-date? ... skipped (omnibus-gitlab has no init script)
Projects have namespace: ...
4/2 ... yes
51/3 ... yes
5/7 ... yes
50/9 ... yes
4/10 ... yes
2/11 ... yes
4/12 ... yes
4/13 ... yes
4/14 ... yes
8/15 ... yes
8/16 ... yes
8/17 ... yes
8/18 ... yes
51/19 ... yes
51/20 ... yes
51/21 ... yes
51/22 ... yes
4/23 ... yes
8/24 ... yes
8/25 ... yes
8/26 ... yes
51/27 ... yes
8/28 ... yes
8/29 ... yes
8/30 ... yes
12/31 ... yes
10/32 ... yes
10/33 ... yes
10/34 ... yes
10/35 ... yes
8/36 ... yes
51/37 ... yes
4/38 ... yes
11/39 ... yes
11/40 ... yes
11/41 ... yes
11/42 ... yes
11/43 ... yes
12/46 ... yes
12/48 ... yes
5/49 ... yes
13/50 ... yes
51/51 ... yes
14/52 ... yes
14/54 ... yes
14/55 ... yes
14/56 ... yes
14/57 ... yes
14/58 ... yes
4/59 ... yes
15/61 ... yes
12/62 ... yes
4/63 ... yes
5/64 ... yes
5/65 ... yes
12/66 ... yes
5/67 ... yes
17/68 ... yes
5/69 ... yes
8/70 ... yes
5/71 ... yes
5/72 ... yes
33/73 ... yes
5/74 ... yes
37/75 ... yes
8/76 ... yes
8/77 ... yes
37/78 ... yes
37/79 ... yes
19/80 ... yes
19/81 ... yes
19/82 ... yes
19/83 ... yes
19/84 ... yes
19/85 ... yes
19/86 ... yes
19/87 ... yes
20/88 ... yes
33/89 ... yes
37/92 ... yes
23/94 ... yes
32/97 ... yes
23/98 ... yes
25/99 ... yes
4/101 ... yes
25/105 ... yes
25/106 ... yes
25/107 ... yes
2/111 ... yes
2/113 ... yes
2/114 ... yes
32/115 ... yes
2/116 ... yes
25/118 ... yes
25/119 ... yes
23/122 ... yes
17/124 ... yes
15/126 ... yes
33/132 ... yes
33/134 ... yes
4/135 ... yes
35/137 ... yes
32/138 ... yes
33/139 ... yes
33/140 ... yes
33/141 ... yes
33/143 ... yes
35/144 ... yes
22/145 ... yes
35/146 ... yes
35/147 ... yes
35/148 ... yes
4/149 ... yes
5/150 ... yes
5/151 ... yes
22/153 ... yes
2/154 ... yes
14/155 ... yes
35/156 ... yes
22/158 ... yes
33/159 ... yes
5/162 ... yes
22/163 ... yes
36/164 ... yes
36/165 ... yes
36/166 ... yes
36/170 ... yes
36/171 ... yes
36/172 ... yes
36/173 ... yes
36/174 ... yes
36/175 ... yes
36/176 ... yes
36/177 ... yes
36/178 ... yes
36/179 ... yes
36/180 ... yes
36/181 ... yes
36/182 ... yes
36/183 ... yes
36/184 ... yes
36/185 ... yes
36/186 ... yes
4/187 ... yes
33/191 ... yes
32/193 ... yes
5/194 ... yes
22/198 ... yes
33/199 ... yes
14/200 ... yes
4/204 ... yes
33/205 ... yes
5/206 ... yes
33/207 ... yes
9/208 ... yes
4/209 ... yes
14/210 ... yes
4/211 ... yes
33/214 ... yes
36/215 ... yes
35/216 ... yes
35/218 ... yes
36/219 ... yes
40/222 ... yes
32/224 ... yes
33/231 ... yes
33/233 ... yes
42/234 ... yes
33/235 ... yes
32/237 ... yes
36/238 ... yes
36/239 ... yes
17/240 ... yes
36/241 ... yes
32/242 ... yes
40/243 ... yes
40/244 ... yes
51/246 ... yes
31/247 ... yes
14/249 ... yes
22/255 ... yes
33/257 ... yes
37/258 ... yes
33/259 ... yes
66/260 ... yes
36/261 ... yes
40/262 ... yes
33/265 ... yes
36/268 ... yes
43/269 ... yes
43/270 ... yes
43/271 ... yes
35/272 ... yes
31/273 ... yes
33/274 ... yes
35/278 ... yes
42/279 ... yes
42/280 ... yes
4/281 ... yes
43/282 ... yes
33/284 ... yes
33/285 ... yes
45/288 ... yes
4/289 ... yes
43/290 ... yes
43/291 ... yes
35/292 ... yes
43/293 ... yes
43/295 ... yes
33/296 ... yes
43/297 ... yes
43/298 ... yes
35/299 ... yes
22/300 ... yes
31/301 ... yes
43/302 ... yes
33/303 ... yes
43/304 ... yes
51/305 ... yes
43/306 ... yes
54/309 ... yes
36/310 ... yes
22/311 ... yes
44/312 ... yes
43/313 ... yes
2/314 ... yes
44/315 ... yes
45/316 ... yes
42/317 ... yes
43/318 ... yes
25/319 ... yes
43/320 ... yes
43/321 ... yes
43/322 ... yes
43/323 ... yes
45/324 ... yes
45/326 ... yes
43/327 ... yes
43/328 ... yes
14/329 ... yes
43/331 ... yes
43/333 ... yes
43/334 ... yes
5/335 ... yes
46/336 ... yes
43/337 ... yes
33/342 ... yes
43/343 ... yes
36/344 ... yes
2/345 ... yes
43/347 ... yes
14/348 ... yes
49/349 ... yes
45/350 ... yes
45/351 ... yes
46/352 ... yes
22/353 ... yes
43/354 ... yes
35/355 ... yes
43/356 ... yes
46/357 ... yes
46/359 ... yes
33/360 ... yes
4/361 ... yes
43/362 ... yes
9/363 ... yes
43/364 ... yes
43/365 ... yes
36/366 ... yes
45/367 ... yes
45/368 ... yes
43/369 ... yes
43/370 ... yes
45/372 ... yes
31/373 ... yes
33/374 ... yes
54/376 ... yes
33/377 ... yes
53/378 ... yes
33/379 ... yes
53/380 ... yes
53/381 ... yes
45/382 ... yes
15/384 ... yes
43/385 ... yes
45/386 ... yes
22/387 ... yes
32/388 ... yes
32/389 ... yes
43/390 ... yes
53/391 ... yes
22/392 ... yes
53/393 ... yes
53/394 ... yes
43/395 ... yes
53/396 ... yes
53/397 ... yes
22/398 ... yes
32/399 ... yes
14/401 ... yes
57/402 ... yes
57/403 ... yes
14/404 ... yes
2/405 ... yes
22/406 ... yes
57/407 ... yes
57/408 ... yes
57/409 ... yes
22/410 ... yes
51/411 ... yes
51/412 ... yes
53/413 ... yes
43/414 ... yes
43/415 ... yes
22/417 ... yes
22/418 ... yes
58/419 ... yes
45/420 ... yes
68/421 ... yes
58/423 ... yes
43/424 ... yes
43/425 ... yes
57/427 ... yes
58/428 ... yes
57/430 ... yes
63/432 ... yes
63/433 ... yes
63/434 ... yes
63/436 ... yes
64/437 ... yes
63/438 ... yes
43/439 ... yes
64/440 ... yes
68/442 ... yes
32/443 ... yes
2/444 ... yes
43/445 ... yes
43/446 ... yes
43/447 ... yes
43/448 ... yes
25/450 ... yes
15/451 ... yes
33/452 ... yes
58/453 ... yes
43/454 ... yes
45/455 ... yes
43/456 ... yes
43/457 ... yes
43/458 ... yes
68/460 ... yes
51/461 ... yes
66/463 ... yes
43/464 ... yes
33/465 ... yes
33/466 ... yes
68/468 ... yes
43/469 ... yes
33/470 ... yes
68/471 ... yes
43/472 ... yes
43/473 ... yes
43/474 ... yes
33/475 ... yes
9/476 ... yes
43/477 ... yes
68/478 ... yes
68/479 ... yes
32/480 ... yes
22/481 ... yes
2/482 ... yes
43/483 ... yes
43/484 ... yes
66/485 ... yes
68/486 ... yes
43/487 ... yes
43/488 ... yes
35/489 ... yes
9/490 ... yes
43/491 ... yes
43/492 ... yes
43/493 ... yes
43/494 ... yes
33/495 ... yes
33/496 ... yes
43/497 ... yes
2/498 ... yes
4/499 ... yes
31/500 ... yes
22/501 ... yes
66/502 ... yes
49/503 ... yes
43/504 ... yes
35/505 ... yes
36/508 ... yes
36/510 ... yes
68/511 ... yes
68/512 ... yes
14/513 ... yes
43/514 ... yes
14/515 ... yes
14/516 ... yes
14/517 ... yes
35/518 ... yes
Redis version >= 4.0.0? ... yes
Ruby version >= 2.5.3 ? ... yes (2.6.6)
Git version >= 2.22.0 ? ... yes (2.27.0)
Git user has default SSH configuration? ... yes
Active users: ... 10
Is authorized keys file accessible? ... yes
GitLab configured to store new projects in hashed storage? ... yes
All projects are in hashed storage? ... no
Try fixing it:
Please migrate all projects to hashed storage
as legacy storage is deprecated in 13.0 and support will be removed in 14.0.
For more information see:
doc/administration/repository_storage_types.md
Elasticsearch version 6.x - 7.x? ... skipped (elasticsearch is disabled)
Checking GitLab App ... Finished
Checking GitLab subtasks ... FinishedDebug information
This is running in Kubernetes, where I try to migrate from omnibus-in-docker to the helm chart solution.
First I thought this is an DNS-Problem, why I changed the ObjectStorage-endpoint from the internal kubernetes dns-service-name to the loadBalancerIP.
However, I can connect the MinIO-Storage from within the gitlab-Container:
root@gitlab-bundle-6c7cb9dfbc-vfjsc:/# curl http://10.139.0.210:9000
<?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>Access Denied.</Message><Resource>/</Resource><RequestId>16246A0C72B1C4AE</RequestId><HostId>b7232567-f83f-40d6-addd-c48433e13dd8</HostId></Error>root@gitlab-bundle-6c7cb9dfbc-vfjsc:/# Edited by Marc Bihlmaier