"500 Proxy Error" since upgrade to 10.7
<!---
Please read this!
Before opening a new issue, make sure to search for keywords in the issues
filtered by the "regression" or "bug" label.
For the Community Edition issue tracker:
- https://gitlab.com/gitlab-org/gitlab-ce/issues?label_name%5B%5D=regression
- https://gitlab.com/gitlab-org/gitlab-ce/issues?label_name%5B%5D=bug
For the Enterprise Edition issue tracker:
- https://gitlab.com/gitlab-org/gitlab-ee/issues?label_name%5B%5D=regression
- https://gitlab.com/gitlab-org/gitlab-ee/issues?label_name%5B%5D=bug
and verify the issue you're about to submit isn't a duplicate.
--->
### Summary
I'm using the Omnibus package with the bundled webserver and when I upgraded to 10.7 the reconfigure step failed to import / read the existing certificates due to some validation failure with letsencrypt. After that, accessing Gitlab via reverse proxy does not work anymore. I tried to reconfigure and reimport the certificates, but nothing helped. On the proxy I'm using Apache + letsencrypt. I have also tried to renew the certs and import them but that didn't help either. Have there been any changes to the configuration? Is there something special one needs to know when using letsencrypt certs in this version?
Accessing Gitlab directly does actually work.
### Steps to reproduce
Upgrade to Gitlab 10.7
### What is the current *bug* behavior?
Accessing Gitlab via reverse proxy fails.
### What is the expected *correct* behavior?
Accessing Gitlab via reverse proxy works as before.
### Output of checks
```
# Logfile created on 2018-04-23 11:07:19 +0200 by logger.rb/56438
[2018-04-23T11:07:20+02:00] INFO: Started chef-zero at chefzero://localhost:1 with repository at /opt/gitlab/embedded
One version per cookbook
[2018-04-23T11:07:20+02:00] INFO: *** Chef 13.6.4 ***
[2018-04-23T11:07:20+02:00] INFO: Platform: x86_64-linux
[2018-04-23T11:07:20+02:00] INFO: Chef-client pid: 6645
[2018-04-23T11:07:20+02:00] INFO: The plugin path /etc/chef/ohai/plugins does not exist. Skipping...
[2018-04-23T11:07:21+02:00] INFO: Setting the run_list to ["recipe[gitlab]"] from CLI options
[2018-04-23T11:07:21+02:00] INFO: Run List is [recipe[gitlab]]
[2018-04-23T11:07:21+02:00] INFO: Run List expands to [gitlab]
[2018-04-23T11:07:21+02:00] INFO: Starting Chef Run for redundanto.iag.uni-stuttgart.de
[2018-04-23T11:07:21+02:00] INFO: Running start handlers
[2018-04-23T11:07:21+02:00] INFO: Start handlers complete.
[2018-04-23T11:07:22+02:00] INFO: Loading cookbooks [gitlab@0.0.1, package@0.1.0, postgresql@0.1.0, registry@0.1.0, mattermost@0.1.0, consul@0.0.0, gitaly@0.1.0, letsencrypt@0.1.0, nginx@0.1.0, runit@0.14.2, acme@3.1.0, crond@0.1.0, compat_resource@12.19.0]
[2018-04-23T11:07:24+02:00] WARN: Selected systemd because systemctl shows .mount units
[2018-04-23T11:07:25+02:00] INFO: The plugin path /etc/chef/ohai/plugins does not exist. Skipping...
[2018-04-23T11:07:25+02:00] INFO: template[/var/opt/gitlab/gitlab-shell/config.yml] backed up to /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/gitlab-shell/config.yml.chef-20180423110725.411834
[2018-04-23T11:07:25+02:00] INFO: template[/var/opt/gitlab/gitlab-shell/config.yml] removed backup at /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/gitlab-shell/config.yml.chef-20160801120424.925822
[2018-04-23T11:07:25+02:00] INFO: template[/var/opt/gitlab/gitlab-shell/config.yml] updated file contents /var/opt/gitlab/gitlab-shell/config.yml
[2018-04-23T11:07:25+02:00] INFO: execute[/opt/gitlab/embedded/service/gitlab-shell/bin/gitlab-keys check-permissions] ran successfully
[2018-04-23T11:07:25+02:00] INFO: template[/var/opt/gitlab/gitlab-rails/etc/gitlab.yml] backed up to /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/gitlab-rails/etc/gitlab.yml.chef-20180423110725.899265
[2018-04-23T11:07:25+02:00] INFO: template[/var/opt/gitlab/gitlab-rails/etc/gitlab.yml] removed backup at /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/gitlab-rails/etc/gitlab.yml.chef-20171121233109.855340
[2018-04-23T11:07:25+02:00] INFO: template[/var/opt/gitlab/gitlab-rails/etc/gitlab.yml] updated file contents /var/opt/gitlab/gitlab-rails/etc/gitlab.yml
[2018-04-23T11:07:26+02:00] INFO: file[/opt/gitlab/embedded/service/gitlab-rails/db/schema.rb] owner changed to 999
[2018-04-23T11:07:26+02:00] INFO: remote_file[/var/opt/gitlab/gitlab-rails/VERSION] backed up to /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/gitlab-rails/VERSION.chef-20180423110726.072660
[2018-04-23T11:07:26+02:00] INFO: remote_file[/var/opt/gitlab/gitlab-rails/VERSION] removed backup at /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/gitlab-rails/VERSION.chef-20180308084317.005403
[2018-04-23T11:07:26+02:00] INFO: remote_file[/var/opt/gitlab/gitlab-rails/VERSION] updated file contents /var/opt/gitlab/gitlab-rails/VERSION
[2018-04-23T11:07:26+02:00] INFO: remote_file[/var/opt/gitlab/gitlab-rails/REVISION] backed up to /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/gitlab-rails/REVISION.chef-20180423110726.086197
[2018-04-23T11:07:26+02:00] INFO: remote_file[/var/opt/gitlab/gitlab-rails/REVISION] removed backup at /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/gitlab-rails/REVISION.chef-20180308084317.046497
[2018-04-23T11:07:26+02:00] INFO: remote_file[/var/opt/gitlab/gitlab-rails/REVISION] updated file contents /var/opt/gitlab/gitlab-rails/REVISION
[2018-04-23T11:07:26+02:00] INFO: execute[chown -R root:root /opt/gitlab/embedded/service/gitlab-rails/public] ran successfully
[2018-04-23T11:07:26+02:00] INFO: ruby_block[Move existing certs and link to /opt/gitlab/embedded/ssl/certs] called
[2018-04-23T11:07:26+02:00] INFO: template[/var/opt/gitlab/postgresql/data/runtime.conf] backed up to /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/postgresql/data/runtime.conf.chef-20180423110726.704359
[2018-04-23T11:07:26+02:00] INFO: template[/var/opt/gitlab/postgresql/data/runtime.conf] updated file contents /var/opt/gitlab/postgresql/data/runtime.conf
[2018-04-23T11:07:26+02:00] INFO: template[/var/opt/gitlab/postgresql/data/runtime.conf] sending run action to execute[reload postgresql] (immediate)
[2018-04-23T11:07:27+02:00] INFO: execute[reload postgresql] ran successfully
[2018-04-23T11:07:27+02:00] INFO: template[/var/opt/gitlab/postgresql/data/runtime.conf] sending run action to execute[start postgresql] (immediate)
[2018-04-23T11:07:41+02:00] INFO: bash[migrate gitlab-rails database] ran successfully
[2018-04-23T11:07:41+02:00] INFO: bash[migrate gitlab-rails database] sending run action to execute[clear the gitlab-rails cache] (immediate)
[2018-04-23T11:07:50+02:00] INFO: execute[clear the gitlab-rails cache] ran successfully
[2018-04-23T11:07:51+02:00] INFO: file[/var/opt/gitlab/gitlab-workhorse/VERSION] backed up to /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/gitlab-workhorse/VERSION.chef-20180423110751.377381
[2018-04-23T11:07:51+02:00] INFO: file[/var/opt/gitlab/gitlab-workhorse/VERSION] removed backup at /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/gitlab-workhorse/VERSION.chef-20180308084344.225473
[2018-04-23T11:07:51+02:00] INFO: file[/var/opt/gitlab/gitlab-workhorse/VERSION] updated file contents /var/opt/gitlab/gitlab-workhorse/VERSION
[2018-04-23T11:07:51+02:00] INFO: template[/var/opt/gitlab/nginx/conf/gitlab-http.conf] backed up to /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/nginx/conf/gitlab-http.conf.chef-20180423110751.467012
[2018-04-23T11:07:51+02:00] INFO: template[/var/opt/gitlab/nginx/conf/gitlab-http.conf] removed backup at /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/nginx/conf/gitlab-http.conf.chef-20171115111740.195226
[2018-04-23T11:07:51+02:00] INFO: template[/var/opt/gitlab/nginx/conf/gitlab-http.conf] updated file contents /var/opt/gitlab/nginx/conf/gitlab-http.conf
[2018-04-23T11:07:51+02:00] INFO: template[/opt/gitlab/sv/prometheus/run] backed up to /opt/gitlab/embedded/cookbooks/cache/backup/opt/gitlab/sv/prometheus/run.chef-20180423110751.860234
[2018-04-23T11:07:51+02:00] INFO: template[/opt/gitlab/sv/prometheus/run] removed backup at /opt/gitlab/embedded/cookbooks/cache/backup/opt/gitlab/sv/prometheus/run.chef-20171109113522.769551
[2018-04-23T11:07:51+02:00] INFO: template[/opt/gitlab/sv/prometheus/run] updated file contents /opt/gitlab/sv/prometheus/run
[2018-04-23T11:07:51+02:00] INFO: directory[/etc/gitlab/ssl] mode changed to 755
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL selfsigned key] created file /etc/gitlab/ssl/gitlabext.iag.uni-stuttgart.de.key
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL selfsigned key] updated file contents /etc/gitlab/ssl/gitlabext.iag.uni-stuttgart.de.key
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL selfsigned key] owner changed to 0
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL selfsigned key] group changed to 0
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL selfsigned key] mode changed to 400
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL selfsigned crt] created file /etc/gitlab/ssl/gitlabext.iag.uni-stuttgart.de.crt
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL selfsigned crt] updated file contents /etc/gitlab/ssl/gitlabext.iag.uni-stuttgart.de.crt
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL selfsigned crt] owner changed to 0
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL selfsigned crt] group changed to 0
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL selfsigned crt] mode changed to 644
[2018-04-23T11:07:52+02:00] INFO: acme_selfsigned[gitlabext.iag.uni-stuttgart.de] sending restart action to service[nginx] (immediate)
[2018-04-23T11:07:52+02:00] INFO: service[nginx] restarted
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL key] created file /etc/gitlab/ssl/gitlabext.iag.uni-stuttgart.de.key-staging
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL key] updated file contents /etc/gitlab/ssl/gitlabext.iag.uni-stuttgart.de.key-staging
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL key] owner changed to 0
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL key] group changed to 0
[2018-04-23T11:07:52+02:00] INFO: file[gitlabext.iag.uni-stuttgart.de SSL key] mode changed to 400
[2018-04-23T11:07:53+02:00] INFO: directory[/var/opt/gitlab/nginx/www/.well-known/acme-challenge] created directory /var/opt/gitlab/nginx/www/.well-known/acme-challenge
[2018-04-23T11:07:53+02:00] INFO: directory[/var/opt/gitlab/nginx/www/.well-known/acme-challenge] owner changed to 0
[2018-04-23T11:07:53+02:00] INFO: directory[/var/opt/gitlab/nginx/www/.well-known/acme-challenge] group changed to 0
[2018-04-23T11:07:53+02:00] INFO: directory[/var/opt/gitlab/nginx/www/.well-known/acme-challenge] mode changed to 755
[2018-04-23T11:07:53+02:00] INFO: file[/var/opt/gitlab/nginx/www/.well-known/acme-challenge/iTJH5jXCwYzDHA-0AyRU5p1Sc6bfQXaBl3M8gFvvAJU] created file /var/opt/gitlab/nginx/www/.well-known/acme-challenge/iTJH5jXCwYzDHA-0AyRU5p1Sc6bfQXaBl3M8gFvvAJU
[2018-04-23T11:07:53+02:00] INFO: file[/var/opt/gitlab/nginx/www/.well-known/acme-challenge/iTJH5jXCwYzDHA-0AyRU5p1Sc6bfQXaBl3M8gFvvAJU] updated file contents /var/opt/gitlab/nginx/www/.well-known/acme-challenge/iTJH5jXCwYzDHA-0AyRU5p1Sc6bfQXaBl3M8gFvvAJU
[2018-04-23T11:07:53+02:00] INFO: file[/var/opt/gitlab/nginx/www/.well-known/acme-challenge/iTJH5jXCwYzDHA-0AyRU5p1Sc6bfQXaBl3M8gFvvAJU] owner changed to 0
[2018-04-23T11:07:53+02:00] INFO: file[/var/opt/gitlab/nginx/www/.well-known/acme-challenge/iTJH5jXCwYzDHA-0AyRU5p1Sc6bfQXaBl3M8gFvvAJU] group changed to 0
[2018-04-23T11:07:53+02:00] INFO: file[/var/opt/gitlab/nginx/www/.well-known/acme-challenge/iTJH5jXCwYzDHA-0AyRU5p1Sc6bfQXaBl3M8gFvvAJU] mode changed to 644
[2018-04-23T11:07:56+02:00] INFO: Running queued delayed notifications before re-raising exception
[2018-04-23T11:07:56+02:00] INFO: Running queued delayed notifications before re-raising exception
[2018-04-23T11:07:56+02:00] INFO: templatesymlink[Create a gitlab.yml and create a symlink to Rails root] sending run action to execute[clear the gitlab-rails cache] (delayed)
[2018-04-23T11:08:05+02:00] INFO: execute[clear the gitlab-rails cache] ran successfully
[2018-04-23T11:08:05+02:00] INFO: file[/var/opt/gitlab/gitlab-workhorse/VERSION] sending restart action to service[gitlab-workhorse] (delayed)
[2018-04-23T11:08:06+02:00] INFO: service[gitlab-workhorse] restarted
[2018-04-23T11:08:06+02:00] ERROR: Running exception handlers
[2018-04-23T11:08:06+02:00] ERROR: Exception handlers complete
[2018-04-23T11:08:06+02:00] FATAL: Stacktrace dumped to /opt/gitlab/embedded/cookbooks/cache/chef-stacktrace.out
[2018-04-23T11:08:06+02:00] FATAL: Please provide the contents of the stacktrace.out file if you file a bug report
[2018-04-23T11:08:06+02:00] FATAL: RuntimeError: letsencrypt_certificate[gitlabext.iag.uni-stuttgart.de] (letsencrypt::http_authorization line 3) had an error: RuntimeError: acme_certificate[staging] (/opt/gitlab/embedded/cookbooks/cache/cookbooks/letsencrypt/resources/certificate.rb line 20) had an error: RuntimeError: [gitlabext.iag.uni-stuttgart.de] Validation failed for domain gitlabext.iag.uni-stuttgart.de
```
The output of `chef-stacktrace.out`:
```
Generated at 2018-04-23 11:08:06 +0200
RuntimeError: letsencrypt_certificate[gitlabext.iag.uni-stuttgart.de] (letsencrypt::http_authorization line 3) had an error: RuntimeError: acme_certificate[staging] (/opt/gitlab/embedded/cookbooks/cache/cookbooks/letsencrypt/resources/certificate.rb line 20) had an error: RuntimeError: [gitlabext.iag.uni-stuttgart.de] Validation failed for domain gitlabext.iag.uni-stuttgart.de
/opt/gitlab/embedded/cookbooks/cache/cookbooks/acme/providers/certificate.rb:93:in `block (2 levels) in class_from_file'
/opt/gitlab/embedded/cookbooks/cache/cookbooks/acme/providers/certificate.rb:68:in `map'
/opt/gitlab/embedded/cookbooks/cache/cookbooks/acme/providers/certificate.rb:68:in `block in class_from_file'
(eval):2:in `block in action_create'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/provider.rb:211:in `instance_eval'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/provider.rb:211:in `compile_and_converge_action'
(eval):2:in `action_create'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/provider.rb:171:in `run_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource.rb:591:in `run_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:70:in `run_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:98:in `block (2 levels) in converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:98:in `each'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:98:in `block in converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/resource_list.rb:94:in `block in execute_each_resource'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:114:in `call_iterator_block'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:85:in `step'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:103:in `iterate'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:55:in `each_with_index'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/resource_list.rb:92:in `execute_each_resource'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:97:in `converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/provider.rb:212:in `compile_and_converge_action'
(eval):2:in `action_create'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/provider.rb:171:in `run_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource.rb:591:in `run_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:70:in `run_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:98:in `block (2 levels) in converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:98:in `each'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:98:in `block in converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/resource_list.rb:94:in `block in execute_each_resource'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:114:in `call_iterator_block'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:85:in `step'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:103:in `iterate'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:55:in `each_with_index'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/resource_list.rb:92:in `execute_each_resource'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:97:in `converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/client.rb:718:in `block in converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/client.rb:713:in `catch'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/client.rb:713:in `converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/client.rb:752:in `converge_and_save'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/client.rb:286:in `run'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/application.rb:273:in `run_with_graceful_exit_option'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/application.rb:249:in `block in run_chef_client'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/local_mode.rb:44:in `with_server_connectivity'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/application.rb:232:in `run_chef_client'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/application/client.rb:434:in `run_application'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/application.rb:59:in `run'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/bin/chef-client:26:in `<top (required)>'
/opt/gitlab/embedded/bin/chef-client:23:in `load'
/opt/gitlab/embedded/bin/chef-client:23:in `<main>'
>>>> Caused by RuntimeError: [gitlabext.iag.uni-stuttgart.de] Validation failed for domain gitlabext.iag.uni-stuttgart.de
/opt/gitlab/embedded/cookbooks/cache/cookbooks/acme/providers/certificate.rb:93:in `block (2 levels) in class_from_file'
/opt/gitlab/embedded/cookbooks/cache/cookbooks/acme/providers/certificate.rb:68:in `map'
/opt/gitlab/embedded/cookbooks/cache/cookbooks/acme/providers/certificate.rb:68:in `block in class_from_file'
(eval):2:in `block in action_create'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/provider.rb:211:in `instance_eval'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/provider.rb:211:in `compile_and_converge_action'
(eval):2:in `action_create'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/provider.rb:171:in `run_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource.rb:591:in `run_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:70:in `run_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:98:in `block (2 levels) in converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:98:in `each'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:98:in `block in converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/resource_list.rb:94:in `block in execute_each_resource'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:114:in `call_iterator_block'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:85:in `step'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:103:in `iterate'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:55:in `each_with_index'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/resource_list.rb:92:in `execute_each_resource'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:97:in `converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/provider.rb:212:in `compile_and_converge_action'
(eval):2:in `action_create'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/provider.rb:171:in `run_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource.rb:591:in `run_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:70:in `run_action'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:98:in `block (2 levels) in converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:98:in `each'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:98:in `block in converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/resource_list.rb:94:in `block in execute_each_resource'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:114:in `call_iterator_block'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:85:in `step'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:103:in `iterate'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/stepable_iterator.rb:55:in `each_with_index'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/resource_collection/resource_list.rb:92:in `execute_each_resource'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/runner.rb:97:in `converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/client.rb:718:in `block in converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/client.rb:713:in `catch'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/client.rb:713:in `converge'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/client.rb:752:in `converge_and_save'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/client.rb:286:in `run'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/application.rb:273:in `run_with_graceful_exit_option'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/application.rb:249:in `block in run_chef_client'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/local_mode.rb:44:in `with_server_connectivity'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/application.rb:232:in `run_chef_client'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/application/client.rb:434:in `run_application'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/lib/chef/application.rb:59:in `run'
/opt/gitlab/embedded/lib/ruby/gems/2.3.0/gems/chef-13.6.4/bin/chef-client:26:in `<top (required)>'
/opt/gitlab/embedded/bin/chef-client:23:in `load'
/opt/gitlab/embedded/bin/chef-client:23:in `<main>'
```
#### Results of GitLab environment info
<details>
<summary>Expand for output related to GitLab environment info</summary>
<pre>
```
System information
System: Ubuntu 16.04
Current User: git
Using RVM: no
Ruby Version: 2.3.6p384
Gem Version: 2.6.13
Bundler Version:1.13.7
Rake Version: 12.3.0
Redis Version: 3.2.11
Git Version: 2.14.3
Sidekiq Version:5.0.5
Go Version: go1.6.2 linux/amd64
GitLab information
Version: 10.7.0
Revision: 2011c9b
Directory: /opt/gitlab/embedded/service/gitlab-rails
DB Adapter: postgresql
URL: https://gitlabext.iag.uni-stuttgart.de
HTTP Clone URL: https://gitlabext.iag.uni-stuttgart.de/some-group/some-project.git
SSH Clone URL: git@gitlab.iag.uni-stuttgart.de:some-group/some-project.git
Using LDAP: yes
Using Omniauth: no
GitLab Shell
Version: 7.1.2
Repository storage paths:
- default: /usr/local/gitlab/git-data/repositories
Hooks: /opt/gitlab/embedded/service/gitlab-shell/hooks
Git: /opt/gitlab/embedded/bin/git
```
</pre>
</details>
#### Results of GitLab application Check
<details>
<summary>Expand for output related to the GitLab application check</summary>
<pre>
```
Checking GitLab Shell ...
GitLab Shell version >= 7.1.2 ? ... OK (7.1.2)
Repo base directory exists?
default... yes
Repo storage directories are symlinks?
default... no
Repo paths owned by git:root, or git:git?
default... yes
Repo paths access is drwxrws---?
default... yes
hooks directories in repos are links: ...
13/1 ... ok
4/2 ... ok
6/3 ... ok
4/5 ... ok
8/8 ... ok
9/13 ... ok
9/14 ... ok
4/15 ... ok
13/20 ... ok
2/21 ... ok
19/23 ... repository is empty
22/25 ... ok
23/26 ... ok
9/27 ... ok
13/29 ... ok
8/30 ... ok
19/31 ... repository is empty
19/33 ... repository is empty
23/34 ... ok
9/35 ... ok
27/38 ... ok
22/42 ... ok
22/43 ... ok
16/44 ... ok
8/45 ... ok
33/46 ... ok
6/47 ... ok
7/49 ... ok
7/50 ... ok
3/51 ... ok
33/52 ... repository is empty
6/53 ... ok
23/54 ... ok
22/55 ... ok
27/56 ... ok
33/57 ... ok
33/58 ... ok
7/59 ... ok
7/60 ... ok
8/62 ... ok
23/65 ... ok
9/67 ... ok
6/68 ... ok
9/69 ... ok
23/72 ... ok
23/73 ... ok
23/74 ... ok
20/75 ... ok
4/76 ... ok
23/77 ... ok
6/79 ... ok
9/82 ... ok
2/83 ... repository is empty
23/84 ... ok
20/85 ... ok
33/86 ... ok
49/87 ... ok
23/88 ... ok
22/89 ... ok
23/92 ... repository is empty
23/93 ... ok
22/94 ... ok
16/95 ... ok
6/99 ... ok
8/100 ... ok
49/102 ... ok
59/103 ... ok
33/106 ... ok
62/108 ... ok
62/109 ... ok
22/110 ... ok
48/111 ... ok
33/112 ... repository is empty
3/113 ... ok
62/114 ... ok
28/115 ... ok
3/116 ... ok
22/117 ... ok
28/119 ... ok
2/120 ... ok
22/121 ... ok
22/122 ... ok
22/123 ... ok
22/124 ... ok
22/125 ... ok
22/126 ... ok
22/127 ... ok
22/128 ... ok
22/129 ... ok
22/130 ... ok
22/131 ... ok
22/132 ... ok
22/133 ... ok
22/134 ... ok
74/136 ... ok
87/137 ... ok
2/138 ... ok
76/139 ... ok
78/141 ... ok
35/142 ... ok
77/144 ... ok
68/145 ... ok
68/146 ... ok
88/147 ... ok
91/148 ... ok
18/149 ... ok
6/151 ... ok
91/152 ... ok
100/156 ... ok
100/157 ... ok
33/159 ... ok
99/161 ... ok
62/165 ... ok
103/166 ... ok
33/168 ... ok
Running /opt/gitlab/embedded/service/gitlab-shell/bin/check
Check GitLab API access: OK
Redis available via internal API: OK
Access to /var/opt/gitlab/.ssh/authorized_keys: OK
gitlab-shell self-check successful
Checking GitLab Shell ... Finished
Checking Sidekiq ...
Running? ... yes
Number of Sidekiq processes ... 1
Checking Sidekiq ... Finished
Reply by email is disabled in config/gitlab.yml
Checking LDAP ...
Server: ldapmain
LDAP authentication... Anonymous. No `bind_dn` or `password` configured
LDAP users with access to your GitLab server (only showing the first 100 results)
....
Checking LDAP ... Finished
Checking GitLab ...
Git configured correctly? ... yes
Database config exists? ... yes
All migrations up? ... yes
Database contains orphaned GroupMembers? ... no
GitLab config exists? ... yes
GitLab config up to date? ... yes
Log directory writable? ... yes
Tmp directory writable? ... yes
Uploads directory exists? ... yes
Uploads directory has correct permissions? ... yes
Uploads directory tmp has correct permissions? ... yes
Init script exists? ... skipped (omnibus-gitlab has no init script)
Init script up-to-date? ... skipped (omnibus-gitlab has no init script)
Projects have namespace: ...
13/1 ... yes
4/2 ... yes
6/3 ... yes
4/5 ... yes
8/8 ... yes
9/13 ... yes
9/14 ... yes
4/15 ... yes
13/20 ... yes
2/21 ... yes
19/23 ... yes
22/25 ... yes
23/26 ... yes
9/27 ... yes
13/29 ... yes
8/30 ... yes
19/31 ... yes
19/33 ... yes
23/34 ... yes
9/35 ... yes
27/38 ... yes
22/42 ... yes
22/43 ... yes
16/44 ... yes
8/45 ... yes
33/46 ... yes
6/47 ... yes
7/49 ... yes
7/50 ... yes
3/51 ... yes
33/52 ... yes
6/53 ... yes
23/54 ... yes
22/55 ... yes
27/56 ... yes
33/57 ... yes
33/58 ... yes
7/59 ... yes
7/60 ... yes
8/62 ... yes
23/65 ... yes
9/67 ... yes
6/68 ... yes
9/69 ... yes
23/72 ... yes
23/73 ... yes
23/74 ... yes
20/75 ... yes
4/76 ... yes
23/77 ... yes
6/79 ... yes
9/82 ... yes
2/83 ... yes
23/84 ... yes
20/85 ... yes
33/86 ... yes
49/87 ... yes
23/88 ... yes
22/89 ... yes
23/92 ... yes
23/93 ... yes
22/94 ... yes
16/95 ... yes
6/99 ... yes
8/100 ... yes
49/102 ... yes
59/103 ... yes
33/106 ... yes
62/108 ... yes
62/109 ... yes
22/110 ... yes
48/111 ... yes
33/112 ... yes
3/113 ... yes
62/114 ... yes
28/115 ... yes
3/116 ... yes
22/117 ... yes
28/119 ... yes
2/120 ... yes
22/121 ... yes
22/122 ... yes
22/123 ... yes
22/124 ... yes
22/125 ... yes
22/126 ... yes
22/127 ... yes
22/128 ... yes
22/129 ... yes
22/130 ... yes
22/131 ... yes
22/132 ... yes
22/133 ... yes
22/134 ... yes
74/136 ... yes
87/137 ... yes
2/138 ... yes
76/139 ... yes
78/141 ... yes
35/142 ... yes
77/144 ... yes
68/145 ... yes
68/146 ... yes
88/147 ... yes
91/148 ... yes
18/149 ... yes
6/151 ... yes
91/152 ... yes
100/156 ... yes
100/157 ... yes
33/159 ... yes
99/161 ... yes
62/165 ... yes
103/166 ... yes
33/168 ... yes
Redis version >= 2.8.0? ... yes
Ruby version >= 2.3.5 ? ... yes (2.3.6)
Git version >= 2.9.5 ? ... yes (2.14.3)
Git user has default SSH configuration? ... yes
Active users: ... 82
Checking GitLab ... Finished
```
</pre>
</details>
issue