Multiple QA failures on qa-master Praefect jobs due to configuration issue

Summary

Multiple failures on qa-master happening today due to a configuration issue happening during gitlab-ctl reconfigure.

Stack trace

================================================================================
Recipe Compile Error in /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab-ee/recipes/default.rb
================================================================================
RuntimeError
------------
Removed configurations found in gitlab.rb. Aborting reconfigure.
Cookbook Trace: (most recent call first)
----------------------------------------
  /opt/gitlab/embedded/cookbooks/cache/cookbooks/package/libraries/omnibus_helper.rb:231:in `check_deprecations'
  /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/default.rb:29:in `from_file'
  /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab-ee/recipes/default.rb:20:in `from_file'
Relevant File Content:
----------------------
/opt/gitlab/embedded/cookbooks/cache/cookbooks/package/libraries/omnibus_helper.rb:
224:      # We are doing something similar in check_config command.
225:      gitlab_rb_config = Gitlab['node'].normal
226:  
227:      removal_messages = Gitlab::Deprecations.check_config(current_version, gitlab_rb_config, :removal)
228:      removal_messages.each do |msg|
229:        LoggingHelper.removal(msg)
230:      end
231>>     raise "Removed configurations found in gitlab.rb. Aborting reconfigure." unless removal_messages.empty?
232:  
233:      deprecation_messages = Gitlab::Deprecations.check_config(current_version, gitlab_rb_config, :deprecation)
234:      deprecation_messages.each do |msg|
235:        LoggingHelper.deprecation(msg)
236:      end
237:    end
238:  
239:    def self.check_environment
240:      ENV['LD_LIBRARY_PATH'] && LoggingHelper.warning('LD_LIBRARY_PATH was found in the env variables, this may cause issues with linking against the included libraries.')
System Info:
------------
chef_version=17.10.0
platform=ubuntu
platform_version=22.04
ruby=ruby 3.0.6p216 (2023-03-30 revision 23a532679b) [x86_64-linux]
program_name=/opt/gitlab/embedded/bin/cinc-client
executable=/opt/gitlab/embedded/bin/cinc-client
Running handlers:
[2023-05-18T07:45:48+00:00] ERROR: Running exception handlers
There was an error running gitlab-ctl reconfigure:
Removed configurations found in gitlab.rb. Aborting reconfigure.
Removals:
* gitaly['listen_addr'] has been deprecated since 15.10 and was removed in 16.0. In GitLab 15.10, Gitaly's configuration in Omnibus GitLab was changed to structurally match Gitaly's own configuration. Please see the migration instructions at https://docs.gitlab.com/ee/update/#15100
* gitaly['auth_token'] has been deprecated since 15.10 and was removed in 16.0. In GitLab 15.10, Gitaly's configuration in Omnibus GitLab was changed to structurally match Gitaly's own configuration. Please see the migration instructions at https://docs.gitlab.com/ee/update/#15100
* gitaly['storage'] has been deprecated since 15.10 and was removed in 16.0. In GitLab 15.10, Gitaly's configuration in Omnibus GitLab was changed to structurally match Gitaly's own configuration. Please see the migration instructions at https://docs.gitlab.com/ee/update/#15100
Running handlers complete
[2023-05-18T07:45:48+00:00] ERROR: Exception handlers complete
Infra Phase failed. 0 resources updated in 04 seconds
[2023-05-18T07:45:48+00:00] FATAL: Stacktrace dumped to /opt/gitlab/embedded/cookbooks/cache/cinc-stacktrace.out
[2023-05-18T07:45:48+00:00] FATAL: ---------------------------------------------------------------------------------------
[2023-05-18T07:45:48+00:00] FATAL: PLEASE PROVIDE THE CONTENTS OF THE stacktrace.out FILE (above) IF YOU FILE A BUG REPORT
[2023-05-18T07:45:48+00:00] FATAL: ---------------------------------------------------------------------------------------
[2023-05-18T07:45:48+00:00] FATAL: RuntimeError: Removed configurations found in gitlab.rb. Aborting reconfigure.

Possible Fixes

Below settings need to be removed/replaced with correct 16.0 versions.

* gitaly['listen_addr'] has been deprecated since 15.10 and was removed in 16.0. In GitLab 15.10, Gitaly's configuration in Omnibus GitLab was changed to structurally match Gitaly's own configuration. Please see the migration instructions at https://docs.gitlab.com/ee/update/#15100
* gitaly['auth_token'] has been deprecated since 15.10 and was removed in 16.0. In GitLab 15.10, Gitaly's configuration in Omnibus GitLab was changed to structurally match Gitaly's own configuration. Please see the migration instructions at https://docs.gitlab.com/ee/update/#15100
* gitaly['storage'] has been deprecated since 15.10 and was removed in 16.0. In GitLab 15.10, Gitaly's configuration in Omnibus GitLab was changed to structurally match Gitaly's own configuration. Please see the migration instructions at https://docs.gitlab.com/ee/update/#15100