Skip to content

NoMethodError occurred in delayed notification: undefined method `run_action' for "execute[reload consul]":String

I just tried updating my hybrid cloud environment with the latest master, and it seems to have failed in consul_service[gitaly] action delete:

      * version_file[Create version file for Gitaly] action create
        * file[/var/opt/gitlab/gitaly/VERSION] action create[2022-07-18T21:27:43+00:00] INFO: file[/var/opt/gitlab/gitaly/VERSION] backed up to /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/gitaly/VERSION.chef-20220718212743.926758
    [2022-07-18T21:27:43+00:00] INFO: file[/var/opt/gitlab/gitaly/VERSION] updated file contents /var/opt/gitlab/gitaly/VERSION

          - update content in file /var/opt/gitlab/gitaly/VERSION from c92178 to 5b3f3e
          --- /var/opt/gitlab/gitaly/VERSION        2022-06-21 07:24:34.244039843 +0000
          +++ /var/opt/gitlab/gitaly/.chef-VERSION20220718-666011-ya17bj    2022-07-18 21:27:43.923499813 +0000
          @@ -1 +1 @@
          -sha256:658accc1d6f8444a2b009d9bb717fc9b098b463fc93c3579b365f32989f31985
          +sha256:40c7f5863fb91321c926cd9aeb16edf710ea885504ff90fbdb8a6999eba9dbb4

      * version_file[Create Ruby version file for Gitaly] action create
        * file[/var/opt/gitlab/gitaly/RUBY_VERSION] action create (up to date)
         (up to date)
      * consul_service[gitaly] action delete
        * file[/var/opt/gitlab/consul/config.d/gitaly-service.json] action delete[2022-07-18T21:27:43+00:00] INFO: file[/var/opt/gitlab/consul/config.d/gitaly-service.json] backed up to /opt/gitlab/embedded/cookbooks/cache/backup/var/opt/gitlab/consul/config.d/gitaly-service.json.chef-20220718212743.991898
    [2022-07-18T21:27:43+00:00] INFO: file[/var/opt/gitlab/consul/config.d/gitaly-service.json] deleted file at /var/opt/gitlab/consul/config.d/gitaly-service.json

          - delete file /var/opt/gitlab/consul/config.d/gitaly-service.json
    [2022-07-18T21:27:43+00:00] INFO: Running queued delayed notifications before re-raising exception
    [2022-07-18T21:27:43+00:00] INFO: file[/var/opt/gitlab/consul/config.d/gitaly-service.json] sending run action to execute[reload consul] (delayed)

        ================================================================================
        Error executing action `delete` on resource 'consul_service[gitaly]'
        ================================================================================

        Chef::Exceptions::MultipleFailures
        ----------------------------------
        Multiple failures occurred:
        * Chef::Exceptions::ResourceNotFound occurred in Chef Infra Client run: resource file[/var/opt/gitlab/consul/config.d/gitaly-service.json] is configured to notify resource execute[reload consul] with action run, but execute[reload consul] cannot be found in the resource collection. file[/var/opt/gitlab/consul/config.d/gitaly-service.json] is defined in /opt/gitlab/embedded/cookbooks/cache/cookbooks/consul/resources/consul_service.rb:57:in `block in class_from_file'

        * NoMethodError occurred in delayed notification: undefined method `run_action' for "execute[reload consul]":String

        Resource Declaration:
        ---------------------
        # In /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitaly/recipes/enable.rb

        148: consul_service node['gitaly']['consul_service_name'] do
        149:   id 'gitaly'
        150:   meta node['gitaly']['consul_service_meta']
        151:   action Prometheus.service_discovery_action
        152:   socket_address node['gitaly']['prometheus_listen_addr']
        153:   reload_service false unless node['consul']['enable']
        154: end

        Compiled Resource:
        ------------------
        # Declared in /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitaly/recipes/enable.rb:148:in `from_file'

        consul_service("gitaly") do
          action [:delete]
          updated true
          updated_by_last_action true
          default_guard_interpreter :default
          declared_type :consul_service
          cookbook_name "gitaly"
          recipe_name "enable"
          id "gitaly"
          meta nil
          socket_address "0.0.0.0:9236"
        end

        System Info:
        ------------
        chef_version=17.10.0
        platform=ubuntu
        platform_version=20.04
        ruby=ruby 2.7.5p203 (2021-11-24 revision f69aeb8314) [x86_64-linux]
        program_name=/opt/gitlab/embedded/bin/cinc-client
        executable=/opt/gitlab/embedded/bin/cinc-client

    [2022-07-18T21:27:43+00:00] INFO: Running queued delayed notifications before re-raising exception
    [2022-07-18T21:27:43+00:00] INFO: templatesymlink[Create a gitlab.yml and create a symlink to Rails root] sending run action to execute[clear the gitlab-rails cache] (delayed)