Migrations did not run during upgrade to GitLab 15.6

Summary

Unable to upgrade to Gitlab 15.6 via operator.

Steps to reproduce

Update yaml. Change spec.chart.version from 6.5.5 to 6.6.0 and apply.

Configuration used

(Please provide a sanitized version of the GitLab Custom Resource spec or any other relevant configuration used wrapped in a YAML code block (starting with ```yaml). Make sure to remove/change any sensitive or identifying information.)

apiVersion: apps.gitlab.com/v1beta1
kind: GitLab
metadata:
  name: gitlab
  namespace: gitlab-system
spec:
  chart:
    version: "6.6.0" # https://gitlab.com/gitlab-org/cloud-native/gitlab-operator/-/blob/0.14.0/CHART_VERSIONS
    values:
      gitlab:
        gitaly:
          persistence:
            size: 50Gi
        toolbox:
          enabled: true
          backups:
            cron:
              enabled: true
              concurrencyPolicy: Replace
              failedJobsHistoryLimit: 1
              schedule: "0 5 * * *"
              successfulJobsHistoryLimit: 3
              suspend: false
              backoffLimit: 6
              restartPolicy: "OnFailure"
              extraArgs: "--storage-class STANDARD_IA"
            objectStorage:
              backend: 's3'
              config:
                secret: gitlab-backup-s3cfg
                key: s3cfg
      global:
        hosts:
          domain: mydomain.com # use a real domain here
        ingress:
          class: gitlab-nginx
          configureCertmanager: true
        minio:
          enabled: false
        appConfig:
          ldap:
            enabled: true
            preventSignin: false
            servers:
              # 'main' is the GitLab 'provider ID' of this LDAP server
              main:
                label: 'LDAP'
                hosts:
                  - ['idm01',636]
                  - ['idm02',636]
                uid: 'uid'
                bind_dn: 'uid=gitlab,cn=sysaccounts,cn=etc,dc=xxxxxxx'
                base: 'cn=accounts,dc=xxxxxxxxx'
                user_filter: >-
                  (&(!(uid=admin))(!(nsaccountlock=TRUE))(objectClass=person))
                ca_file: /etc/ssl/certs/myca.pem
                encryption: simple_tls
                lowercase_usernames: true
                password:
                  secret: ldap-password-secret
                  key: password
          object_store:
            enabled: true
            proxy_download: true
            storage_options: {}
            connection:
              secret: gitlab-storage-secret
              key: connection
          artifacts:
            enabled: true
            bucket: xxxx
          ciSecureFiles:
            enabled: true
            bucket: xxxx
          dependencyProxy:
            enabled: true
            bucket: xxxx
          externalDiffs:
            enabled: true
            proxy_download: true
            bucket: xxxx
          lfs:
            enabled: true
            bucket: xxxx
          packages:
            enabled: true
            bucket: xxxx
          terraformState:
            enabled: true
            bucket: xxxx
          uploads:
            enabled: true
            bucket: xxxx
          backups:
            bucket: xxxx
            tmpBucket: xxxx
        certificates:
          customCAs:
            - configMap: myca-configmap
      certmanager-issuer:
        email: asdf@asdf.com # use your real email address here

Current behavior

Sidekiq and webservice pods do not start when trying to upgrade chart.

Expected behavior

Upgrade chart from 6.5.5 to 6.6.0 via operator.

Versions

  • Operator: 0.14.0
  • Platform:
    • Self-hosted: OpenShift ROSA
  • Kubernetes: (kubectl version)
    • Client: v1.24.1
    • Server: v1.24.6+5157800

Relevant logs

Database Schema - main (gitlabhq_production) - current: 20221018081416, codebase: 20221111070314
Checking: main
Database Schema - main (gitlabhq_production) - current: 20221018081416, codebase: 20221111070314
WARNING: Not all services were operational, with data migrations completed.
If this container continues to fail, please see: https://docs.gitlab.com/charts/troubleshooting/index.html#application-containers-constantly-initializing
Edited by Jeff Gustafson