Skip to content

Toolbox pod crash when upgrading chart version

Summary

After upgrading GitLab version to 5.9.3 I see the toolbox pod in crashloopback. The initial script tries to change a file in a read only filesystem.

Steps to reproduce

Did installation was an upgrade from 5.7.1 in the operator 0.4.2. Therefore,

  1. Install the operation version 0.4.2
  2. Deploy GitLab version 5.7.1
  3. Upgrade operator to version 0.6.3
  4. Change GitLab resource to 5.7.7
  5. Change GitLab resource to 5.8.5
  6. Change GitLab resource to 5.9.3

Configuration used

apiVersion: apps.gitlab.com/v1beta1
kind: GitLab
metadata:
  name: gitlab
  namespace: gitlab-system
spec:
  chart:
    values:
      global:
        appConfig:
          omniauth:
            allowSingleSignOn:
            - openid_connect
            blockAutoCreatedUsers: false
            enabled: true
            providers:
            - secret: openid-connect
        hosts:
          domain: dev.example.com
        ingress:
          configureCertmanager: true
        minio:
          persistence:
            size: 100Gi
    version: 5.9.3

Current behavior

The pod is in crashloopback.

Expected behavior

The pod up and running

Versions

  • Operator: 0.6.3
  • Platform:
    • Cloud: GKE
  • Kubernetes:
    • Client: 1.22.4
    • Server: v1.21.6-gke.1503

Relevant logs

$ kubectl logs -n gitlab-system gitlab-toolbox-58cf544465-vs2v9
Begin parsing .erb templates from /var/opt/gitlab/templates
Writing /var/opt/gitlab/templates/cable.yml
/scripts/set-config: line 20: /var/opt/gitlab/templates/cable.yml: Read-only file system
Edited by Mitchell Nielsen