Gitlab Update from 15.9 to 15.11 fail and now gitlab is not loading and libruby.so.3.0 are missing
I was at version 15.9 of gitlab. Today I read the banner that claim to upgrade immediatly in order to install a security fix. So I run the update, it choose the 16.0.3 but then fail claiming to upgrade at least to 15.11.x Ok.
So I run the update, requiring to upgrade to 15.11.x
So, first attempt went wrong with a very strange message:
error: unpacking of archive failed on file /opt/gitlab/embedded/bin/redis-server;6481bffe: cpio: Digest mismatch
Log:
gitlab-ce-15.11.8-ce.0.el7.x86_64.rpm | 1.2 GB 00:01:59
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
gitlab preinstall: Checking for unmigrated data on legacy storage
gitlab preinstall: Automatically backing up only the GitLab SQL database (excluding everything else!)
2023-06-08 11:49:31 UTC -- Dumping database ...
Dumping PostgreSQL database gitlabhq_production ... [DONE]
2023-06-08 11:49:43 UTC -- Dumping database ... done
2023-06-08 11:49:43 UTC -- Dumping repositories ... [SKIPPED]
2023-06-08 11:49:43 UTC -- Dumping uploads ... [SKIPPED]
2023-06-08 11:49:43 UTC -- Dumping builds ... [SKIPPED]
2023-06-08 11:49:43 UTC -- Dumping artifacts ... [SKIPPED]
2023-06-08 11:49:43 UTC -- Dumping pages ... [SKIPPED]
2023-06-08 11:49:43 UTC -- Dumping lfs objects ... [SKIPPED]
2023-06-08 11:49:43 UTC -- Dumping terraform states ... [SKIPPED]
2023-06-08 11:49:43 UTC -- Dumping container registry images ... [SKIPPED]
2023-06-08 11:49:43 UTC -- Dumping packages ... [SKIPPED]
2023-06-08 11:49:43 UTC -- Creating backup archive: 1686224971_2023_06_08_15.9.1_gitlab_backup.tar ...
2023-06-08 11:49:43 UTC -- Creating backup archive: 1686224971_2023_06_08_15.9.1_gitlab_backup.tar ... done
2023-06-08 11:49:43 UTC -- Uploading backup archive to remote storage ... [SKIPPED]
2023-06-08 11:49:43 UTC -- Deleting old backups ... [SKIPPED]
2023-06-08 11:49:43 UTC -- Deleting tar staging files ...
2023-06-08 11:49:43 UTC -- Cleaning up /var/opt/gitlab/backups/backup_information.yml
2023-06-08 11:49:43 UTC -- Cleaning up /var/opt/gitlab/backups/db
2023-06-08 11:49:43 UTC -- Deleting tar staging files ... done
2023-06-08 11:49:43 UTC -- Deleting backups/tmp ...
2023-06-08 11:49:43 UTC -- Deleting backups/tmp ... done
2023-06-08 11:49:43 UTC -- Warning: Your gitlab.rb and gitlab-secrets.json files contain sensitive data
and are not included in this backup. You will need these files to restore a backup.
Please back them up manually.
2023-06-08 11:49:43 UTC -- Backup 1686224971_2023_06_08_15.9.1 is done.
2023-06-08 13:49:43 +0200 -- Deleting backup and restore lock file
gitlab preinstall: Automatically backing up /etc/gitlab
Running configuration backup
Creating configuration backup archive: gitlab_config_1686224984_2023_06_08.tar
/etc/gitlab/
/etc/gitlab/gitlab-secrets.json
/etc/gitlab/trusted-certs/
/etc/gitlab/gitlab.rb
/etc/gitlab/ssl/
/etc/gitlab/ssl/git.phoenixweb.it.key
/etc/gitlab/ssl/git.phoenixweb.it.crt
/etc/gitlab/ssl/git.phoenixweb.it.key-staging
/etc/gitlab/ssl/git.phoenixweb.it.crt-staging
Configuration backup archive complete: /etc/gitlab/config_backup/gitlab_config_1686224984_2023_06_08.tar
Keeping all older configuration backups
Updating : gitlab-ce-15.11.8-ce.0.el7.x86_64 1/2
Error unpacking rpm package gitlab-ce-15.11.8-ce.0.el7.x86_64
error: unpacking of archive failed on file /opt/gitlab/embedded/bin/redis-server;6481bffe: cpio: Digest mismatch
gitlab-ce-15.9.1-ce.0.el7.x86_64 was supposed to be removed but is not!
Verifying : gitlab-ce-15.9.1-ce.0.el7.x86_64 1/2
Verifying : gitlab-ce-15.11.8-ce.0.el7.x86_64 2/2
Failed:
gitlab-ce.x86_64 0:15.9.1-ce.0.el7 gitlab-ce.x86_64 0:15.11.8-ce.0.el7
So.. I tried again and the error was different: /opt/gitlab/embedded/lib/exiftool-perl/Image/ExifTool/WriteXMP.pl;6481c148: cpio: Digest mismatch
gitlab-ce-15.11.8-ce.0.el7.x86_64.rpm | 1.2 GB 00:01:55
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
gitlab preinstall: Checking for unmigrated data on legacy storage
gitlab preinstall: Automatically backing up only the GitLab SQL database (excluding everything else!)
2023-06-08 11:54:54 UTC -- Dumping database ...
Dumping PostgreSQL database gitlabhq_production ... [DONE]
2023-06-08 11:55:04 UTC -- Dumping database ... done
2023-06-08 11:55:04 UTC -- Dumping repositories ... [SKIPPED]
2023-06-08 11:55:04 UTC -- Dumping uploads ... [SKIPPED]
2023-06-08 11:55:04 UTC -- Dumping builds ... [SKIPPED]
2023-06-08 11:55:04 UTC -- Dumping artifacts ... [SKIPPED]
2023-06-08 11:55:04 UTC -- Dumping pages ... [SKIPPED]
2023-06-08 11:55:04 UTC -- Dumping lfs objects ... [SKIPPED]
2023-06-08 11:55:04 UTC -- Dumping terraform states ... [SKIPPED]
2023-06-08 11:55:04 UTC -- Dumping container registry images ... [SKIPPED]
2023-06-08 11:55:04 UTC -- Dumping packages ... [SKIPPED]
2023-06-08 11:55:04 UTC -- Creating backup archive: 1686225294_2023_06_08_15.9.1_gitlab_backup.tar ...
2023-06-08 11:55:04 UTC -- Creating backup archive: 1686225294_2023_06_08_15.9.1_gitlab_backup.tar ... done
2023-06-08 11:55:04 UTC -- Uploading backup archive to remote storage ... [SKIPPED]
2023-06-08 11:55:04 UTC -- Deleting old backups ... [SKIPPED]
2023-06-08 11:55:04 UTC -- Deleting tar staging files ...
2023-06-08 11:55:04 UTC -- Cleaning up /var/opt/gitlab/backups/backup_information.yml
2023-06-08 11:55:04 UTC -- Cleaning up /var/opt/gitlab/backups/db
2023-06-08 11:55:04 UTC -- Deleting tar staging files ... done
2023-06-08 11:55:04 UTC -- Deleting backups/tmp ...
2023-06-08 11:55:04 UTC -- Deleting backups/tmp ... done
2023-06-08 11:55:04 UTC -- Warning: Your gitlab.rb and gitlab-secrets.json files contain sensitive data
and are not included in this backup. You will need these files to restore a backup.
Please back them up manually.
2023-06-08 11:55:04 UTC -- Backup 1686225294_2023_06_08_15.9.1 is done.
2023-06-08 13:55:04 +0200 -- Deleting backup and restore lock file
gitlab preinstall: Automatically backing up /etc/gitlab
Running configuration backup
Creating configuration backup archive: gitlab_config_1686225305_2023_06_08.tar
/etc/gitlab/
/etc/gitlab/gitlab-secrets.json
/etc/gitlab/trusted-certs/
/etc/gitlab/gitlab.rb
/etc/gitlab/ssl/
/etc/gitlab/ssl/git.phoenixweb.it.key
/etc/gitlab/ssl/git.phoenixweb.it.crt
/etc/gitlab/ssl/git.phoenixweb.it.key-staging
/etc/gitlab/ssl/git.phoenixweb.it.crt-staging
Configuration backup archive complete: /etc/gitlab/config_backup/gitlab_config_1686225305_2023_06_08.tar
Keeping all older configuration backups
Updating : gitlab-ce-15.11.8-ce.0.el7.x86_64 1/2
Error unpacking rpm package gitlab-ce-15.11.8-ce.0.el7.x86_64
error: unpacking of archive failed on file /opt/gitlab/embedded/lib/exiftool-perl/Image/ExifTool/WriteXMP.pl;6481c148: cpio: Digest mismatch
gitlab-ce-15.9.1-ce.0.el7.x86_64 was supposed to be removed but is not!
Verifying : gitlab-ce-15.9.1-ce.0.el7.x86_64 1/2
Verifying : gitlab-ce-15.11.8-ce.0.el7.x86_64 2/2
Failed:
gitlab-ce.x86_64 0:15.9.1-ce.0.el7 gitlab-ce.x86_64 0:15.11.8-ce.0.el7
So I tried again but it fail always with same error:
gitlab-ce-15.11.8-ce.0.el7.x86_64.rpm | 1.2 GB 00:02:16
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
/opt/gitlab/embedded/bin/ruby: error while loading shared libraries: libruby.so.3.0: cannot open shared object file: No such file or directory
error: %pre(gitlab-ce-15.11.8-ce.0.el7.x86_64) scriptlet failed, exit status 1
Error in PREIN scriptlet in rpm package gitlab-ce-15.11.8-ce.0.el7.x86_64
gitlab-ce-15.9.1-ce.0.el7.x86_64 was supposed to be removed but is not!
Verifying : gitlab-ce-15.9.1-ce.0.el7.x86_64 1/2
Verifying : gitlab-ce-15.11.8-ce.0.el7.x86_64 2/2
Failed:
gitlab-ce.x86_64 0:15.9.1-ce.0.el7 gitlab-ce.x86_64 0:15.11.8-ce.0.el7
Gitlab is now off. Cannot restart Cannot reconfigured It just broken. I need help.