Updating from gitlab-ee_14.10.0 fails because of insufficient space, but there is enougth space.
I try to upgrade gitlab from 14.10 to 15.1.x, but I can't even update to the newest 14.10 version. It fails with the error message below. The error message tells me, that my space is not sufficient, but it is, I checked it and appended the output below.
uname -v:#37~20.04.1-Ubuntu SMP Mon Jun 13 22:51:01 UTC 2022
sudo apt install gitlab-ee=14.10.4-ee.0:
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages will be upgraded:
gitlab-ee
1 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Need to get 0 B/1.144 MB of archives.
After this operation, 125 kB of additional disk space will be used.
(Reading database ... 221117 files and directories currently installed.)
Preparing to unpack .../gitlab-ee_14.10.4-ee.0_amd64.deb ...
gitlab preinstall: Checking for unmigrated data on legacy storage
gitlab preinstall: Automatically backing up only the GitLab SQL database (excluding everything else!)
2022-06-30 19:16:27 +0000 -- Dumping database ...
Dumping PostgreSQL database gitlabhq_production ... [DONE]
2022-06-30 19:16:35 +0000 -- Dumping database ... done
2022-06-30 19:16:35 +0000 -- Dumping repositories ... [SKIPPED]
2022-06-30 19:16:35 +0000 -- Dumping uploads ... [SKIPPED]
2022-06-30 19:16:35 +0000 -- Dumping builds ... [SKIPPED]
2022-06-30 19:16:35 +0000 -- Dumping artifacts ... [SKIPPED]
2022-06-30 19:16:35 +0000 -- Dumping pages ... [SKIPPED]
2022-06-30 19:16:35 +0000 -- Dumping lfs objects ... [SKIPPED]
2022-06-30 19:16:35 +0000 -- Dumping terraform states ... [SKIPPED]
2022-06-30 19:16:35 +0000 -- Dumping container registry images ... [DISABLED]
2022-06-30 19:16:35 +0000 -- Dumping packages ... [SKIPPED]
2022-06-30 19:16:35 +0000 -- Creating backup archive: 1656616587_2022_06_30_14.10.0-ee_gitlab_backup.tar ...
2022-06-30 19:16:35 +0000 -- Creating backup archive: 1656616587_2022_06_30_14.10.0-ee_gitlab_backup.tar ... done
2022-06-30 19:16:35 +0000 -- Uploading backup archive to remote storage ... [SKIPPED]
2022-06-30 19:16:35 +0000 -- Deleting tar staging files ...
2022-06-30 19:16:35 +0000 -- Cleaning up /var/opt/gitlab/backups/backup_information.yml
2022-06-30 19:16:35 +0000 -- Cleaning up /var/opt/gitlab/backups/db
2022-06-30 19:16:35 +0000 -- Deleting tar staging files ... done
2022-06-30 19:16:35 +0000 -- Deleting old backups ... [SKIPPED]
2022-06-30 19:16:35 +0000 -- Warning: Your gitlab.rb and gitlab-secrets.json files contain sensitive data
and are not included in this backup. You will need these files to restore a backup.
Please back them up manually.
2022-06-30 19:16:35 +0000 -- Backup 1656616587_2022_06_30_14.10.0-ee is done.
gitlab preinstall: Automatically backing up /etc/gitlab
Running configuration backup
Creating configuration backup archive: gitlab_config_1656616597_2022_06_30.tar
/etc/gitlab/
/etc/gitlab/ssl/
/etc/gitlab/ssl/gitlab.optomet.de.key
/etc/gitlab/ssl/gitlab.optomet.de.crt
/etc/gitlab/trusted-certs/
/etc/gitlab/gitlab.rb
/etc/gitlab/gitlab.rb.save
/etc/gitlab/gitlab.rb.save.2
/etc/gitlab/gitlab.rb.save.1
/etc/gitlab/gitlab-secrets.json
Configuration backup archive complete: /etc/gitlab/config_backup/gitlab_config_1656616597_2022_06_30.tar
Keeping all older configuration backups
Unpacking gitlab-ee (14.10.4-ee.0) over (14.10.0-ee.0) ...
dpkg: error processing archive /var/cache/apt/archives/gitlab-ee_14.10.4-ee.0_amd64.deb (--unpack):
cannot copy extracted data for './opt/gitlab/embedded/service/mattermost/prepackaged_plugins/mattermost-plugin-playbooks-v1.25.0-linux-amd64.tar.gz' to '/opt/gitlab/embedded/service/mattermost/prepackaged_plugins/mattermost-plugin-playbooks-v1.25.0-linux-amd64.tar.gz.dpkg-new': failed to write (No space left on device)
No apport report written because the error message indicates a disk full error
dpkg-deb: error: paste subprocess was killed by signal (Broken pipe)
Errors were encountered while processing:
/var/cache/apt/archives/gitlab-ee_14.10.4-ee.0_amd64.deb
E: Sub-process /usr/bin/dpkg returned an error code (1)df -i:
Filesystem Inodes IUsed IFree IUse% Mounted on
udev 230554 433 230121 1% /dev
tmpfs 236426 687 235739 1% /run
/dev/mapper/ubuntu--vg-ubuntu--lv 655360 229783 425577 36% /
tmpfs 236426 5 236421 1% /dev/shm
tmpfs 236426 3 236423 1% /run/lock
tmpfs 236426 19 236407 1% /sys/fs/cgroup
tmpfs 236426 1 236425 1% /run/shm
/dev/sda2 65536 312 65224 1% /boot
/dev/mapper/ubuntu--vg-ubuntu--lv--var 2621440 34829 2586611 2% /var
/dev/sda1 0 0 0 - /boot/efi
/dev/loop0 12849 12849 0 100% /snap/core/13308
/dev/loop1 10849 10849 0 100% /snap/core18/2344
/dev/loop3 11789 11789 0 100% /snap/core20/1494
/dev/loop2 802 802 0 100% /snap/lxd/22753
/dev/loop4 10857 10857 0 100% /snap/core18/2409
/dev/loop5 12848 12848 0 100% /snap/core/13250
/dev/loop6 11789 11789 0 100% /snap/core20/1518
/dev/loop7 799 799 0 100% /snap/lxd/22526
tmpfs 498570 22 498548 1% /run/user/1000df:
Filesystem 1K-blocks Used Available Use% Mounted on
udev 922216 0 922216 0% /dev
tmpfs 189144 6000 183144 4% /run
/dev/mapper/ubuntu--vg-ubuntu--lv 10255636 7610864 2104100 79% /
tmpfs 945704 28 945676 1% /dev/shm
tmpfs 5120 0 5120 0% /run/lock
tmpfs 945704 0 945704 0% /sys/fs/cgroup
tmpfs 945704 0 945704 0% /run/shm
/dev/sda2 999320 221688 708820 24% /boot
/dev/mapper/ubuntu--vg-ubuntu--lv--var 41153760 20512712 18716276 53% /var
/dev/sda1 523248 5356 517892 2% /boot/efi
/dev/loop0 116736 116736 0 100% /snap/core/13308
/dev/loop1 56960 56960 0 100% /snap/core18/2344
/dev/loop3 63488 63488 0 100% /snap/core20/1494
/dev/loop2 69504 69504 0 100% /snap/lxd/22753
/dev/loop4 56960 56960 0 100% /snap/core18/2409
/dev/loop5 114432 114432 0 100% /snap/core/13250
/dev/loop6 63488 63488 0 100% /snap/core20/1518
/dev/loop7 69632 69632 0 100% /snap/lxd/22526
tmpfs 189140 0 189140 0% /run/user/1000