Switch from gzip compression to xz compression for packages
Summary
Chef omnibus defaults to using gzip compression for deb and rpm packages, but support xz compression. We should switch to XZ compression.
Proposal
- Confirm that our supported distros will all support xz compressed debs and rpms
- Update the
compressor_type
used in debs and rpms in https://gitlab.com/gitlab-org/omnibus-gitlab/-/blob/master/config/projects/gitlab.rb - Try to determine how much extra time xz compression is adding to our builds vs gzip
References
Prior investigation shows this should provide about a 19% decrease in package size: #6292 (comment 669691295)
Designs
- Show closed items
Activity
-
Newest first Oldest first
-
Show all activity Show comments only Show history only
- DJ Mountney changed milestone to %Next 1-3 releases
changed milestone to %Next 1-3 releases
- DJ Mountney marked this issue as related to #6292
marked this issue as related to #6292
- DJ Mountney marked this issue as related to #6386 (closed)
marked this issue as related to #6386 (closed)
- Ryan Egesdahl created branch
8197-switch-from-gzip-compression-to-xz-compression-for-packages
to address this issuecreated branch
8197-switch-from-gzip-compression-to-xz-compression-for-packages
to address this issue - Ryan Egesdahl mentioned in merge request !7128 (merged)
mentioned in merge request !7128 (merged)
- Developer
Regarding (1), "[c]onfirm that our supported distros will all support xz compressed debs and rpms":
- For RPM-based distros, they need to have RPM 4.7 or above and have support compiled-in. This has been the case for RedHat distros since at least CentOS 7/RHEL 7/Fedora 19+20, so it's definitely the case now. For SLES, it's been the case since at least 2007.
- For DEB distros,
dpkg
has had support since 2007 and Debian made it the default for all packages in the base repositories in either 2009 or 2010.
I think we're likely safe. However, should we find that some weird distro doesn't support it for some reason, it's very likely an extreme minority use case that we can easily override in
config/projects/gitlab.rb
.Edited by Ryan Egesdahl - DJ Mountney assigned to @deriamis
assigned to @deriamis
- DJ Mountney changed milestone to %16.4
changed milestone to %16.4
- Ryan Egesdahl added release post item label
added release post item label
- Maintainer
This issue is scheduled for completion in this milestone but is not yet in development. Changing health status to 'needs attention'.
Issue participants are welcome to override this by setting the health status to another value.
- 🤖 GitLab Bot 🤖 changed health status to needs attention
changed health status to needs attention
- Ryan Egesdahl added workflowin dev label
added workflowin dev label
- Ryan Egesdahl changed health status to on track
changed health status to on track
- Maintainer
This issue is scheduled for completion in this milestone but is in an early development stage. Changing health status to 'at risk'.
Issue participants are welcome to override this by setting the health status to another value.
- 🤖 GitLab Bot 🤖 changed health status to at risk
changed health status to at risk
- 🤖 GitLab Bot 🤖 mentioned in issue gitlab-org/quality/triage-reports#14146 (closed)
mentioned in issue gitlab-org/quality/triage-reports#14146 (closed)
- Vishal Patel added quad-planningcomplete-no-action label
added quad-planningcomplete-no-action label
- 🤖 GitLab Bot 🤖 changed milestone to %16.5
changed milestone to %16.5
- 🤖 GitLab Bot 🤖 added missed-deliverable missed:16.4 labels
added missed-deliverable missed:16.4 labels
- Maintainer
Setting health status to
on track
as the milestone has just begun.Issue participants are welcome to override this by setting the health status to another value.
- 🤖 GitLab Bot 🤖 changed health status to on track
changed health status to on track
- Balasankar 'Balu' C closed with merge request !7128 (merged)
closed with merge request !7128 (merged)
- 🤖 GitLab Bot 🤖 added workflowcomplete label and removed workflowin dev label
added workflowcomplete label and removed workflowin dev label
- Balasankar 'Balu' C mentioned in commit a6fe72df
mentioned in commit a6fe72df
- Author Contributor
#8222 (closed) was logged as a followup to investigate getting this working for rpm packages as well
- DJ Mountney mentioned in merge request gitlab-com/www-gitlab-com!130218 (merged)
mentioned in merge request gitlab-com/www-gitlab-com!130218 (merged)
This change should be mentioned in version-specific changes and manual signature verification docs should also be updated to reflect new file extensions. Took me long enough to ensure Gitlab binaries for 16.5 aren't compromised.