2025-10-05: GitLab.com Shared runners failing to upload and download artifacts

GitLab.com Shared runners failing to upload and download artifacts (Severity 2 (High))

Problem: Shared runners on GitLab.com failed to upload and download artifacts, causing jobs to hang and time out during the artifact upload/download phase.

Impact: All pipelines using shared GitLab.com runners were unable to upload or download job artifacts, which caused jobs to hang and eventually time out.

Causes: An unattended upgrade of HAProxy introduced a change that caused shared GitLab.com runners to fail artifact uploads and downloads. The gitlab-runner-helper artifacts-uploader process hung while attempting to upload or download job artifacts via the internal CI gateway service, where the affected HAProxy nodes run.

Response strategy: We reconfigured all CI runner shards to bypass the internal CI gateway. This restored artifact upload/download functionality for external users and internal users after applying the fix to staging. A permanent fix for HAProxy will be implemented in follow-up work.

---

This ticket was created to track INC-4485, by incident.io 🔥