2025-12-24: Blackbox probe availability for https://dev.gitlab.org below 74.17% in the last hour
Blackbox probe availability for https://dev.gitlab.org below 74.17% in the last hour (Severity 4)
Problem: The GitLab service on https://dev.gitlab.org became unavailable after a failed upgrade, with automated probes and user checks confirming the outage.
Impact: Users were unable to access https://dev.gitlab.org for up to an hour, with site availability dropping below 74.17%.
Causes: A failed nightly upgrade caused a database migration error due to a missing unique constraint in the deployments table. This led to multiple core components of the GitLab service on dev.gitlab.org shutting down.
Response strategy: We manually restarted all core GitLab components to restore service. Attempts to downgrade the package failed due to a malformed configuration file, so we placed a hold on the current package version to prevent further upgrade failures until a migration fix is available.
This ticket was created to track INC-6424, by incident.io