Alertmanager frequently fireing WorkhorseHighErrorRate since update to 11.9
Since we updated our GitLab installation to 11.9, Alertmanager frequently fires the WorkhorseHighErrorRate
alert. We're currently on 11.9.1-ee (b50dc44da0c)(Omnibus).
[1] Firing
Labels
alertname = WorkhorseHighErrorRate
method = head
Annotations
description = Postgres database had %!d(float64=12.499999999999998) queries canceled due to deadlocks in the last 5 minutes.
summary = Postgres database has queries canceled due to deadlocks
The method varies. We get this notification a few times about 30 minutes apart and then it stops for a few hours and occurs again. We have set up Grafana with GitLab, but it does not reveal anything unusual.
Additionally we noticed, that many NewMergeRequestWorker tasks are failing with the error Net::HTTPServerException: 403 "Forbidden"
.
Edited by johlandabee