Growth Acquisition Error Budget Investigation 01/2023
Context
We have exceeded Acquisition error budget on 16th January. This issue is to investigate possible causes and remediate this. Please create separate thread for discussion on specific cause that you discovered.
Link to Error Budget Grafana Dashboard: https://dashboards.gitlab.net/d/stage-groups-detail-acquisition/stage-groups-acquisition-group-error-budget-detail
Causes found:
-
Looking up for free to take "testX" path when user uses "test" as initial path. This will keep querying for free sequential number executing hundreds (thousands?) of queries until it finds the free one. Possible fix: gitlab-org/gitlab!108989 (merged)
ℹ Note this only applies to top slowest requests between 15s-25s durations and may not have effect on the other slow requests in range 1s to 5s.
Complete criteria
-
Merge and deploy change of the Registration endpoints urgency to :low
-
Merge and deploy fix for deep recurrent lookups for common names like "test"
Edited by Kamil Niechajewicz