2023-10: Error Budget and Infradev Monthly Report

Budget Spend Information

As per the error budget handbook page. You can see all previous error budget reports as child items in our Monthly Error Budget Reports epic.

Please see #27 (closed) for the previous month's spend.

Generated from data on 2023-10-01 00:00:00 UTC

Recent Changes and Work In Progress

We have been working on improving the availability reporting for GitLab.com and we are happy to announce that the 28-day values are reliable again. We have also been through the results and they are accurate.

Budget Spend by Stage Group

🔴 Over budget (under 99.95% availability)

Product Stage Stage Group Error Budget (28d) Error Budget (7d) Traffic Share (28d) Error Budget Issues Infradev Issues Incident Issues Notes
create source_code 99.94% 99.96% 18.79% 0 4 (1 past due) 0
verify pipeline_authoring 99.94% 99.92% 0.02% 2 1 1 (S3)
govern security_policies 99.91% 99.40% 0.51% 2 1 1 (S3) The bulk of the work for making a sidekiq workload more effecient has been done in gitlab!131554 (merged) + gitlab!131539 (merged), both applied on 2023-09-13. But 7d error budget is still below target, this might need looking into. Will the traffic share be back below 0.01%?
create code_creation 99.03% 98.61% 0.11% 1 0 0 This is caused by runway_ingress on the ai_gateway. But all ai_gateway/model_gateway apdexes took a turn for the worst around the 15th of september. Did something change?

🔶 Active exceptions

Product Stage Stage Group Error Budget (28d) Error Budget (7d) Traffic Share (28d) Error Budget Issues Infradev Issues Incident Issues Notes
data_stores global_search 99.91% 99.93% 0.16% 1 1 1 (S2)
data_stores tenant_scale 99.81% 99.78% 2.30% 17 2 (1 past due) 2 (S1, S1)

Within budget (over 99.95% availability)

Product Stage Stage Group Error Budget (28d) Error Budget (7d) Traffic Share (28d) Error Budget Issues Infradev Issues Incident Issues Notes
manage foundations 100.00% 100.00% 0.22% 0 0 0
growth acquisition 100.00% 100.00% 0.03% 0 0 0
systems gitaly 100.00% 100.00% 23.92% 0 0 0
secure static_analysis 100.00% 100.00% 0.04% 0 0 0
verify runner 99.99% 99.99% 4.43% 0 1 0
govern compliance 99.99% 99.99% 0.16% 2 0 0
secure composition_analysis 99.99% 99.98% 0.29% 0 0 0
verify pipeline_security 99.99% 99.99% 0.30% 1 0 0
package package_registry 99.99% 99.99% 1.11% 2 0 0
govern authentication_and_authorization 99.99% 99.99% 2.53% 1 0 0
govern threat_insights 99.98% 99.98% 0.05% 12 0 0
analyze analytics_instrumentation 99.98% 99.98% 0.03% 0 0 0
package container_registry 99.98% 99.98% 12.35% 0 0 0
verify pipeline_execution 99.98% 99.98% 9.89% 5 1 (1 past due) 0
plan knowledge 99.97% 99.97% 4.46% 4 1 0
deploy environments 99.97% 99.96% 6.21% 2 0 0
plan product_planning 99.96% 99.97% 0.03% 1 0 0
plan optimize 99.96% 99.98% 0.01% 0 0 0
plan project_management 99.95% 99.95% 1.17% 6 1 0
manage import_and_integrate 99.95% 99.96% 0.36% 5 1 0
create code_review 99.95% 99.97% 3.73% 0 0 0
not_owned not_owned 99.95% 99.95% 6.74% 0 0 0

🔷 Below traffic share threshold (under 0.01%)

Product Stage Stage Group Error Budget (28d) Error Budget (7d) Traffic Share (28d) Error Budget Issues Infradev Issues Incident Issues Notes
systems geo 100.00% 100.00% 0.00% 0 0 0
secure dynamic_analysis 100.00% 100.00% 0.00% 0 0 0
5-min-app 5-min-app 100.00% 100.00% 0.00% 0 0 0
govern anti-abuse 100.00% 99.96% 0.00% 1 2 (1 past due) 7 (S3, S3, S3, S3, S4, S4, S4)
growth activation 100.00% 0.00% 0.01% 0 0 0
create ide 99.99% 99.99% 0.01% 0 0 0
fulfillment utilization 99.97% 100.00% 0.00% 0 0 0
data_stores database 99.96% 99.97% 0.00% 0 0 0
analyze observability 99.93% 99.95% 0.00% 0 0 0
fulfillment purchase 99.93% 99.95% 0.01% 0 0 0
ai-powered ai_framework 99.84% 99.67% 0.00% 0 0 0
mobile mobile_devops 99.81% 99.87% 0.00% 0 0 0
monitor respond 99.75% 99.75% 0.01% 1 0 0
modelops mlops 99.73% 99.75% 0.00% 0 0 0
fulfillment fulfillment_platform 99.70% 99.73% 0.00% 0 1 (1 past due) 1 (S2)
fulfillment billing_and_subscription_management 99.66% 99.73% 0.00% 0 0 0
fulfillment provision 99.22% 99.71% 0.00% 3 0 0
analyze product_analytics 96.68% 85.09% 0.00% 0 0 0
ai-powered duo_chat 37.51% 51.85% 0.00% 0 0 0
platforms scalability 0.00% 0.00% 0.00% 0 0 0
no_code no_code_automation 0.00% 0.00% 0.00% 0 0 0
Edited by Rachel Nienaber