Error budget by component for groups with puma-apdex
This shows the improvement for the groups with the top 4 puma traffic, that do not have other components feeding into the budget than Sidekiq & Puma.
We've excluded groups with other SLIs because the raw numbers are harder to find in logs. The difference between the availability number calculated from the logs and from the metrics can mostly be explained by the window of time that is being looked at.
group_name | Overall budget | puma-apdex-traffic-share | Dashboard | Sidekiq jobs | Failed Jobs | Jobs meeting apdex | Requests | Failed Requests | Requests meeting 1s apdex | 7 day availability from logs | Requests meeting 5s threshold | 7d availability with 5s request apdex threhsold | Improvement |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
{"product_stage"=>"create", "stage_group"=>"source_code"} | 99.90% | 54.33% | https://dashboards.gitlab.net/d/stage-groups-source_code/stage-groups-group-dashboard-create-source-code?orgId=1 | 106,738,892 | 24,964 | 106,611,876 | 2,371,514,741 | 45,642 | 2,367,052,720 | 99.9060% | 2,371,542,490 | 99.9966% | 0.09% |
{"product_stage"=>"manage", "stage_group"=>"access"} | 99.94% | 7.06% | https://dashboards.gitlab.net/d/stage-groups-access/stage-groups-group-dashboard-manage-access?orgId=1 | 2,317,844 | 2,687 | 2,313,773 | 349,615,061 | 254 | 349,150,292 | 99.9330% | 349,441,123 | 99.9743% | 0.04% |
{"product_stage"=>"create", "stage_group"=>"code_review"} | 99.74% | 4.96% | https://dashboards.gitlab.net/d/stage-groups-code_review/stage-groups-group-dashboard-create-code-review | 6,106,345 | 18,625 | 6,069,931 | 261,111,134 | 10,728 | 258,780,755 | 99.5516% | 261,016,167 | 99.9699% | 0.42% |
{"product_stage"=>"plan", "stage_group"=>"project_management"} | 99.51% | 3.99% | https://dashboards.gitlab.net/d/stage-groups-project_management/stage-groups-group-dashboard-plan-project-management?orgId=1 | 9,297,774 | 29,316 | 9265536 | 201,979,151 | 21,380 | 198,115,556 | 99.0660% | 201,817,560 | 99.9421% | 0.88% |
{"product_stage"=>"enablement", "stage_group"=>"global_search"} | 99.68% | 0.10% | https://dashboards.gitlab.net/d/stage-groups-global_search/stage-groups-group-dashboard-enablement-global-search?orgId=1 | 10,707,887 | 10,375 | 10,697,146 | 5,356,675 | 4,332 | 4,682,535 | 97.8226% | 5,171,670 | 99.3450% | 1.52% |
This shows that if we were to use a 5s request duration target, these groups can see a big improvement, I suspect that the improvement will become bigger for lower traffic groups.
Old table containing raw data from thanos
| group_name | | goserver-apdex | puma-apdex | sidekiq_execution-apdex | puma-error | server_route_manifest_writes-apdex | sidekiq_execution-error | storage-apdex | server-error | shared_runner_queues-apdex | loadbalancer-error | polling-error | proxy-apdex | goserver-error | imagescaler-apdex | trace_archiving_ci_jobs-error | gitalyruby-error | goserver_op_service-error | server-apdex | praefect_cloudsql-error | server_headers-apdex | proxy-error | replicator_queue-apdex | gitalyruby-apdex | server_route_manifest_reads-apdex | shared_runner_queues-error | grpc_requests-error | puma-apdex-traffic-share | |--------------------------------------------------------------------|--------------------|----------------|--------------------|-------------------------|--------------------|------------------------------------|-------------------------|--------------------|--------------------|----------------------------|--------------------|--------------------|-------------|----------------|--------------------|-------------------------------|------------------|---------------------------|--------------------|-------------------------|----------------------|-------------|------------------------|------------------|-----------------------------------|----------------------------|---------------------|----------------------------| | {"product_stage"=>"configure", "stage_group"=>"configure"} | 0.997672555392206 | * | 0.992616883136485 | 0.9994076137340727 | 0.999574673516231 | * | 0.9959818432948793 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.9999887904455631 | 0.00011387928409470997 | | {"product_stage"=>"plan", "stage_group"=>"certify"} | 0.884670237979676 | * | 0.9955266463685158 | 0.9996190210029013 | 1 | * | 0.7238562171525078 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.000027955193822001945 | | {"product_stage"=>"verify", "stage_group"=>"pipeline_authoring"} | 0.9981020390142619 | * | 0.9963424604598379 | * | 0.9998675509415841 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.0007035452874066749 | | {"product_stage"=>"create", "stage_group"=>"source_code"} | 0.9989915736422523 | * | 0.9981246944209732 | 0.9988654172363417 | 0.9999820736597211 | * | 0.9998530347941045 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.5432744351488293 | | {"product_stage"=>"manage", "stage_group"=>"import"} | 0.9977764152362285 | * | 0.9956910572852883 | 0.9960166534079078 | 0.9999815657688531 | * | 0.9991170371866986 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.000262993893121864 | | {"product_stage"=>"fulfillment", "stage_group"=>"license"} | 1 | * | NaN | 1 | NaN | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0 | | {"product_stage"=>"manage", "stage_group"=>"optimize"} | 0.9992715904170842 | * | 0.9963984975765989 | 0.9994930418823942 | 1 | * | 1 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.000009875742812438972 | | {"product_stage"=>"not_owned", "stage_group"=>"not_owned"} | 0.9974014605039448 | * | 0.994799606374258 | 0.9995699374957124 | 0.9999463349487521 | * | 0.997222354278296 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.07255420494733907 | | {"product_stage"=>"plan", "stage_group"=>"project_management"} | 0.9950580828039507 | * | 0.9812860896882459 | 0.9991873330008656 | 0.9999810470838202 | * | 0.9972694574496449 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.039899144515826025 | | {"product_stage"=>"secure", "stage_group"=>"static_analysis"} | 0.9980445057300935 | * | 0.9960516560156374 | 0.9996749428068713 | 1 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.000014735797496377088 | | {"product_stage"=>"verify", "stage_group"=>"runner"} | 0.9986561179613044 | * | 0.9882392983724925 | * | 0.9999351839934779 | * | * | * | * | 0.9980895463943535 | * | 0.9999870537776775 | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.9985312004343659 | * | 0.033313358264679335 | | {"product_stage"=>"manage", "stage_group"=>"workspace"} | 0.9876153934022066 | * | 0.9652453328187869 | 0.9995830717710027 | 0.999934734151663 | * | 0.9996788248340444 | * | * | * | * | * | * | * | 0.9970877348508003 | * | * | * | * | * | * | * | * | * | * | * | * | 0.012970082775123445 | | {"product_stage"=>"create", "stage_group"=>"editor"} | 0.992596333551596 | * | 0.9850920169012493 | * | 0.9999982473545966 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.0006759614417779988 | | {"product_stage"=>"release", "stage_group"=>"release"} | 0.9990731451986656 | * | 0.9967329862363719 | 0.9995641696600515 | 0.9999934614249301 | * | 0.9994758851165398 | * | 0.9998647831049438 | * | 0.9999780891382589 | * | * | * | * | * | * | * | 0.998032896725951 | * | 0.9990895062837122 | * | * | * | * | * | * | 0.06040719748672664 | | {"product_stage"=>"secure", "stage_group"=>"threat_insights"} | 0.9942434022426649 | * | 0.994358244023151 | 0.9990504268034138 | 0.9996147361674198 | * | 0.9645583537034222 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.0006098451493999463 | | {"product_stage"=>"manage", "stage_group"=>"compliance"} | 0.9987750930103622 | * | 0.997555429686748 | 0.9998049911205638 | 1 | * | 0.9352566909954783 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.0008851052425768647 | | {"product_stage"=>"protect", "stage_group"=>"container_security"} | 0.9999853642612848 | * | 1 | 0.9997032475313433 | 1 | * | 1 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.000000003729802724063807 | | {"product_stage"=>"growth", "stage_group"=>"product_intelligence"} | 0.9996897333715995 | * | 0.9993786336100726 | 0.9996699600985015 | 1 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.0034766164538961174 | | {"product_stage"=>"secure", "stage_group"=>"composition_analysis"} | 0.9989010175302361 | * | 0.997799964394129 | 0.9986748638268531 | 1 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.000016958570238011398 | | {"product_stage"=>"enablement", "stage_group"=>"global_search"} | 0.9967586111550479 | * | 0.8801242532856312 | 0.9996865534276377 | 0.9994605202606198 | * | 0.9991367023309103 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.0010059668001483294 | | {"product_stage"=>"fulfillment", "stage_group"=>"purchase"} | 0.972949026346594 | * | 0.9420380732745641 | * | 1 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.000006114343995650414 | | {"product_stage"=>"plan", "stage_group"=>"product_planning"} | 0.999396993860806 | * | 0.9979630792553207 | 0.9996712108576442 | 0.9999951528635627 | * | 1 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.000776752710710973 | | {"product_stage"=>"secure", "stage_group"=>"dynamic_analysis"} | 0.9998665921943978 | * | 0.9997411347857048 | 0.9997020877004695 | 1 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.00000005794347539527039 | | {"product_stage"=>"verify", "stage_group"=>"pipeline_execution"} | 0.9971664965285894 | * | 0.9828940342722196 | 0.9995009124281279 | 0.9999318897686338 | * | 0.9999150606120372 | * | * | * | * | * | * | * | * | 0.9999920520110663 | * | * | * | * | * | * | * | * | * | * | * | 0.08574186485920411 | | {"product_stage"=>"create", "stage_group"=>"code_review"} | 0.9973620475783047 | * | 0.9905890058333393 | 0.9953494057802293 | 0.9999831105216535 | * | 0.9983779758661511 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.04960928093737697 | | {"product_stage"=>"package", "stage_group"=>"package"} | 0.9994826379990674 | * | 0.9907328157672819 | 0.9988981585886192 | 0.9999986215761909 | 0.9984032477819231 | 0.9991201993993999 | 0.9994652512788077 | 0.9999995949239677 | * | * | * | * | * | * | * | * | * | 0.9984863156390721 | * | * | * | * | * | 0.9992094282864611 | * | * | 0.01323259690780681 | | {"product_stage"=>"monitor", "stage_group"=>"monitor"} | 0.9992701690032687 | * | 0.9985153956188145 | 0.9996970459515 | 0.9993159296205538 | * | 0.9999944686919443 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.00011899207956749168 | | {"product_stage"=>"growth", "stage_group"=>"expansion"} | NaN | * | NaN | * | NaN | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0 | | {"product_stage"=>"manage", "stage_group"=>"access"} | 0.9994064523449068 | * | 0.9988578024732075 | 0.9991872499268062 | 0.99999910266139 | * | 0.9999510656230571 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.07056294445053025 | | {"product_stage"=>"verify", "stage_group"=>"testing"} | 0.9983315544146858 | * | 0.9939310730176399 | 0.9995777910075996 | 0.9999786665410072 | * | 0.9998842939183104 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.002125893399751348 | | {"product_stage"=>"ecosystem", "stage_group"=>"integrations"} | 0.999220599382763 | * | 0.9968003623147332 | 0.9996051970778784 | 0.9997344560485119 | * | 0.9998270348854738 | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | * | 0.007069122959402035 |Edited by Bob Van Landuyt