Skip to content

Provide metrics that would help us to detect the potential N+1 CACHED SQL calls

Metrics

Controller#action

Request db_count and db_cached_count per controller#action last 5 days

Request db_count and db_cached_count per controller#action and root_namespace for last 5 days

Request db_cached_count per json_path (internal)

json.meta.caller_id.keyword: Descending Count Max json.db_cached_count 50th percentile of json.db_cached_count 95th percentile of json.db_cached_count
Import::BitbucketServerController#create 433 2801 50 2669
Projects::GroupLinksController#create 1312 6578 4.72727272727273 175.366666666665
Groups::GroupLinksController#update 30 4220 14 614
Groups::GroupLinksController#create 176 12496 9 251
Import::GitlabProjectsController#create 1189 6483 3 275
GroupsController#transfer 257 2829 14 218.199999999999
ProjectsController#transfer 3349 6481 2 68.1249999999999
Projects::PipelinesController#create 27331 6749 4 249.93861349154
Groups::IssuesController#bulk_update 308 149 34.1666666666667 132
Projects::IssuesController#bulk_update 2080 401 29 101
Groups::GroupLinksController#destroy 25 620 9 281.75
Profiles::SlacksController#edit 261 4975 0 118
Boards::IssuesController#bulk_move 119 383 23 96.55
Groups::MergeRequestsController#bulk_update 12 103 15 100.9
Projects::MergeRequestsController#bulk_update 180 318 9.5 137
Groups::MilestonesController#destroy 41 180 7 148.55
ProjectsController#create 70887 12545 0 17.6502476190476
Projects::MilestonesController#destroy 165 1713 3 49.25
Projects::ForksController#create 3945 6470 0 14
Projects::GroupLinksController#destroy 161 1310 6 41.1499999999999
Admin::UsersController#projects 11 164 0 156.95
Groups::MilestonesController#labels 28 233 7 51.1999999999996
GroupsController#update 2155 3679 0 14.9642857142857
Projects::GroupLinksController#update 155 473 2 37.5
Groups::EpicLinksController#create 60 138 4 35
Groups::EpicLinksController#destroy 16 68 9 51.8
Import::BitbucketController#create 601 1126 0 52
Projects::IssuesController#move 1338 303 10 18
Projects::DiscussionsController#resolve 70435 135 10 20
Projects::DiscussionsController#unresolve 3148 84 10 19

Sidekiq Workers metrics

Kibana - Sidekiq DB Cache calls per project

Sidekiq DB Cache calls per worker

json.class.keyword: Descending Count Max json.db_cached_count 50th percentile of json.db_cached_count 95th percentile of json.db_cached_count 50th percentile of json.db_count 95th percentile of json.db_count
ProjectExportWorker 9,717 47,191 6 116.9 174.093 3,054.025
ExportCsvWorker 353 31,867 85 1,976.6 106.5 2,008.2
ReactiveCachingWorker 340,929 22,088 0 105.81 11 230.706
ExpireBuildArtifactsWorker 59 10,700 0 10,615 0 74,412.15
UpdateMaxSeatsUsedForGitlabComSubscriptionsWorker 1 7,070 7,070 7,070 52,579 52,579
UpdateMergeRequestsWorker 308,722 6,686 14 69.381 153.965 411.817
PostReceive 2,046,361 4,119 0 8 37 165.145
RepositoryUpdateMirrorWorker 5,858,572 3,459 0 0 18 22
AutoMergeProcessWorker 47,098 3,193 0 10.372 5 142.479
RunPipelineScheduleWorker 300,901 2,880 0 44.419 25.481 183.008
UpdateExternalPullRequestsWorker 68,853 2,062 0 0 3 3.058
PipelineHooksWorker 2,706,120 1,963 3 18.462 22 51.002
VulnerabilityExports::ExportWorker 9 1,667 556 1,667 1,173 2,585
NewMergeRequestWorker 185,450 1,390 7 29.141 63 188.706
ElasticIndexInitialBulkCronWorker 1,210 1,244 0 0 4 22
InvalidGpgSignatureUpdateWorker 197 1,027 0 120 3 603
RepositoryImportWorker 5,930 998 0 3 38 187.867
ActiveJob::QueueAdapters::SidekiqAdapter::JobWrapper 3,023,049 887 4 16 24 47
ElasticIndexBulkCronWorker 2,902 552 55.714 154.233 325.284 606
CreateCommitSignatureWorker 38,410 500 2 12.482 12 42.96
Edited by Nikola Milojevic