Provide metrics that would help us to detect the potential N+1 CACHED SQL calls
Metrics
Controller#action
Request db_count and db_cached_count per controller#action last 5 days
Request db_count and db_cached_count per controller#action and root_namespace for last 5 days
Request db_cached_count per json_path (internal)
json.meta.caller_id.keyword: Descending | Count | Max json.db_cached_count | 50th percentile of json.db_cached_count | 95th percentile of json.db_cached_count |
---|---|---|---|---|
Import::BitbucketServerController#create | 433 | 2801 | 50 | 2669 |
Projects::GroupLinksController#create | 1312 | 6578 | 4.72727272727273 | 175.366666666665 |
Groups::GroupLinksController#update | 30 | 4220 | 14 | 614 |
Groups::GroupLinksController#create | 176 | 12496 | 9 | 251 |
Import::GitlabProjectsController#create | 1189 | 6483 | 3 | 275 |
GroupsController#transfer | 257 | 2829 | 14 | 218.199999999999 |
ProjectsController#transfer | 3349 | 6481 | 2 | 68.1249999999999 |
Projects::PipelinesController#create | 27331 | 6749 | 4 | 249.93861349154 |
Groups::IssuesController#bulk_update | 308 | 149 | 34.1666666666667 | 132 |
Projects::IssuesController#bulk_update | 2080 | 401 | 29 | 101 |
Groups::GroupLinksController#destroy | 25 | 620 | 9 | 281.75 |
Profiles::SlacksController#edit | 261 | 4975 | 0 | 118 |
Boards::IssuesController#bulk_move | 119 | 383 | 23 | 96.55 |
Groups::MergeRequestsController#bulk_update | 12 | 103 | 15 | 100.9 |
Projects::MergeRequestsController#bulk_update | 180 | 318 | 9.5 | 137 |
Groups::MilestonesController#destroy | 41 | 180 | 7 | 148.55 |
ProjectsController#create | 70887 | 12545 | 0 | 17.6502476190476 |
Projects::MilestonesController#destroy | 165 | 1713 | 3 | 49.25 |
Projects::ForksController#create | 3945 | 6470 | 0 | 14 |
Projects::GroupLinksController#destroy | 161 | 1310 | 6 | 41.1499999999999 |
Admin::UsersController#projects | 11 | 164 | 0 | 156.95 |
Groups::MilestonesController#labels | 28 | 233 | 7 | 51.1999999999996 |
GroupsController#update | 2155 | 3679 | 0 | 14.9642857142857 |
Projects::GroupLinksController#update | 155 | 473 | 2 | 37.5 |
Groups::EpicLinksController#create | 60 | 138 | 4 | 35 |
Groups::EpicLinksController#destroy | 16 | 68 | 9 | 51.8 |
Import::BitbucketController#create | 601 | 1126 | 0 | 52 |
Projects::IssuesController#move | 1338 | 303 | 10 | 18 |
Projects::DiscussionsController#resolve | 70435 | 135 | 10 | 20 |
Projects::DiscussionsController#unresolve | 3148 | 84 | 10 | 19 |
Sidekiq Workers metrics
Kibana - Sidekiq DB Cache calls per project
Sidekiq DB Cache calls per worker
json.class.keyword: Descending | Count | Max json.db_cached_count | 50th percentile of json.db_cached_count | 95th percentile of json.db_cached_count | 50th percentile of json.db_count | 95th percentile of json.db_count |
---|---|---|---|---|---|---|
ProjectExportWorker | 9,717 | 47,191 | 6 | 116.9 | 174.093 | 3,054.025 |
ExportCsvWorker | 353 | 31,867 | 85 | 1,976.6 | 106.5 | 2,008.2 |
ReactiveCachingWorker | 340,929 | 22,088 | 0 | 105.81 | 11 | 230.706 |
ExpireBuildArtifactsWorker | 59 | 10,700 | 0 | 10,615 | 0 | 74,412.15 |
UpdateMaxSeatsUsedForGitlabComSubscriptionsWorker | 1 | 7,070 | 7,070 | 7,070 | 52,579 | 52,579 |
UpdateMergeRequestsWorker | 308,722 | 6,686 | 14 | 69.381 | 153.965 | 411.817 |
PostReceive | 2,046,361 | 4,119 | 0 | 8 | 37 | 165.145 |
RepositoryUpdateMirrorWorker | 5,858,572 | 3,459 | 0 | 0 | 18 | 22 |
AutoMergeProcessWorker | 47,098 | 3,193 | 0 | 10.372 | 5 | 142.479 |
RunPipelineScheduleWorker | 300,901 | 2,880 | 0 | 44.419 | 25.481 | 183.008 |
UpdateExternalPullRequestsWorker | 68,853 | 2,062 | 0 | 0 | 3 | 3.058 |
PipelineHooksWorker | 2,706,120 | 1,963 | 3 | 18.462 | 22 | 51.002 |
VulnerabilityExports::ExportWorker | 9 | 1,667 | 556 | 1,667 | 1,173 | 2,585 |
NewMergeRequestWorker | 185,450 | 1,390 | 7 | 29.141 | 63 | 188.706 |
ElasticIndexInitialBulkCronWorker | 1,210 | 1,244 | 0 | 0 | 4 | 22 |
InvalidGpgSignatureUpdateWorker | 197 | 1,027 | 0 | 120 | 3 | 603 |
RepositoryImportWorker | 5,930 | 998 | 0 | 3 | 38 | 187.867 |
ActiveJob::QueueAdapters::SidekiqAdapter::JobWrapper | 3,023,049 | 887 | 4 | 16 | 24 | 47 |
ElasticIndexBulkCronWorker | 2,902 | 552 | 55.714 | 154.233 | 325.284 | 606 |
CreateCommitSignatureWorker | 38,410 | 500 | 2 | 12.482 | 12 | 42.96 |
Edited by Nikola Milojevic