Skip to content

postgres-checkup report for gitlab_production: 2020-02-18 (auto-generated)

PostgreSQL Checkup. Project: 'gitlab_production'. Database: 'gitlabhq_production'

Epoch number: '20200218001'

NOTICE: while most reports describe the “current database”, some of them may contain cluster-wide information describing all databases in the cluster.

Last modified at: 2020-02-18 02:35:59 +0000

 

Table of contents

A002 Version Information
A003 Postgres Settings
A004 Cluster Information
A005 Extensions
A006 Postgres Setting Deviations
A007 Altered Settings
D004 pg_stat_statements and pg_stat_kcache Settings
F001 Autovacuum: Current Settings
F002 Autovacuum: Transaction ID Wraparound Check
F003 Autovacuum: Dead Tuples
F004 Autovacuum: Heap Bloat (Estimated)
F005 Autovacuum: Btree Index Bloat (Estimated)
F008 Autovacuum: Resource Usage
G001 Memory-related Settings
G002 Connections and Current Activity
G003 Timeouts, Locks, Deadlocks
H001 Invalid Indexes
H002 Unused Indexes
H003 Non-indexed Foreign Keys
H004 Redundant Indexes
K001 Globally Aggregated Query Metrics
K002 Workload Type ("The First Word" Analysis)
K003 Top-20 Queries by total_time
L001 Table Sizes
L003 Integer (int2, int4) Out-of-range Risks in PKs

Issues found

The empty lines represent reports for which Conclusions and Recommendations are not yet implemented.

Report P1 P2 P3
A002 Version Information 0 2 1
A003 Postgres Settings
A004 Cluster Information
A005 Extensions
A006 Postgres Setting Deviations
A007 Altered Settings
D004 pg_stat_statements and pg_stat_kcache Settings
F001 Autovacuum: Current Settings 0 0 0
F002 Autovacuum: Transaction ID Wraparound Check 0 0 0
F003 Autovacuum: Dead Tuples
F004 Autovacuum: Heap Bloat (Estimated) 1 0 0
F005 Autovacuum: Btree Index Bloat (Estimated) 1 0 0
F008 Autovacuum: Resource Usage
G001 Memory-related Settings
G002 Connections and Current Activity 0 0 0
G003 Timeouts, Locks, Deadlocks
H001 Invalid Indexes
H002 Unused Indexes 0 0 1
H003 Non-indexed Foreign Keys
H004 Redundant Indexes 0 0 1
K001 Globally Aggregated Query Metrics
K002 Workload Type ("The First Word" Analysis)
K003 Top-20 Queries by total_time 1 0 0
L001 Table Sizes
L003 Integer (int2, int4) Out-of-range Risks in PKs 1 0 0

  Table of contents

A002 Version Information

Observations

Data collected: 2020-02-18 02:29:25 +0000 UTC

Master (10.220.16.106)

PostgreSQL 9.6.14 on x86_64-pc-linux-gnu (Ubuntu 9.6.14-1.pgdg16.04+1), compiled by gcc (Ubuntu 5.4.0-6ubuntu1~16.04.11) 5.4.0 20160609, 64-bit

Replica servers:

Replica (10.220.16.101)

PostgreSQL 9.6.15 on x86_64-pc-linux-gnu (Ubuntu 9.6.15-1.pgdg16.04+1), compiled by gcc (Ubuntu 5.4.0-6ubuntu1~16.04.11) 5.4.0 20160609, 64-bit

Replica (10.220.16.102)

PostgreSQL 9.6.14 on x86_64-pc-linux-gnu (Ubuntu 9.6.14-1.pgdg16.04+1), compiled by gcc (Ubuntu 5.4.0-6ubuntu1~16.04.11) 5.4.0 20160609, 64-bit

Replica (10.220.16.103)

PostgreSQL 9.6.14 on x86_64-pc-linux-gnu (Ubuntu 9.6.14-1.pgdg16.04+1), compiled by gcc (Ubuntu 5.4.0-6ubuntu1~16.04.11) 5.4.0 20160609, 64-bit

Replica (10.220.16.104)

PostgreSQL 9.6.14 on x86_64-pc-linux-gnu (Ubuntu 9.6.14-1.pgdg16.04+1), compiled by gcc (Ubuntu 5.4.0-6ubuntu1~16.04.11) 5.4.0 20160609, 64-bit

Replica (10.220.16.105)

PostgreSQL 9.6.14 on x86_64-pc-linux-gnu (Ubuntu 9.6.14-1.pgdg16.04+1), compiled by gcc (Ubuntu 5.4.0-6ubuntu1~16.04.11) 5.4.0 20160609, 64-bit

Replica (10.220.16.107)

PostgreSQL 9.6.15 on x86_64-pc-linux-gnu (Ubuntu 9.6.15-1.pgdg16.04+1), compiled by gcc (Ubuntu 5.4.0-6ubuntu1~16.04.11) 5.4.0 20160609, 64-bit

Replica (10.220.16.108)

PostgreSQL 9.6.15 on x86_64-pc-linux-gnu (Ubuntu 9.6.15-1.pgdg16.04+1), compiled by gcc (Ubuntu 5.4.0-6ubuntu1~16.04.11) 5.4.0 20160609, 64-bit

Replica (10.220.16.109)

PostgreSQL 9.6.15 on x86_64-pc-linux-gnu (Ubuntu 9.6.15-1.pgdg16.04+1), compiled by gcc (Ubuntu 5.4.0-6ubuntu1~16.04.11) 5.4.0 20160609, 64-bit

Conclusions

  • [P2] Postgres minor version on the master and replica(s) differ. Nodes 10.220.16.102, 10.220.16.105, 10.220.16.106, 10.220.16.109, 10.220.16.101, 10.220.16.103, 10.220.16.104, 10.220.16.107, 10.220.16.108 use Postgres 9.6.14, 9.6.15.

  • Postgres major version being used is 9.6 and it is currently supported by PostgreSQL Global Development Group. End of life is scheduled 2021-11-11. It means that in case of bugs and security issues, updates (new minor versions) with fixes will be released and available for use. Read more: Versioning Policy.

  • [P2] The minor versions being used (9.6.14, 9.6.15) are not up-to-date (the newest version: 9.6.17). See the full list of changes between 9.6.14 and 9.6.17 and between 9.6.15 and 9.6.17.

Recommendations

  Table of contents

A003 Postgres Settings

Observations

Data collected: 2020-02-18 02:29:25 +0000 UTC

Master (10.220.16.106)

▼ Category Setting Value Unit Pretty value
Autovacuum autovacuum on
Autovacuum autovacuum_analyze_scale_factor 0.005
Autovacuum autovacuum_analyze_threshold 50
Autovacuum autovacuum_freeze_max_age 200000000
Autovacuum autovacuum_max_workers 6
Autovacuum autovacuum_multixact_freeze_max_age 400000000
Autovacuum autovacuum_naptime 30 s
Autovacuum autovacuum_vacuum_cost_delay 5 ms
Autovacuum autovacuum_vacuum_cost_limit 6000
Autovacuum autovacuum_vacuum_scale_factor 0.005
Autovacuum autovacuum_vacuum_threshold 50
Client Connection Defaults / Locale and Formatting DateStyle ISO, MDY
Client Connection Defaults / Locale and Formatting IntervalStyle postgres
Client Connection Defaults / Locale and Formatting TimeZone GMT
Client Connection Defaults / Locale and Formatting client_encoding UTF8
Client Connection Defaults / Locale and Formatting default_text_search_config pg_catalog.english
Client Connection Defaults / Locale and Formatting extra_float_digits 0
Client Connection Defaults / Locale and Formatting lc_collate C.UTF-8
Client Connection Defaults / Locale and Formatting lc_ctype C.UTF-8
Client Connection Defaults / Locale and Formatting lc_messages C
Client Connection Defaults / Locale and Formatting lc_monetary C
Client Connection Defaults / Locale and Formatting lc_numeric C
Client Connection Defaults / Locale and Formatting lc_time C
Client Connection Defaults / Locale and Formatting server_encoding UTF8
Client Connection Defaults / Locale and Formatting timezone_abbreviations Default
Client Connection Defaults / Other Defaults dynamic_library_path $libdir
Client Connection Defaults / Other Defaults gin_fuzzy_search_limit 0
Client Connection Defaults / Other Defaults tcp_keepalives_count 9
Client Connection Defaults / Other Defaults tcp_keepalives_idle 300 s
Client Connection Defaults / Other Defaults tcp_keepalives_interval 75 s
Client Connection Defaults / Shared Library Preloading local_preload_libraries
Client Connection Defaults / Shared Library Preloading session_preload_libraries
Client Connection Defaults / Shared Library Preloading shared_preload_libraries pg_stat_statements
Client Connection Defaults / Statement Behavior bytea_output hex
Client Connection Defaults / Statement Behavior check_function_bodies on
Client Connection Defaults / Statement Behavior client_min_messages notice
Client Connection Defaults / Statement Behavior default_tablespace
Client Connection Defaults / Statement Behavior default_transaction_deferrable off
Client Connection Defaults / Statement Behavior default_transaction_isolation read committed
Client Connection Defaults / Statement Behavior default_transaction_read_only off
Client Connection Defaults / Statement Behavior gin_pending_list_limit 4096 kB 4.00 MiB
Client Connection Defaults / Statement Behavior idle_in_transaction_session_timeout 30000 ms
Client Connection Defaults / Statement Behavior lock_timeout 0 ms
Client Connection Defaults / Statement Behavior search_path "$user", public
Client Connection Defaults / Statement Behavior session_replication_role origin
Client Connection Defaults / Statement Behavior statement_timeout 15000 ms
Client Connection Defaults / Statement Behavior temp_tablespaces
Client Connection Defaults / Statement Behavior transaction_deferrable off
Client Connection Defaults / Statement Behavior transaction_isolation read committed
Client Connection Defaults / Statement Behavior transaction_read_only off
Client Connection Defaults / Statement Behavior vacuum_freeze_min_age 50000000
Client Connection Defaults / Statement Behavior vacuum_freeze_table_age 150000000
Client Connection Defaults / Statement Behavior vacuum_multixact_freeze_min_age 5000000
Client Connection Defaults / Statement Behavior vacuum_multixact_freeze_table_age 150000000
Client Connection Defaults / Statement Behavior xmlbinary base64
Client Connection Defaults / Statement Behavior xmloption content
Connections and Authentication / Connection Settings bonjour off
Connections and Authentication / Connection Settings bonjour_name
Connections and Authentication / Connection Settings listen_addresses 0.0.0.0
Connections and Authentication / Connection Settings max_connections 300
Connections and Authentication / Connection Settings port 5432
Connections and Authentication / Connection Settings superuser_reserved_connections 3
Connections and Authentication / Connection Settings unix_socket_directories /var/opt/gitlab/postgresql
Connections and Authentication / Connection Settings unix_socket_group
Connections and Authentication / Connection Settings unix_socket_permissions 0777
Connections and Authentication / Security and Authentication authentication_timeout 60 s
Connections and Authentication / Security and Authentication db_user_namespace off
Connections and Authentication / Security and Authentication krb_caseins_users off
Connections and Authentication / Security and Authentication krb_server_keyfile FILE:/etc/postgresql-common/krb5.keytab
Connections and Authentication / Security and Authentication password_encryption on
Connections and Authentication / Security and Authentication row_security on
Connections and Authentication / Security and Authentication ssl on
Connections and Authentication / Security and Authentication ssl_ca_file
Connections and Authentication / Security and Authentication ssl_cert_file /var/opt/gitlab/postgresql/server.crt
Connections and Authentication / Security and Authentication ssl_ciphers HIGH:MEDIUM:+3DES:!aNULL:!SSLv3:!TLSv1
Connections and Authentication / Security and Authentication ssl_crl_file
Connections and Authentication / Security and Authentication ssl_ecdh_curve prime256v1
Connections and Authentication / Security and Authentication ssl_key_file /var/opt/gitlab/postgresql/server.key
Connections and Authentication / Security and Authentication ssl_prefer_server_ciphers on
Customized Options pg_stat_statements.max 5000
Customized Options pg_stat_statements.save on
Customized Options pg_stat_statements.track top
Customized Options pg_stat_statements.track_utility on
Developer Options allow_system_table_mods off
Developer Options ignore_checksum_failure off
Developer Options ignore_system_indexes off
Developer Options post_auth_delay 0 s
Developer Options pre_auth_delay 0 s
Developer Options trace_notify off
Developer Options trace_recovery_messages log
Developer Options trace_sort off
Developer Options zero_damaged_pages off
Error Handling data_sync_retry off
Error Handling exit_on_error off
Error Handling restart_after_crash on
File Locations config_file /var/opt/gitlab/postgresql/postgresql.conf
File Locations data_directory /var/opt/gitlab/postgresql/data
File Locations external_pid_file
File Locations hba_file /var/opt/gitlab/postgresql/data/pg_hba.conf
File Locations ident_file /var/opt/gitlab/postgresql/pg_ident.conf
Lock Management deadlock_timeout 5000 ms
Lock Management max_locks_per_transaction 128
Lock Management max_pred_locks_per_transaction 64
Preset Options block_size 8192
Preset Options data_checksums off
Preset Options debug_assertions off
Preset Options integer_datetimes on
Preset Options max_function_args 100
Preset Options max_identifier_length 63
Preset Options max_index_keys 32
Preset Options segment_size 131072 8kB 1.00 GiB
Preset Options server_version 9.6.14
Preset Options server_version_num 90614
Preset Options wal_block_size 8192
Preset Options wal_segment_size 2048 8kB 16.00 MiB
Process Title cluster_name pg-ha-cluster
Process Title update_process_title on
Query Tuning / Genetic Query Optimizer geqo on
Query Tuning / Genetic Query Optimizer geqo_effort 5
Query Tuning / Genetic Query Optimizer geqo_generations 0
Query Tuning / Genetic Query Optimizer geqo_pool_size 0
Query Tuning / Genetic Query Optimizer geqo_seed 0
Query Tuning / Genetic Query Optimizer geqo_selection_bias 2
Query Tuning / Genetic Query Optimizer geqo_threshold 12
Query Tuning / Other Planner Options constraint_exclusion partition
Query Tuning / Other Planner Options cursor_tuple_fraction 0.1
Query Tuning / Other Planner Options default_statistics_target 1000
Query Tuning / Other Planner Options force_parallel_mode off
Query Tuning / Other Planner Options from_collapse_limit 8
Query Tuning / Other Planner Options join_collapse_limit 8
Query Tuning / Planner Cost Constants cpu_index_tuple_cost 0.005
Query Tuning / Planner Cost Constants cpu_operator_cost 0.0025
Query Tuning / Planner Cost Constants cpu_tuple_cost 0.01
Query Tuning / Planner Cost Constants effective_cache_size 43352064 8kB 330.75 GiB
Query Tuning / Planner Cost Constants min_parallel_relation_size 1024 8kB 8.00 MiB
Query Tuning / Planner Cost Constants parallel_setup_cost 1000
Query Tuning / Planner Cost Constants parallel_tuple_cost 0.1
Query Tuning / Planner Cost Constants random_page_cost 1.5
Query Tuning / Planner Cost Constants seq_page_cost 4
Query Tuning / Planner Method Configuration enable_bitmapscan on
Query Tuning / Planner Method Configuration enable_hashagg on
Query Tuning / Planner Method Configuration enable_hashjoin on
Query Tuning / Planner Method Configuration enable_indexonlyscan on
Query Tuning / Planner Method Configuration enable_indexscan on
Query Tuning / Planner Method Configuration enable_material on
Query Tuning / Planner Method Configuration enable_mergejoin on
Query Tuning / Planner Method Configuration enable_nestloop on
Query Tuning / Planner Method Configuration enable_seqscan on
Query Tuning / Planner Method Configuration enable_sort on
Query Tuning / Planner Method Configuration enable_tidscan on
Replication track_commit_timestamp off
Replication / Master Server synchronous_standby_names
Replication / Master Server vacuum_defer_cleanup_age 0
Replication / Sending Servers max_replication_slots 32
Replication / Sending Servers max_wal_senders 32
Replication / Sending Servers wal_keep_segments 2048
Replication / Sending Servers wal_sender_timeout 60000 ms
Replication / Standby Servers hot_standby on
Replication / Standby Servers hot_standby_feedback on
Replication / Standby Servers max_standby_archive_delay 30000 ms
Replication / Standby Servers max_standby_streaming_delay 30000 ms
Replication / Standby Servers wal_receiver_status_interval 10 s
Replication / Standby Servers wal_receiver_timeout 60000 ms
Replication / Standby Servers wal_retrieve_retry_interval 5000 ms
Reporting and Logging / What to Log application_name checkup
Reporting and Logging / What to Log debug_pretty_print on
Reporting and Logging / What to Log debug_print_parse off
Reporting and Logging / What to Log debug_print_plan off
Reporting and Logging / What to Log debug_print_rewritten off
Reporting and Logging / What to Log log_autovacuum_min_duration 0 ms
Reporting and Logging / What to Log log_checkpoints on
Reporting and Logging / What to Log log_connections on
Reporting and Logging / What to Log log_disconnections on
Reporting and Logging / What to Log log_duration off
Reporting and Logging / What to Log log_error_verbosity default
Reporting and Logging / What to Log log_hostname off
Reporting and Logging / What to Log log_line_prefix %m [%p, %x]: [%l-1] user=%u, db=%d, app=%a, client=%h
Reporting and Logging / What to Log log_lock_waits on
Reporting and Logging / What to Log log_replication_commands off
Reporting and Logging / What to Log log_statement ddl
Reporting and Logging / What to Log log_temp_files 0 kB 0.00 bytes
Reporting and Logging / What to Log log_timezone GMT
Reporting and Logging / When to Log log_min_duration_statement 1000 ms
Reporting and Logging / When to Log log_min_error_statement error
Reporting and Logging / When to Log log_min_messages warning
Reporting and Logging / Where to Log event_source PostgreSQL
Reporting and Logging / Where to Log log_destination stderr
Reporting and Logging / Where to Log log_directory /var/log/gitlab/postgresql
Reporting and Logging / Where to Log log_file_mode 0640
Reporting and Logging / Where to Log log_filename postgresql.log
Reporting and Logging / Where to Log log_rotation_age 0 min
Reporting and Logging / Where to Log log_rotation_size 0 kB 0.00 bytes
Reporting and Logging / Where to Log log_truncate_on_rotation off
Reporting and Logging / Where to Log logging_collector on
Reporting and Logging / Where to Log syslog_facility local0
Reporting and Logging / Where to Log syslog_ident postgres
Reporting and Logging / Where to Log syslog_sequence_numbers on
Reporting and Logging / Where to Log syslog_split_messages on
Resource Usage / Asynchronous Behavior backend_flush_after 0 8kB 0.00 bytes
Resource Usage / Asynchronous Behavior effective_io_concurrency 100
Resource Usage / Asynchronous Behavior max_parallel_workers_per_gather 0
Resource Usage / Asynchronous Behavior max_worker_processes 8
Resource Usage / Asynchronous Behavior old_snapshot_threshold -1 min
Resource Usage / Background Writer bgwriter_delay 200 ms
Resource Usage / Background Writer bgwriter_flush_after 64 8kB 512.00 KiB
Resource Usage / Background Writer bgwriter_lru_maxpages 100
Resource Usage / Background Writer bgwriter_lru_multiplier 2
Resource Usage / Cost-Based Vacuum Delay vacuum_cost_delay 0 ms
Resource Usage / Cost-Based Vacuum Delay vacuum_cost_limit 200
Resource Usage / Cost-Based Vacuum Delay vacuum_cost_page_dirty 20
Resource Usage / Cost-Based Vacuum Delay vacuum_cost_page_hit 1
Resource Usage / Cost-Based Vacuum Delay vacuum_cost_page_miss 10
Resource Usage / Disk temp_file_limit -1 kB
Resource Usage / Kernel Resources max_files_per_process 1000
Resource Usage / Memory autovacuum_work_mem -1 kB
Resource Usage / Memory dynamic_shared_memory_type posix
Resource Usage / Memory huge_pages try
Resource Usage / Memory maintenance_work_mem 2097152 kB 2.00 GiB
Resource Usage / Memory max_prepared_transactions 0
Resource Usage / Memory max_stack_depth 2048 kB 2.00 MiB
Resource Usage / Memory replacement_sort_tuples 150000
Resource Usage / Memory shared_buffers 14450688 8kB 110.25 GiB
Resource Usage / Memory temp_buffers 1024 8kB 8.00 MiB
Resource Usage / Memory track_activity_query_size 1024
Resource Usage / Memory work_mem 102400 kB 100.00 MiB
Statistics / Monitoring log_executor_stats off
Statistics / Monitoring log_parser_stats off
Statistics / Monitoring log_planner_stats off
Statistics / Monitoring log_statement_stats off
Statistics / Query and Index Statistics Collector stats_temp_directory pg_stat_tmp
Statistics / Query and Index Statistics Collector track_activities on
Statistics / Query and Index Statistics Collector track_counts on
Statistics / Query and Index Statistics Collector track_functions none
Statistics / Query and Index Statistics Collector track_io_timing on
Version and Platform Compatibility / Other Platforms and Clients transform_null_equals off
Version and Platform Compatibility / Previous PostgreSQL Versions array_nulls on
Version and Platform Compatibility / Previous PostgreSQL Versions backslash_quote safe_encoding
Version and Platform Compatibility / Previous PostgreSQL Versions default_with_oids off
Version and Platform Compatibility / Previous PostgreSQL Versions escape_string_warning on
Version and Platform Compatibility / Previous PostgreSQL Versions lo_compat_privileges off
Version and Platform Compatibility / Previous PostgreSQL Versions operator_precedence_warning off
Version and Platform Compatibility / Previous PostgreSQL Versions quote_all_identifiers off
Version and Platform Compatibility / Previous PostgreSQL Versions sql_inheritance on
Version and Platform Compatibility / Previous PostgreSQL Versions standard_conforming_strings on
Version and Platform Compatibility / Previous PostgreSQL Versions synchronize_seqscans on
Write-Ahead Log / Archiving archive_command /usr/bin/envdir /etc/wal-e.d/env /opt/wal-e/bin/wal-e wal-push %p
Write-Ahead Log / Archiving archive_mode on
Write-Ahead Log / Archiving archive_timeout 60 s
Write-Ahead Log / Checkpoints checkpoint_completion_target 0.7
Write-Ahead Log / Checkpoints checkpoint_flush_after 32 8kB 256.00 KiB
Write-Ahead Log / Checkpoints checkpoint_timeout 300 s
Write-Ahead Log / Checkpoints checkpoint_warning 30 s
Write-Ahead Log / Checkpoints max_wal_size 320 16MB 5.00 GiB
Write-Ahead Log / Checkpoints min_wal_size 5 16MB 80.00 MiB
Write-Ahead Log / Settings commit_delay 0
Write-Ahead Log / Settings commit_siblings 5
Write-Ahead Log / Settings fsync on
Write-Ahead Log / Settings full_page_writes on
Write-Ahead Log / Settings synchronous_commit on
Write-Ahead Log / Settings wal_buffers 2048 8kB 16.00 MiB
Write-Ahead Log / Settings wal_compression off
Write-Ahead Log / Settings wal_level replica
Write-Ahead Log / Settings wal_log_hints on
Write-Ahead Log / Settings wal_sync_method fdatasync
Write-Ahead Log / Settings wal_writer_delay 200 ms
Write-Ahead Log / Settings wal_writer_flush_after 128 8kB 1.00 MiB

  Table of contents

A004 Cluster Information

Observations

Data collected: 2020-02-18 02:29:26 +0000 UTC

▼ Indicator 10.220.16.106 10.220.16.101 10.220.16.102 10.220.16.103 10.220.16.104 10.220.16.105 10.220.16.107 10.220.16.108 10.220.16.109
Config file /var/opt/gitlab/postgresql/postgresql.conf /var/opt/gitlab/postgresql/postgresql.conf /var/opt/gitlab/postgresql/postgresql.conf /var/opt/gitlab/postgresql/postgresql.conf /var/opt/gitlab/postgresql/postgresql.conf /var/opt/gitlab/postgresql/postgresql.conf /var/opt/gitlab/postgresql/postgresql.conf /var/opt/gitlab/postgresql/postgresql.conf /var/opt/gitlab/postgresql/postgresql.conf
Role Master Replica (delay: 00:00:00; paused: false) Replica (delay: 00:00:00; paused: false) Replica (delay: 00:00:00; paused: false) Replica (delay: 00:00:00; paused: false) Replica (delay: 00:00:00; paused: false) Replica (delay: 00:00:00; paused: false) Replica (delay: 00:00:00; paused: false) Replica (delay: 00:00:00; paused: false)
Replicas async/streaming: 10.220.16.107, 10.220.16.102, 10.220.16.104, 10.220.16.101, 10.220.16.110, 10.220.16.103, 10.220.16.105, 10.220.16.111, 10.220.16.108, 10.220.16.109, 10.220.16.112
Started At 2019-10-28 16:07:17+00 2019-12-12 07:32:00+00 2019-12-12 07:32:03+00 2019-12-12 07:32:05+00 2019-12-12 07:32:03+00 2019-12-12 07:32:09+00 2019-12-12 07:31:59+00 2019-12-12 07:32:09+00 2019-12-12 07:32:10+00
Uptime 112 days 10:20:21 67 days 18:53:13 67 days 18:53:38 67 days 18:54:05 67 days 18:54:36 67 days 18:54:59 67 days 18:56:27 67 days 18:56:47 67 days 18:57:17
Checkpoints 67844 1036212 1048978 1044838 1044169 1044409 1036445 1034950 1036570
Forced Checkpoints 78.8% 99.7% 99.7% 99.7% 99.7% 99.7% 99.7% 99.7% 99.7%
Checkpoint MB/sec 12.545464 14.054580 14.057124 14.057486 14.057826 14.057754 14.055094 14.054728 14.054611
Database Name gitlabhq_production gitlabhq_production gitlabhq_production gitlabhq_production gitlabhq_production gitlabhq_production gitlabhq_production gitlabhq_production gitlabhq_production
Database Size 5265 GB 5265 GB 5265 GB 5265 GB 5265 GB 5265 GB 5265 GB 5265 GB 5265 GB
Stats Since 2019-10-28 16:07:35+00 2019-12-12 07:32:12+00 2019-12-12 07:32:11+00 2019-12-12 07:32:13+00 2019-12-12 07:32:12+00 2019-12-12 07:32:20+00 2019-12-12 07:32:11+00 2019-12-12 07:32:21+00 2019-12-12 07:32:25+00
Stats Age 112 days 10:20:03 67 days 18:53:01 67 days 18:53:29 67 days 18:53:57 67 days 18:54:26 67 days 18:54:48 67 days 18:56:14 67 days 18:56:35 67 days 18:57:02
Cache Effectiveness 99.35% 99.70% 99.71% 99.71% 99.72% 99.72% 99.70% 99.71% 99.71%
Successful Commits 99.70% 100.00% 100.00% 100.00% 100.00% 100.00% 100.00% 100.00% 100.00%
Conflicts 4 2 0 0 0 0 0 0 0
Temp Files: total size 729 GB 4046 GB 4093 GB 3983 GB 3974 GB 4059 GB 4040 GB 4010 GB 4024 GB
Temp Files: total number of files 4803 28001 28468 26842 27307 28423 26801 28196 28322
Temp Files: total number of files per day 42 411 418 394 401 417 394 414 416
Temp Files: avg file size 155 MB 148 MB 147 MB 152 MB 149 MB 146 MB 154 MB 146 MB 146 MB
Deadlocks 938 0 0 0 0 0 0 0 0
Deadlocks per day 8 0 0 0 0 0 0 0 0

Databases sizes

Database ▼ Size
gitlabhq_production 5.15 TiB
postgres 6.99 MiB
template1 6.94 MiB
template0 6.93 MiB

Conclusions

Recommendations

  Table of contents

A005 Extensions

Observations

Data collected: 2020-02-18 02:29:26 +0000 UTC

Master (10.220.16.106)

▼ Database Extension name Installed version Default version Is old
gitlabhq_production btree_gin 1.0 1.0
gitlabhq_production dblink 1.2 1.2
gitlabhq_production pageinspect 1.5 1.5
gitlabhq_production pg_buffercache 1.2 1.2
gitlabhq_production pg_repack 1.4.4 1.4.4
gitlabhq_production pg_stat_statements 1.4 1.4
gitlabhq_production pg_trgm 1.3 1.3
gitlabhq_production pgstattuple 1.4 1.4
gitlabhq_production plpgsql 1.0 1.0

Conclusions

Recommendations

  Table of contents

A006 Postgres Setting Deviations

Observations

Data collected: 2020-02-18 02:29:27 +0000 UTC

Settings (pg_settings) that Differ

▼ Setting 10.220.16.106 10.220.16.101 10.220.16.102 10.220.16.103 10.220.16.104 10.220.16.105 10.220.16.107 10.220.16.108 10.220.16.109
server_version 9.6.14 9.6.15 9.6.14 9.6.14 9.6.14 9.6.14 9.6.15 9.6.15 9.6.15
server_version_num 90614 90615 90614 90614 90614 90614 90615 90615 90615

Configs(pg_config) that differ

▼ Config 10.220.16.106 10.220.16.101 10.220.16.102 10.220.16.103 10.220.16.104 10.220.16.105 10.220.16.107 10.220.16.108 10.220.16.109
CONFIGURE '--build=x86_64-linux-gnu' '--prefix=/usr' '--includedir=/usr/include' '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--sysconfdir=/etc' '--localstatedir=/var' '--disable-silent-rules' '--libdir=/usr/lib/x86_64-linux-gnu' '--libexecdir=/usr/lib/x86_64-linux-gnu' '--disable-maintainer-mode' '--disable-dependency-tracking' '--with-tcl' '--with-perl' '--with-python' '--with-pam' '--with-openssl' '--with-libxml' '--with-libxslt' 'PYTHON=/usr/bin/python' '--mandir=/usr/share/postgresql/9.6/man' '--docdir=/usr/share/doc/postgresql-doc-9.6' '--sysconfdir=/etc/postgresql-common' '--datarootdir=/usr/share/' '--datadir=/usr/share/postgresql/9.6' '--bindir=/usr/lib/postgresql/9.6/bin' '--libdir=/usr/lib/x86_64-linux-gnu/' '--libexecdir=/usr/lib/postgresql/' '--includedir=/usr/include/postgresql/' '--enable-nls' '--enable-integer-datetimes' '--enable-thread-safety' '--enable-tap-tests' '--enable-debug' '--enable-dtrace' '--disable-rpath' '--with-uuid=e2fs' '--with-gnu-ld' '--with-pgport=5432' '--with-system-tzdata=/usr/share/zoneinfo' '--with-systemd' '--with-selinux' 'MKDIR_P=/bin/mkdir -p' 'TAR=/bin/tar' 'CFLAGS=-g -O2 -fstack-protector-strong -Wformat -Werror=format-security -fPIC -pie -fno-omit-frame-pointer' 'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now' 'DPKG_VERSION=9.6.14-1.pgdg16.04+1' 'DPKG_VENDOR=Ubuntu' '--with-gssapi' '--with-ldap' '--with-includes=/usr/include/mit-krb5' '--with-libs=/usr/lib/mit-krb5' '--with-libs=/usr/lib/x86_64-linux-gnu/mit-krb5' 'build_alias=x86_64-linux-gnu' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' '--build=x86_64-linux-gnu' '--prefix=/usr' '--includedir=/usr/include' '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--sysconfdir=/etc' '--localstatedir=/var' '--disable-silent-rules' '--libdir=/usr/lib/x86_64-linux-gnu' '--libexecdir=/usr/lib/x86_64-linux-gnu' '--disable-maintainer-mode' '--disable-dependency-tracking' '--with-tcl' '--with-perl' '--with-python' '--with-pam' '--with-openssl' '--with-libxml' '--with-libxslt' 'PYTHON=/usr/bin/python' '--mandir=/usr/share/postgresql/9.6/man' '--docdir=/usr/share/doc/postgresql-doc-9.6' '--sysconfdir=/etc/postgresql-common' '--datarootdir=/usr/share/' '--datadir=/usr/share/postgresql/9.6' '--bindir=/usr/lib/postgresql/9.6/bin' '--libdir=/usr/lib/x86_64-linux-gnu/' '--libexecdir=/usr/lib/postgresql/' '--includedir=/usr/include/postgresql/' '--enable-nls' '--enable-integer-datetimes' '--enable-thread-safety' '--enable-tap-tests' '--enable-debug' '--enable-dtrace' '--disable-rpath' '--with-uuid=e2fs' '--with-gnu-ld' '--with-pgport=5432' '--with-system-tzdata=/usr/share/zoneinfo' '--with-systemd' '--with-selinux' 'MKDIR_P=/bin/mkdir -p' 'TAR=/bin/tar' 'CFLAGS=-g -O2 -fstack-protector-strong -Wformat -Werror=format-security -fPIC -pie -fno-omit-frame-pointer' 'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now' 'DPKG_VERSION=9.6.15-1.pgdg16.04+1' 'DPKG_VENDOR=Ubuntu' '--with-gssapi' '--with-ldap' '--with-includes=/usr/include/mit-krb5' '--with-libs=/usr/lib/mit-krb5' '--with-libs=/usr/lib/x86_64-linux-gnu/mit-krb5' 'build_alias=x86_64-linux-gnu' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' '--build=x86_64-linux-gnu' '--prefix=/usr' '--includedir=/usr/include' '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--sysconfdir=/etc' '--localstatedir=/var' '--disable-silent-rules' '--libdir=/usr/lib/x86_64-linux-gnu' '--libexecdir=/usr/lib/x86_64-linux-gnu' '--disable-maintainer-mode' '--disable-dependency-tracking' '--with-tcl' '--with-perl' '--with-python' '--with-pam' '--with-openssl' '--with-libxml' '--with-libxslt' 'PYTHON=/usr/bin/python' '--mandir=/usr/share/postgresql/9.6/man' '--docdir=/usr/share/doc/postgresql-doc-9.6' '--sysconfdir=/etc/postgresql-common' '--datarootdir=/usr/share/' '--datadir=/usr/share/postgresql/9.6' '--bindir=/usr/lib/postgresql/9.6/bin' '--libdir=/usr/lib/x86_64-linux-gnu/' '--libexecdir=/usr/lib/postgresql/' '--includedir=/usr/include/postgresql/' '--enable-nls' '--enable-integer-datetimes' '--enable-thread-safety' '--enable-tap-tests' '--enable-debug' '--enable-dtrace' '--disable-rpath' '--with-uuid=e2fs' '--with-gnu-ld' '--with-pgport=5432' '--with-system-tzdata=/usr/share/zoneinfo' '--with-systemd' '--with-selinux' 'MKDIR_P=/bin/mkdir -p' 'TAR=/bin/tar' 'CFLAGS=-g -O2 -fstack-protector-strong -Wformat -Werror=format-security -fPIC -pie -fno-omit-frame-pointer' 'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now' 'DPKG_VERSION=9.6.14-1.pgdg16.04+1' 'DPKG_VENDOR=Ubuntu' '--with-gssapi' '--with-ldap' '--with-includes=/usr/include/mit-krb5' '--with-libs=/usr/lib/mit-krb5' '--with-libs=/usr/lib/x86_64-linux-gnu/mit-krb5' 'build_alias=x86_64-linux-gnu' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' '--build=x86_64-linux-gnu' '--prefix=/usr' '--includedir=/usr/include' '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--sysconfdir=/etc' '--localstatedir=/var' '--disable-silent-rules' '--libdir=/usr/lib/x86_64-linux-gnu' '--libexecdir=/usr/lib/x86_64-linux-gnu' '--disable-maintainer-mode' '--disable-dependency-tracking' '--with-tcl' '--with-perl' '--with-python' '--with-pam' '--with-openssl' '--with-libxml' '--with-libxslt' 'PYTHON=/usr/bin/python' '--mandir=/usr/share/postgresql/9.6/man' '--docdir=/usr/share/doc/postgresql-doc-9.6' '--sysconfdir=/etc/postgresql-common' '--datarootdir=/usr/share/' '--datadir=/usr/share/postgresql/9.6' '--bindir=/usr/lib/postgresql/9.6/bin' '--libdir=/usr/lib/x86_64-linux-gnu/' '--libexecdir=/usr/lib/postgresql/' '--includedir=/usr/include/postgresql/' '--enable-nls' '--enable-integer-datetimes' '--enable-thread-safety' '--enable-tap-tests' '--enable-debug' '--enable-dtrace' '--disable-rpath' '--with-uuid=e2fs' '--with-gnu-ld' '--with-pgport=5432' '--with-system-tzdata=/usr/share/zoneinfo' '--with-systemd' '--with-selinux' 'MKDIR_P=/bin/mkdir -p' 'TAR=/bin/tar' 'CFLAGS=-g -O2 -fstack-protector-strong -Wformat -Werror=format-security -fPIC -pie -fno-omit-frame-pointer' 'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now' 'DPKG_VERSION=9.6.14-1.pgdg16.04+1' 'DPKG_VENDOR=Ubuntu' '--with-gssapi' '--with-ldap' '--with-includes=/usr/include/mit-krb5' '--with-libs=/usr/lib/mit-krb5' '--with-libs=/usr/lib/x86_64-linux-gnu/mit-krb5' 'build_alias=x86_64-linux-gnu' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' '--build=x86_64-linux-gnu' '--prefix=/usr' '--includedir=/usr/include' '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--sysconfdir=/etc' '--localstatedir=/var' '--disable-silent-rules' '--libdir=/usr/lib/x86_64-linux-gnu' '--libexecdir=/usr/lib/x86_64-linux-gnu' '--disable-maintainer-mode' '--disable-dependency-tracking' '--with-tcl' '--with-perl' '--with-python' '--with-pam' '--with-openssl' '--with-libxml' '--with-libxslt' 'PYTHON=/usr/bin/python' '--mandir=/usr/share/postgresql/9.6/man' '--docdir=/usr/share/doc/postgresql-doc-9.6' '--sysconfdir=/etc/postgresql-common' '--datarootdir=/usr/share/' '--datadir=/usr/share/postgresql/9.6' '--bindir=/usr/lib/postgresql/9.6/bin' '--libdir=/usr/lib/x86_64-linux-gnu/' '--libexecdir=/usr/lib/postgresql/' '--includedir=/usr/include/postgresql/' '--enable-nls' '--enable-integer-datetimes' '--enable-thread-safety' '--enable-tap-tests' '--enable-debug' '--enable-dtrace' '--disable-rpath' '--with-uuid=e2fs' '--with-gnu-ld' '--with-pgport=5432' '--with-system-tzdata=/usr/share/zoneinfo' '--with-systemd' '--with-selinux' 'MKDIR_P=/bin/mkdir -p' 'TAR=/bin/tar' 'CFLAGS=-g -O2 -fstack-protector-strong -Wformat -Werror=format-security -fPIC -pie -fno-omit-frame-pointer' 'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now' 'DPKG_VERSION=9.6.14-1.pgdg16.04+1' 'DPKG_VENDOR=Ubuntu' '--with-gssapi' '--with-ldap' '--with-includes=/usr/include/mit-krb5' '--with-libs=/usr/lib/mit-krb5' '--with-libs=/usr/lib/x86_64-linux-gnu/mit-krb5' 'build_alias=x86_64-linux-gnu' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' '--build=x86_64-linux-gnu' '--prefix=/usr' '--includedir=/usr/include' '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--sysconfdir=/etc' '--localstatedir=/var' '--disable-silent-rules' '--libdir=/usr/lib/x86_64-linux-gnu' '--libexecdir=/usr/lib/x86_64-linux-gnu' '--disable-maintainer-mode' '--disable-dependency-tracking' '--with-tcl' '--with-perl' '--with-python' '--with-pam' '--with-openssl' '--with-libxml' '--with-libxslt' 'PYTHON=/usr/bin/python' '--mandir=/usr/share/postgresql/9.6/man' '--docdir=/usr/share/doc/postgresql-doc-9.6' '--sysconfdir=/etc/postgresql-common' '--datarootdir=/usr/share/' '--datadir=/usr/share/postgresql/9.6' '--bindir=/usr/lib/postgresql/9.6/bin' '--libdir=/usr/lib/x86_64-linux-gnu/' '--libexecdir=/usr/lib/postgresql/' '--includedir=/usr/include/postgresql/' '--enable-nls' '--enable-integer-datetimes' '--enable-thread-safety' '--enable-tap-tests' '--enable-debug' '--enable-dtrace' '--disable-rpath' '--with-uuid=e2fs' '--with-gnu-ld' '--with-pgport=5432' '--with-system-tzdata=/usr/share/zoneinfo' '--with-systemd' '--with-selinux' 'MKDIR_P=/bin/mkdir -p' 'TAR=/bin/tar' 'CFLAGS=-g -O2 -fstack-protector-strong -Wformat -Werror=format-security -fPIC -pie -fno-omit-frame-pointer' 'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now' 'DPKG_VERSION=9.6.14-1.pgdg16.04+1' 'DPKG_VENDOR=Ubuntu' '--with-gssapi' '--with-ldap' '--with-includes=/usr/include/mit-krb5' '--with-libs=/usr/lib/mit-krb5' '--with-libs=/usr/lib/x86_64-linux-gnu/mit-krb5' 'build_alias=x86_64-linux-gnu' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' '--build=x86_64-linux-gnu' '--prefix=/usr' '--includedir=/usr/include' '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--sysconfdir=/etc' '--localstatedir=/var' '--disable-silent-rules' '--libdir=/usr/lib/x86_64-linux-gnu' '--libexecdir=/usr/lib/x86_64-linux-gnu' '--disable-maintainer-mode' '--disable-dependency-tracking' '--with-tcl' '--with-perl' '--with-python' '--with-pam' '--with-openssl' '--with-libxml' '--with-libxslt' 'PYTHON=/usr/bin/python' '--mandir=/usr/share/postgresql/9.6/man' '--docdir=/usr/share/doc/postgresql-doc-9.6' '--sysconfdir=/etc/postgresql-common' '--datarootdir=/usr/share/' '--datadir=/usr/share/postgresql/9.6' '--bindir=/usr/lib/postgresql/9.6/bin' '--libdir=/usr/lib/x86_64-linux-gnu/' '--libexecdir=/usr/lib/postgresql/' '--includedir=/usr/include/postgresql/' '--enable-nls' '--enable-integer-datetimes' '--enable-thread-safety' '--enable-tap-tests' '--enable-debug' '--enable-dtrace' '--disable-rpath' '--with-uuid=e2fs' '--with-gnu-ld' '--with-pgport=5432' '--with-system-tzdata=/usr/share/zoneinfo' '--with-systemd' '--with-selinux' 'MKDIR_P=/bin/mkdir -p' 'TAR=/bin/tar' 'CFLAGS=-g -O2 -fstack-protector-strong -Wformat -Werror=format-security -fPIC -pie -fno-omit-frame-pointer' 'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now' 'DPKG_VERSION=9.6.15-1.pgdg16.04+1' 'DPKG_VENDOR=Ubuntu' '--with-gssapi' '--with-ldap' '--with-includes=/usr/include/mit-krb5' '--with-libs=/usr/lib/mit-krb5' '--with-libs=/usr/lib/x86_64-linux-gnu/mit-krb5' 'build_alias=x86_64-linux-gnu' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' '--build=x86_64-linux-gnu' '--prefix=/usr' '--includedir=/usr/include' '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--sysconfdir=/etc' '--localstatedir=/var' '--disable-silent-rules' '--libdir=/usr/lib/x86_64-linux-gnu' '--libexecdir=/usr/lib/x86_64-linux-gnu' '--disable-maintainer-mode' '--disable-dependency-tracking' '--with-tcl' '--with-perl' '--with-python' '--with-pam' '--with-openssl' '--with-libxml' '--with-libxslt' 'PYTHON=/usr/bin/python' '--mandir=/usr/share/postgresql/9.6/man' '--docdir=/usr/share/doc/postgresql-doc-9.6' '--sysconfdir=/etc/postgresql-common' '--datarootdir=/usr/share/' '--datadir=/usr/share/postgresql/9.6' '--bindir=/usr/lib/postgresql/9.6/bin' '--libdir=/usr/lib/x86_64-linux-gnu/' '--libexecdir=/usr/lib/postgresql/' '--includedir=/usr/include/postgresql/' '--enable-nls' '--enable-integer-datetimes' '--enable-thread-safety' '--enable-tap-tests' '--enable-debug' '--enable-dtrace' '--disable-rpath' '--with-uuid=e2fs' '--with-gnu-ld' '--with-pgport=5432' '--with-system-tzdata=/usr/share/zoneinfo' '--with-systemd' '--with-selinux' 'MKDIR_P=/bin/mkdir -p' 'TAR=/bin/tar' 'CFLAGS=-g -O2 -fstack-protector-strong -Wformat -Werror=format-security -fPIC -pie -fno-omit-frame-pointer' 'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now' 'DPKG_VERSION=9.6.15-1.pgdg16.04+1' 'DPKG_VENDOR=Ubuntu' '--with-gssapi' '--with-ldap' '--with-includes=/usr/include/mit-krb5' '--with-libs=/usr/lib/mit-krb5' '--with-libs=/usr/lib/x86_64-linux-gnu/mit-krb5' 'build_alias=x86_64-linux-gnu' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2' '--build=x86_64-linux-gnu' '--prefix=/usr' '--includedir=/usr/include' '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--sysconfdir=/etc' '--localstatedir=/var' '--disable-silent-rules' '--libdir=/usr/lib/x86_64-linux-gnu' '--libexecdir=/usr/lib/x86_64-linux-gnu' '--disable-maintainer-mode' '--disable-dependency-tracking' '--with-tcl' '--with-perl' '--with-python' '--with-pam' '--with-openssl' '--with-libxml' '--with-libxslt' 'PYTHON=/usr/bin/python' '--mandir=/usr/share/postgresql/9.6/man' '--docdir=/usr/share/doc/postgresql-doc-9.6' '--sysconfdir=/etc/postgresql-common' '--datarootdir=/usr/share/' '--datadir=/usr/share/postgresql/9.6' '--bindir=/usr/lib/postgresql/9.6/bin' '--libdir=/usr/lib/x86_64-linux-gnu/' '--libexecdir=/usr/lib/postgresql/' '--includedir=/usr/include/postgresql/' '--enable-nls' '--enable-integer-datetimes' '--enable-thread-safety' '--enable-tap-tests' '--enable-debug' '--enable-dtrace' '--disable-rpath' '--with-uuid=e2fs' '--with-gnu-ld' '--with-pgport=5432' '--with-system-tzdata=/usr/share/zoneinfo' '--with-systemd' '--with-selinux' 'MKDIR_P=/bin/mkdir -p' 'TAR=/bin/tar' 'CFLAGS=-g -O2 -fstack-protector-strong -Wformat -Werror=format-security -fPIC -pie -fno-omit-frame-pointer' 'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,-z,now' 'DPKG_VERSION=9.6.15-1.pgdg16.04+1' 'DPKG_VENDOR=Ubuntu' '--with-gssapi' '--with-ldap' '--with-includes=/usr/include/mit-krb5' '--with-libs=/usr/lib/mit-krb5' '--with-libs=/usr/lib/x86_64-linux-gnu/mit-krb5' 'build_alias=x86_64-linux-gnu' 'CPPFLAGS=-Wdate-time -D_FORTIFY_SOURCE=2'
VERSION PostgreSQL 9.6.14 PostgreSQL 9.6.15 PostgreSQL 9.6.14 PostgreSQL 9.6.14 PostgreSQL 9.6.14 PostgreSQL 9.6.14 PostgreSQL 9.6.15 PostgreSQL 9.6.15 PostgreSQL 9.6.15

Conclusions

Recommendations

  Table of contents

A007 Altered Settings

Observations

Data collected: 2020-02-18 02:29:28 +0000 UTC

Master (10.220.16.106)

Source Settings count Changed settings
/var/opt/gitlab/postgresql/data/postgresql.auto.conf 9 autovacuum_naptime idle_in_transaction_session_timeout log_connections log_disconnections log_min_duration_statement maintenance_work_mem max_wal_size track_io_timing wal_keep_segments
/var/opt/gitlab/postgresql/postgresql.base.conf 2 autovacuum_freeze_max_age min_wal_size
/var/opt/gitlab/postgresql/postgresql.conf 44 archive_command archive_mode archive_timeout autovacuum_analyze_scale_factor autovacuum_max_workers autovacuum_vacuum_cost_delay autovacuum_vacuum_cost_limit autovacuum_vacuum_scale_factor checkpoint_completion_target checkpoint_timeout deadlock_timeout default_statistics_target default_text_search_config effective_cache_size effective_io_concurrency hot_standby_feedback lc_messages log_autovacuum_min_duration log_checkpoints log_destination log_directory log_file_mode log_filename log_line_prefix log_lock_waits log_rotation_age log_rotation_size log_statement log_temp_files logging_collector random_page_cost shared_buffers shared_preload_libraries ssl ssl_ca_file ssl_cert_file ssl_ciphers ssl_key_file tcp_keepalives_count tcp_keepalives_idle tcp_keepalives_interval track_activity_query_size unix_socket_directories work_mem
default 211

Replica servers:

Replica (10.220.16.101)

Source Settings count Changed settings
/var/opt/gitlab/postgresql/data/postgresql.auto.conf 7 autovacuum_naptime idle_in_transaction_session_timeout log_connections log_disconnections log_min_duration_statement track_io_timing wal_keep_segments
/var/opt/gitlab/postgresql/postgresql.base.conf 2 autovacuum_freeze_max_age min_wal_size
/var/opt/gitlab/postgresql/postgresql.conf 46 archive_command archive_mode archive_timeout autovacuum_analyze_scale_factor autovacuum_max_workers autovacuum_vacuum_cost_delay autovacuum_vacuum_cost_limit autovacuum_vacuum_scale_factor checkpoint_completion_target checkpoint_timeout deadlock_timeout default_statistics_target default_text_search_config effective_cache_size effective_io_concurrency hot_standby_feedback lc_messages log_autovacuum_min_duration log_checkpoints log_destination log_directory log_file_mode log_filename log_line_prefix log_lock_waits log_rotation_age log_rotation_size log_statement log_temp_files logging_collector maintenance_work_mem max_wal_size random_page_cost shared_buffers shared_preload_libraries ssl ssl_ca_file ssl_cert_file ssl_ciphers ssl_key_file tcp_keepalives_count tcp_keepalives_idle tcp_keepalives_interval track_activity_query_size unix_socket_directories work_mem
default 211

Replica (10.220.16.102)

Source Settings count Changed settings
/var/opt/gitlab/postgresql/data/postgresql.auto.conf 4 autovacuum_naptime idle_in_transaction_session_timeout track_io_timing wal_keep_segments
/var/opt/gitlab/postgresql/postgresql.base.conf 2 autovacuum_freeze_max_age min_wal_size
/var/opt/gitlab/postgresql/postgresql.conf 49 archive_command archive_mode archive_timeout autovacuum_analyze_scale_factor autovacuum_max_workers autovacuum_vacuum_cost_delay autovacuum_vacuum_cost_limit autovacuum_vacuum_scale_factor checkpoint_completion_target checkpoint_timeout deadlock_timeout default_statistics_target default_text_search_config effective_cache_size effective_io_concurrency hot_standby_feedback lc_messages log_autovacuum_min_duration log_checkpoints log_connections log_destination log_directory log_disconnections log_file_mode log_filename log_line_prefix log_lock_waits log_min_duration_statement log_rotation_age log_rotation_size log_statement log_temp_files logging_collector maintenance_work_mem max_wal_size random_page_cost shared_buffers shared_preload_libraries ssl ssl_ca_file ssl_cert_file ssl_ciphers ssl_key_file tcp_keepalives_count tcp_keepalives_idle tcp_keepalives_interval track_activity_query_size unix_socket_directories work_mem
default 211

Replica (10.220.16.103)

Source Settings count Changed settings
/var/opt/gitlab/postgresql/data/postgresql.auto.conf 4 autovacuum_naptime idle_in_transaction_session_timeout track_io_timing wal_keep_segments
/var/opt/gitlab/postgresql/postgresql.base.conf 2 autovacuum_freeze_max_age min_wal_size
/var/opt/gitlab/postgresql/postgresql.conf 49 archive_command archive_mode archive_timeout autovacuum_analyze_scale_factor autovacuum_max_workers autovacuum_vacuum_cost_delay autovacuum_vacuum_cost_limit autovacuum_vacuum_scale_factor checkpoint_completion_target checkpoint_timeout deadlock_timeout default_statistics_target default_text_search_config effective_cache_size effective_io_concurrency hot_standby_feedback lc_messages log_autovacuum_min_duration log_checkpoints log_connections log_destination log_directory log_disconnections log_file_mode log_filename log_line_prefix log_lock_waits log_min_duration_statement log_rotation_age log_rotation_size log_statement log_temp_files logging_collector maintenance_work_mem max_wal_size random_page_cost shared_buffers shared_preload_libraries ssl ssl_ca_file ssl_cert_file ssl_ciphers ssl_key_file tcp_keepalives_count tcp_keepalives_idle tcp_keepalives_interval track_activity_query_size unix_socket_directories work_mem
default 211

Replica (10.220.16.104)

Source Settings count Changed settings
/var/opt/gitlab/postgresql/data/postgresql.auto.conf 4 autovacuum_naptime idle_in_transaction_session_timeout track_io_timing wal_keep_segments
/var/opt/gitlab/postgresql/postgresql.base.conf 2 autovacuum_freeze_max_age min_wal_size
/var/opt/gitlab/postgresql/postgresql.conf 49 archive_command archive_mode archive_timeout autovacuum_analyze_scale_factor autovacuum_max_workers autovacuum_vacuum_cost_delay autovacuum_vacuum_cost_limit autovacuum_vacuum_scale_factor checkpoint_completion_target checkpoint_timeout deadlock_timeout default_statistics_target default_text_search_config effective_cache_size effective_io_concurrency hot_standby_feedback lc_messages log_autovacuum_min_duration log_checkpoints log_connections log_destination log_directory log_disconnections log_file_mode log_filename log_line_prefix log_lock_waits log_min_duration_statement log_rotation_age log_rotation_size log_statement log_temp_files logging_collector maintenance_work_mem max_wal_size random_page_cost shared_buffers shared_preload_libraries ssl ssl_ca_file ssl_cert_file ssl_ciphers ssl_key_file tcp_keepalives_count tcp_keepalives_idle tcp_keepalives_interval track_activity_query_size unix_socket_directories work_mem
default 211

Replica (10.220.16.105)

Source Settings count Changed settings
/var/opt/gitlab/postgresql/data/postgresql.auto.conf 4 autovacuum_naptime idle_in_transaction_session_timeout track_io_timing wal_keep_segments
/var/opt/gitlab/postgresql/postgresql.base.conf 2 autovacuum_freeze_max_age min_wal_size
/var/opt/gitlab/postgresql/postgresql.conf 49 archive_command archive_mode archive_timeout autovacuum_analyze_scale_factor autovacuum_max_workers autovacuum_vacuum_cost_delay autovacuum_vacuum_cost_limit autovacuum_vacuum_scale_factor checkpoint_completion_target checkpoint_timeout deadlock_timeout default_statistics_target default_text_search_config effective_cache_size effective_io_concurrency hot_standby_feedback lc_messages log_autovacuum_min_duration log_checkpoints log_connections log_destination log_directory log_disconnections log_file_mode log_filename log_line_prefix log_lock_waits log_min_duration_statement log_rotation_age log_rotation_size log_statement log_temp_files logging_collector maintenance_work_mem max_wal_size random_page_cost shared_buffers shared_preload_libraries ssl ssl_ca_file ssl_cert_file ssl_ciphers ssl_key_file tcp_keepalives_count tcp_keepalives_idle tcp_keepalives_interval track_activity_query_size unix_socket_directories work_mem
default 211

Replica (10.220.16.107)

Source Settings count Changed settings
/var/opt/gitlab/postgresql/data/postgresql.auto.conf 4 autovacuum_naptime idle_in_transaction_session_timeout track_io_timing wal_keep_segments
/var/opt/gitlab/postgresql/postgresql.base.conf 2 autovacuum_freeze_max_age min_wal_size
/var/opt/gitlab/postgresql/postgresql.conf 49 archive_command archive_mode archive_timeout autovacuum_analyze_scale_factor autovacuum_max_workers autovacuum_vacuum_cost_delay autovacuum_vacuum_cost_limit autovacuum_vacuum_scale_factor checkpoint_completion_target checkpoint_timeout deadlock_timeout default_statistics_target default_text_search_config effective_cache_size effective_io_concurrency hot_standby_feedback lc_messages log_autovacuum_min_duration log_checkpoints log_connections log_destination log_directory log_disconnections log_file_mode log_filename log_line_prefix log_lock_waits log_min_duration_statement log_rotation_age log_rotation_size log_statement log_temp_files logging_collector maintenance_work_mem max_wal_size random_page_cost shared_buffers shared_preload_libraries ssl ssl_ca_file ssl_cert_file ssl_ciphers ssl_key_file tcp_keepalives_count tcp_keepalives_idle tcp_keepalives_interval track_activity_query_size unix_socket_directories work_mem
default 211

Replica (10.220.16.108)

Source Settings count Changed settings
/var/opt/gitlab/postgresql/data/postgresql.auto.conf 4 autovacuum_naptime idle_in_transaction_session_timeout track_io_timing wal_keep_segments
/var/opt/gitlab/postgresql/postgresql.base.conf 2 autovacuum_freeze_max_age min_wal_size
/var/opt/gitlab/postgresql/postgresql.conf 49 archive_command archive_mode archive_timeout autovacuum_analyze_scale_factor autovacuum_max_workers autovacuum_vacuum_cost_delay autovacuum_vacuum_cost_limit autovacuum_vacuum_scale_factor checkpoint_completion_target checkpoint_timeout deadlock_timeout default_statistics_target default_text_search_config effective_cache_size effective_io_concurrency hot_standby_feedback lc_messages log_autovacuum_min_duration log_checkpoints log_connections log_destination log_directory log_disconnections log_file_mode log_filename log_line_prefix log_lock_waits log_min_duration_statement log_rotation_age log_rotation_size log_statement log_temp_files logging_collector maintenance_work_mem max_wal_size random_page_cost shared_buffers shared_preload_libraries ssl ssl_ca_file ssl_cert_file ssl_ciphers ssl_key_file tcp_keepalives_count tcp_keepalives_idle tcp_keepalives_interval track_activity_query_size unix_socket_directories work_mem
default 211

Replica (10.220.16.109)

Source Settings count Changed settings
/var/opt/gitlab/postgresql/data/postgresql.auto.conf 4 autovacuum_naptime idle_in_transaction_session_timeout track_io_timing wal_keep_segments
/var/opt/gitlab/postgresql/postgresql.base.conf 2 autovacuum_freeze_max_age min_wal_size
/var/opt/gitlab/postgresql/postgresql.conf 49 archive_command archive_mode archive_timeout autovacuum_analyze_scale_factor autovacuum_max_workers autovacuum_vacuum_cost_delay autovacuum_vacuum_cost_limit autovacuum_vacuum_scale_factor checkpoint_completion_target checkpoint_timeout deadlock_timeout default_statistics_target default_text_search_config effective_cache_size effective_io_concurrency hot_standby_feedback lc_messages log_autovacuum_min_duration log_checkpoints log_connections log_destination log_directory log_disconnections log_file_mode log_filename log_line_prefix log_lock_waits log_min_duration_statement log_rotation_age log_rotation_size log_statement log_temp_files logging_collector maintenance_work_mem max_wal_size random_page_cost shared_buffers shared_preload_libraries ssl ssl_ca_file ssl_cert_file ssl_ciphers ssl_key_file tcp_keepalives_count tcp_keepalives_idle tcp_keepalives_interval track_activity_query_size unix_socket_directories work_mem
default 211

Conclusions

Recommendations

  Table of contents

D004 pg_stat_statements and pg_stat_kcache Settings

Observations

Data collected: 2020-02-18 02:29:29 +0000 UTC

Master (10.220.16.106)

pg_stat_statements extension settings

Setting Value Unit Type Min value Max value
pg_stat_statements.max 5000 integer 100 2147483647
pg_stat_statements.save on bool
pg_stat_statements.track top enum
pg_stat_statements.track_utility on bool

Conclusions

Recommendations

  Table of contents

F001 Autovacuum: Current Settings

Observations

Data collected: 2020-02-18 02:29:30 +0000 UTC

Master (10.220.16.106)

▼ Setting name Value Unit Pretty value
autovacuum on
autovacuum_analyze_scale_factor 0.005
autovacuum_analyze_threshold 50
autovacuum_freeze_max_age 200000000
autovacuum_max_workers 6
autovacuum_multixact_freeze_max_age 400000000
autovacuum_naptime 30 s
autovacuum_vacuum_cost_delay 5 ms
autovacuum_vacuum_cost_limit 6000
autovacuum_vacuum_scale_factor 0.005
autovacuum_vacuum_threshold 50
autovacuum_work_mem -1 kB
maintenance_work_mem 2097152 kB 2.00 GiB
vacuum_cost_delay 0 ms
vacuum_cost_limit 200
vacuum_cost_page_dirty 20
vacuum_cost_page_hit 1
vacuum_cost_page_miss 10
vacuum_defer_cleanup_age 0
vacuum_freeze_min_age 50000000
vacuum_freeze_table_age 150000000
vacuum_multixact_freeze_min_age 5000000
vacuum_multixact_freeze_table_age 150000000

Tuned tables

▼ Namespace Relation Options
pg_toast pg_toast_33145 autovacuum_enabled=true
pg_toast pg_toast_33153 autovacuum_enabled=true
pg_toast pg_toast_33161 autovacuum_enabled=true
pg_toast pg_toast_33208 autovacuum_enabled=true
pg_toast pg_toast_33221 autovacuum_enabled=true
pg_toast pg_toast_33229 autovacuum_enabled=true
pg_toast pg_toast_33237 autovacuum_enabled=true
pg_toast pg_toast_33248 autovacuum_enabled=true
pg_toast pg_toast_33262 autovacuum_enabled=true
pg_toast pg_toast_33272 autovacuum_enabled=true
pg_toast pg_toast_33322 autovacuum_enabled=true
pg_toast pg_toast_33356 autovacuum_enabled=true
pg_toast pg_toast_33369 autovacuum_enabled=true
pg_toast pg_toast_33383 autovacuum_enabled=true
pg_toast pg_toast_33393 autovacuum_enabled=true
pg_toast pg_toast_33400 autovacuum_enabled=true
pg_toast pg_toast_33426 autovacuum_enabled=true
pg_toast pg_toast_33439 autovacuum_enabled=true
pg_toast pg_toast_33447 autovacuum_enabled=true
pg_toast pg_toast_33462 autovacuum_enabled=true
pg_toast pg_toast_33476 autovacuum_enabled=true
pg_toast pg_toast_33497 autovacuum_enabled=true
pg_toast pg_toast_33506 autovacuum_enabled=true
pg_toast pg_toast_33514 autovacuum_enabled=true
pg_toast pg_toast_33527 autovacuum_enabled=true
pg_toast pg_toast_33541 autovacuum_enabled=true
pg_toast pg_toast_33553 autovacuum_enabled=true
pg_toast pg_toast_33568 autovacuum_enabled=true
pg_toast pg_toast_33587 autovacuum_enabled=true
pg_toast pg_toast_33597 autovacuum_enabled=true
pg_toast pg_toast_33614 autovacuum_enabled=true
pg_toast pg_toast_33625 autovacuum_enabled=true
pg_toast pg_toast_33634 autovacuum_enabled=true
pg_toast pg_toast_33642 autovacuum_enabled=true
pg_toast pg_toast_33650 autovacuum_enabled=true
pg_toast pg_toast_33659 autovacuum_enabled=true
pg_toast pg_toast_33667 autovacuum_enabled=true
pg_toast pg_toast_33675 autovacuum_enabled=true
pg_toast pg_toast_33696 autovacuum_enabled=true
pg_toast pg_toast_33706 autovacuum_enabled=true
pg_toast pg_toast_33749 autovacuum_enabled=true
pg_toast pg_toast_33756 autovacuum_enabled=true
pg_toast pg_toast_33768 autovacuum_enabled=true
pg_toast pg_toast_33776 autovacuum_enabled=true
pg_toast pg_toast_33791 autovacuum_enabled=true
pg_toast pg_toast_33801 autovacuum_enabled=true
pg_toast pg_toast_33824 autovacuum_enabled=true
pg_toast pg_toast_33835 autovacuum_enabled=true
pg_toast pg_toast_33851 autovacuum_enabled=true
pg_toast pg_toast_33863 autovacuum_enabled=true
pg_toast pg_toast_33872 autovacuum_enabled=true
pg_toast pg_toast_33885 autovacuum_enabled=true
pg_toast pg_toast_33898 autovacuum_enabled=true
pg_toast pg_toast_33909 autovacuum_enabled=true
pg_toast pg_toast_33959 autovacuum_enabled=true
public abuse_reports autovacuum_enabled=true
public appearances autovacuum_enabled=true
public application_settings autovacuum_enabled=true
public approval_merge_request_rules_users autovacuum_enabled=on
public approvals autovacuum_enabled=true
public approver_groups autovacuum_enabled=true
public approvers autovacuum_enabled=on
public audit_events autovacuum_enabled=true
public award_emoji autovacuum_enabled=on
public boards autovacuum_enabled=true
public broadcast_messages autovacuum_enabled=true
public ci_builds autovacuum_enabled=true
public ci_pipelines autovacuum_enabled=true
public ci_runner_projects autovacuum_enabled=true
public ci_runners autovacuum_enabled=on
public ci_trigger_requests autovacuum_enabled=true
public ci_triggers autovacuum_enabled=true
public ci_variables autovacuum_enabled=true
public deploy_keys_projects autovacuum_enabled=true
public deployments autovacuum_enabled=on
public emails autovacuum_enabled=true
public environments autovacuum_enabled=true
public forked_project_links autovacuum_enabled=true
public geo_nodes autovacuum_enabled=true
public historical_data autovacuum_enabled=true
public identities autovacuum_enabled=true
public index_statuses autovacuum_enabled=true
public issue_metrics autovacuum_enabled=true
public issues autovacuum_enabled=true
public keys autovacuum_enabled=true
public label_links autovacuum_enabled=true
public label_priorities autovacuum_enabled=true
public labels autovacuum_enabled=on
public ldap_group_links autovacuum_enabled=true
public lfs_objects autovacuum_enabled=true
public lfs_objects_projects autovacuum_enabled=true
public licenses autovacuum_enabled=true
public lists autovacuum_enabled=true
public members autovacuum_enabled=true
public merge_request_diffs autovacuum_enabled=true
public merge_request_metrics autovacuum_enabled=true
public merge_requests autovacuum_enabled=true
public merge_requests_closing_issues autovacuum_enabled=true
public milestones autovacuum_enabled=on
public namespaces autovacuum_enabled=on
public notes autovacuum_enabled=true
public notification_settings autovacuum_enabled=on
public oauth_access_grants autovacuum_enabled=true
public oauth_access_tokens autovacuum_enabled=true
public oauth_applications autovacuum_enabled=true
public pages_domains autovacuum_enabled=true
public path_locks autovacuum_enabled=true
public personal_access_tokens autovacuum_enabled=true
public project_authorizations autovacuum_enabled=true
public project_features autovacuum_enabled=true
public project_group_links autovacuum_enabled=true
public project_import_data autovacuum_enabled=on
public project_mirror_data autovacuum_vacuum_cost_limit=10000
autovacuum_enabled=on
public project_repository_states autovacuum_enabled=on
public projects autovacuum_vacuum_cost_limit=7000
autovacuum_enabled=on
public protected_branch_merge_access_levels autovacuum_enabled=true
public protected_branch_push_access_levels autovacuum_enabled=true
public protected_branches autovacuum_enabled=true
public push_rules autovacuum_enabled=true
public releases autovacuum_enabled=on
public remote_mirrors autovacuum_enabled=true
public sent_notifications autovacuum_enabled=true
public services autovacuum_enabled=on
public snippets autovacuum_enabled=on
public spam_logs autovacuum_enabled=true
public subscriptions autovacuum_enabled=true
public taggings autovacuum_enabled=true
public tags autovacuum_enabled=true
public todos autovacuum_enabled=true
public trending_projects autovacuum_enabled=true
public u2f_registrations autovacuum_enabled=true
public untracked_files_for_uploads autovacuum_enabled=on
public user_agent_details autovacuum_enabled=true
public users autovacuum_enabled=on
public users_star_projects autovacuum_enabled=true
public web_hooks autovacuum_enabled=true

Replicas settings

Setting 10.220.16.101 10.220.16.102 10.220.16.103 10.220.16.104 10.220.16.105 10.220.16.107 10.220.16.108 10.220.16.109
hot_standby_feedback on on on on on on on on

Conclusions

Recommendations

All good, no recommendations here.

  Table of contents

F002 Autovacuum: Transaction ID Wraparound Check

Observations

  • Data collected: 2020-02-18 02:27:41 +0000 UTC
  • Current database: gitlabhq_production

Master (10.220.16.106)

Databases

# Database ▼ Age Capacity used, % Warning datfrozenxid
1 gitlabhq_production 198714674 10.19 1458211378
2 postgres 193986392 9.95 1462939660
3 template1 186150677 9.55 1470775375
4 template0 121383825 6.22 1535542227

Tables in the observed database

The list is limited to 10 items. Total: 321.

# Relation Age ▼ Capacity used, % Warning rel_relfrozenxid toast_relfrozenxid
1 protected_environments 198714674 10.19 1458211378 1567058077
2 services* 198621873 10.19 1550112782 1458304179
3 protected_environment_deploy_access_levels 198714674 10.19 1458211378 0
4 routes 198439186 10.18 1458486866 1567058077
5 project_mirror_data* 197563663 10.13 1564156474 1459362389
6 operations_feature_flag_scopes 197563663 10.13 1459362389 1570689814
7 user_statuses 197213923 10.11 1459712129 1567058077
8 vulnerabilities 196512659 10.08 1460413393 1506995085
9 issue_links 194986116 10 1461939936 0
10 users_security_dashboard_projects 194331099 9.97 1462594953 0

* This table has specific autovacuum settings. See 'F001 Autovacuum: Current settings'

Conclusions

Recommendations

All good, no recommendations here.

  Table of contents

F003 Autovacuum: Dead Tuples

Observations

Data collected: 2020-02-18 02:27:42 +0000 UTC
Current database: gitlabhq_production
Stats reset: 3 mons 20 days 10:20:00 ago (2019-10-28 16:07:35 +0000 UTC)

Master (10.220.16.106)

The list is limited to 20 items. Total: 212.

# Relation reltype Since last autovacuum Since last vacuum Autovacuum Count Vacuum Count n_tup_ins n_tup_upd n_tup_del pg_class.reltuples n_live_tup n_dead_tup ▼Dead Tuples Ratio, %
1 epics r 02:35:07.95072 3437 0 6715 201046 432 18418 18418 126 0.68
2 cluster_projects r 2 days 10:25:13.87678 45 0 9851 0 6796 22511 22516 140 0.62
3 remote_mirrors* r 00:20:20.077076 16030 0 16922 3879106 11158 50487 50487 292 0.58
4 pool_repositories r 17:15:16.697193 556 0 8663 26201 165 19698 19708 111 0.56
5 epic_issues r 1 day 12:33:37.89273 43 0 20857 7076 2126 54620 54673 295 0.54
6 project_mirror_data* r 00:00:19.703582 90 days 19:08:29.725966 94437 1 295837 2445854427 75624 2481719 2474696 12967 0.52
7 deployment_clusters r 16:12:41.069378 4 0 48211 0 752 47304 47458 247 0.52
8 u2f_registrations* r 06:58:35.198418 663 0 4622 36374 1857 18569 18597 95 0.51
9 ci_group_variables r 06:51:36.58229 2022 0 33457 326676 12572 88968 88981 443 0.5
10 ci_pipelines* r 12:38:45.584324 202 0 26502373 78692930 3627475 110429960 110532873 544731 0.49
11 pg_toast.pg_toast_33587* t 13:05:39.770364 197 0 19194 0 15471 11371 11375 56 0.49
12 web_hooks* r 14:36:05.25844 1522 0 482479 378613 394849 455297 455543 2146 0.47
13 container_expiration_policies r 1 day 02:46:01.534731 142 0 1064670 1550 174621 878267 879807 4056 0.46
14 deployments* r 1 day 07:15:45.412368 76 0 15377780 15123813 428636 49660888 49675548 227303 0.46
15 board_group_recent_visits r 04:05:17.053827 3699 0 10924 491456 2416 32224 32226 146 0.45
16 protected_branches* r 1 day 06:59:00.000702 57 0 3910679 8485 2613535 10117829 10119003 45287 0.45
17 approval_project_rules_users r 2 days 15:21:12.963853 44 0 36199 0 22891 95040 95170 431 0.45
18 pg_catalog.pg_statistic r 00:02:20.244949 33075 0 5945 4479574 5681 17498 17453 77 0.44
19 merge_requests* r 04:37:17.986987 764 0 9297087 129133123 2511465 40313464 40316729 176722 0.44
20 project_authorizations* r 2 days 12:50:49.960101 70 0 45106606 0 19571636 68245584 68395991 299815 0.44

* This table has specific autovacuum settings. See 'F001 Autovacuum: Current settings'

Conclusions

Recommendations

  Table of contents

F004 Autovacuum: Heap Bloat (Estimated)

⚠ This report is based on estimations. The errors in bloat estimates may be significant (in some cases, up to 15% and even more). Use it only as an indicator of potential issues.

Observations

Data collected: 2020-02-18 02:27:42 +0000 UTC
Current database: gitlabhq_production

Master (10.220.16.106)

The list is limited to 20 items. Total: 321.

# Table Real Size ▼ Estimated bloat Est. bloat, bytes Est. bloat factor Est. bloat level, % Live Data Size Last vacuum Fillfactor
  ===== TOTAL ===== 3.63 TiB 78.88 GiB 84,694,515,712 1.02 2.12 ~3.56 TiB
1 merge_request_diff_files 1.59 TiB 39.14 GiB 42,024,796,160 1.02 2.41 ~1.55 TiB 2020-02-16 21:25:00 (auto) 100
2 ci_builds* 548.88 GiB 11.50 GiB 12,345,139,200 1.02 2.09 ~537.38 GiB 2020-02-17 21:55:33 (auto) 100
3 merge_request_diff_commits 615.70 GiB 5.93 GiB 6,361,473,024 1.01 0.96 ~609.78 GiB 2020-02-17 11:22:29 (auto) 100
4 audit_events* 57.09 GiB 2.12 GiB 2,270,593,024 1.04 3.70 ~54.97 GiB 2020-02-17 10:52:09 (auto) 100
5 project_mirror_data* 2.14 GiB 1.91 GiB 2,048,901,120 9.31 89.26 ~235.21 MiB 2020-02-18 02:27:23 (auto) 100
6 ci_pipelines* 22.96 GiB 1.90 GiB 2,035,998,720 1.09 8.26 ~21.07 GiB 2020-02-17 13:48:57 (auto) 100
7 ci_job_artifacts 53.89 GiB 1.66 GiB 1,775,124,480 1.03 3.07 ~52.24 GiB 2020-02-17 18:31:36 (auto) 100
8 notes* 172.40 GiB 1.43 GiB 1,531,715,584 1.01 0.83 ~170.97 GiB 2020-02-17 14:01:28 (auto) 100
9 sent_notifications* 40.18 GiB 1.42 GiB 1,514,799,104 1.04 3.51 ~38.77 GiB 2020-02-17 11:35:39 (auto) 100
10 merge_requests* 19.87 GiB 1.16 GiB 1,237,663,744 1.06 5.80 ~18.72 GiB 2020-02-17 21:50:25 (auto) 100
11 services* 1.70 GiB 1.09 GiB 1,163,378,688 2.78 64.01 ~623.84 MiB 2020-02-17 03:04:47 (auto) 100
12 ci_stages 16.77 GiB 1.04 GiB 1,108,369,408 1.07 6.16 ~15.74 GiB 2020-02-17 13:30:37 (auto) 100
13 merge_request_diffs* 14.15 GiB 0.98 GiB 1,043,865,600 1.07 6.87 ~13.18 GiB 2020-02-17 20:50:59 (auto) 100
14 ci_build_trace_sections 145.91 GiB 757.20 MiB 793,976,832 1.01 0.51 ~145.18 GiB 2020-02-17 11:25:33 (auto) 100
15 deployments* 7.94 GiB 751.25 MiB 787,734,528 1.10 9.25 ~7.20 GiB 2020-02-16 19:11:57 (auto) 100
16 resource_label_events 15.41 GiB 646.04 MiB 677,421,056 1.04 4.10 ~14.78 GiB 2020-02-17 12:25:32 (auto) 100
17 projects* 3.61 GiB 461.87 MiB 484,302,848 1.14 12.51 ~3.16 GiB 2020-02-18 01:14:12 (auto) 100
18 issues* 21.56 GiB 430.68 MiB 451,600,384 1.02 1.95 ~21.14 GiB 2020-02-17 18:52:56 (auto) 100
19 users* 2.41 GiB 419.93 MiB 440,320,000 1.21 17.07 ~2.00 GiB 2020-02-18 02:16:15 (auto) 100
20 todos* 3.86 GiB 332.35 MiB 348,487,680 1.09 8.42 ~3.53 GiB 2020-02-16 02:35:08 (auto) 100

* This table has specific autovacuum settings. See 'F001 Autovacuum: Current settings'

Conclusions

  • The estimated table (heap) bloat in this DB is low, just ~2.12% (~78.88 GiB). No action is needed now. Keep watching it though.

  • [P1] The following 2 tables have significant size (>1 MiB) and bloat estimate > 90.00%:

    • project_feature_usages: size 17.25 MiB, can be reduced 11.68 times, by ~15.77 MiB (~91.44%)
    • ci_build_trace_chunks: size 4.34 MiB, can be reduced 69.38 times, by ~4.28 MiB (~98.56%)

  • [P2] There are 12 tables with size > 1 MiB and table bloat estimate >= 40.00% and < 90.00%:

    • project_mirror_data: size 2.14 GiB, can be reduced 9.31 times, by ~1.91 GiB (~89.26%)
    • services: size 1.70 GiB, can be reduced 2.78 times, by ~1.09 GiB (~64.01%)
    • personal_access_tokens: size 624.11 MiB, can be reduced 1.74 times, by ~264.63 MiB (~42.40%)
    • ci_runners: size 371.92 MiB, can be reduced 2.90 times, by ~243.54 MiB (~65.48%)
    • lists: size 465.29 MiB, can be reduced 1.92 times, by ~223.40 MiB (~48.01%)
    • etc.

Recommendations

  • [P1] Reduce and prevent the high level of table bloat:

    • to prevent a high level of bloat in the future, tune autovacuum: consider more aggressive autovacuum settings (see F001);
    • eliminate or reduce the current table bloat using one of the approaches listed below.

  • The following tables have size > 1 MiB and table bloat estimate > 40.00%. Use this list to reduce the bloat applying one of the approaches described below. Here are these tables: project_mirror_data, services, personal_access_tokens, ci_runners, lists, issue_links, deploy_tokens, project_feature_usages, ci_pipeline_schedules, oauth_applications, ci_build_trace_chunks, security_scans, lfs_file_locks, import_failures.

  • If you want to get exact bloat numbers, clone the database, get table sizes, then apply database-wide VACUUM FULL (it eliminate all the bloat), and get new table sizes. Then compare old and new numbers.

  • To reduce the table bloat, consider one of the following approaches:

  • Read more on this topic:

  Table of contents

F005 Autovacuum: Btree Index Bloat (Estimated)

⚠ This report is based on estimations. The errors in bloat estimates may be significant (in some cases, up to 15% and even more). Use it only as an indicator of potential issues.

Observations

Data collected: 2020-02-18 02:27:43 +0000 UTC
Current database: gitlabhq_production
ℹ This report considers only btree indexes.

Master (10.220.16.106)

The list is limited to 20 items. Total: 1131.

# Index (Table) Index Size Table Size ▼ Estimated bloat Est. bloat, bytes Est. bloat factor Est. bloat level, % Live Data Size Fillfactor
  ===== TOTAL ===== 1.39 TiB 2.83 TiB 255.36 GiB 274,182,774,784 1.22 17.99 1.14 TiB
1 index_merge_request_diff_commits_on_sha (merge_request_diff_commits) 110.68 GiB 601.13 GiB 18.64 GiB 20,007,362,560 1.20 16.84 ~92.05 GiB 90
2 index_ci_builds_on_token_encrypted (ci_builds*) 31.90 GiB 421.50 GiB 16.58 GiB 17,798,406,144 2.08 51.97 ~15.32 GiB 90
3 index_ci_build_trace_sections_on_section_name_id (ci_build_trace_sections) 52.34 GiB 146.33 GiB 9.69 GiB 10,404,159,488 1.23 18.51 ~42.65 GiB 90
4 index_ci_builds_on_auto_canceled_by_id (ci_builds*) 14.27 GiB 421.50 GiB 9.05 GiB 9,712,992,256 2.73 63.41 ~5.23 GiB 90
5 index_ci_build_trace_sections_on_project_id (ci_build_trace_sections) 51.43 GiB 146.33 GiB 8.78 GiB 9,426,059,264 1.21 17.07 ~42.65 GiB 90
6 index_projects_on_repository_storage (projects*) 8.27 GiB 3.34 GiB 7.91 GiB 8,493,203,456 23.06 95.66 ~367.17 MiB 90
7 index_ci_builds_on_token (ci_builds*) 16.20 GiB 421.50 GiB 7.58 GiB 8,130,691,072 1.88 46.75 ~8.63 GiB 90
8 index_projects_on_pending_delete (projects*) 6.96 GiB 3.34 GiB 6.70 GiB 7,189,659,648 27.09 96.31 ~262.84 MiB 90
9 index_sent_notifications_on_reply_key (sent_notifications*) 22.75 GiB 40.23 GiB 6.64 GiB 7,121,682,432 1.41 29.16 ~16.12 GiB 90
10 index_projects_on_star_count (projects*) 6.66 GiB 3.34 GiB 6.40 GiB 6,866,681,856 25.92 96.14 ~262.83 MiB 90
11 index_ci_job_artifacts_on_expire_at_and_job_id (ci_job_artifacts) 13.94 GiB 53.90 GiB 6.31 GiB 6,770,475,008 1.83 45.24 ~7.64 GiB 90
12 index_events_on_target_type_and_target_id (events) 17.27 GiB 37.40 GiB 5.82 GiB 6,238,502,912 1.51 33.66 ~11.46 GiB 90
13 index_projects_on_mirror_user_id (projects*) 6.05 GiB 3.34 GiB 5.80 GiB 6,220,193,792 24.06 95.84 ~257.23 MiB 90
14 index_ci_builds_on_queued_at (ci_builds*) 14.31 GiB 421.50 GiB 5.66 GiB 6,076,964,864 1.65 39.55 ~8.65 GiB 90
15 index_ci_builds_on_protected (ci_builds*) 14.22 GiB 421.50 GiB 5.59 GiB 5,996,093,440 1.65 39.30 ~8.63 GiB 90
16 index_ci_builds_on_runner_id (ci_builds*) 13.77 GiB 421.50 GiB 5.24 GiB 5,617,115,136 1.61 38.01 ~8.54 GiB 90
17 index_notes_on_discussion_id (notes*) 17.48 GiB 162.51 GiB 3.98 GiB 4,264,558,592 1.29 22.73 ~13.51 GiB 90
18 index_ci_builds_on_updated_at (ci_builds*) 12.49 GiB 421.50 GiB 3.82 GiB 4,094,672,896 1.44 30.54 ~8.68 GiB 90
19 index_notes_on_commit_id (notes*) 8.74 GiB 162.51 GiB 3.57 GiB 3,824,386,048 1.69 40.78 ~5.18 GiB 90
20 index_ci_job_artifacts_on_file_store (ci_job_artifacts) 10.64 GiB 53.90 GiB 3.15 GiB 3,380,502,528 1.42 29.60 ~7.49 GiB 90

* This table has specific autovacuum settings. See 'F001 Autovacuum: Current settings'

Conclusions

  • The estimated index (btree only) bloat in this DB is low, just ~17.99% (~255.36 GiB). No action is needed now. Keep watching it though.

  • [P1] The following 34 indexes have significant size (>1 MiB) and bloat estimate > 90.00%:

    • index_projects_on_repository_storage: size 8.27 GiB, can be reduced 23.06 times, by ~7.95 GiB (~95.66%)
    • index_projects_on_pending_delete: size 6.96 GiB, can be reduced 27.09 times, by ~6.73 GiB (~96.31%)
    • index_projects_on_star_count: size 6.66 GiB, can be reduced 25.92 times, by ~6.43 GiB (~96.14%)
    • index_projects_on_mirror_user_id: size 6.05 GiB, can be reduced 24.06 times, by ~5.82 GiB (~95.84%)
    • index_projects_on_mirror_last_successful_update_at: size 1.71 GiB, can be reduced 11.09 times, by ~1.57 GiB (~90.98%)
    • etc.

  • [P2] There are 170 indexes with size > 1 MiB and index bloat estimate >= 40.00% and < 90.00%:

    • index_ci_builds_on_token_encrypted: size 31.90 GiB, can be reduced 2.08 times, by ~18.15 GiB (~51.97%)
    • index_ci_builds_on_auto_canceled_by_id: size 14.27 GiB, can be reduced 2.73 times, by ~9.57 GiB (~63.41%)
    • index_ci_builds_on_token: size 16.20 GiB, can be reduced 1.88 times, by ~8.44 GiB (~46.75%)
    • index_ci_job_artifacts_on_expire_at_and_job_id: size 13.94 GiB, can be reduced 1.83 times, by ~7.08 GiB (~45.24%)
    • index_notes_on_commit_id: size 8.74 GiB, can be reduced 1.69 times, by ~4.09 GiB (~40.78%)
    • etc.

Recommendations

  • [P1] Reduce and prevent a high level of index bloat:

    • to prevent a high level of bloat in the future, tune autovacuum: consider more aggressive autovacuum settings (see F001);
    • eliminate or reduce the current index bloat using one of the approaches listed below.

  • The following indexes have size > 1 MiB and index bloat estimate > 40.00%. Use this list to reduce the bloat applying one of the approaches described below. Here are these indexes: index_ci_builds_on_token_encrypted, index_ci_builds_on_auto_canceled_by_id, index_projects_on_repository_storage, index_ci_builds_on_token, index_projects_on_pending_delete, index_projects_on_star_count, index_ci_job_artifacts_on_expire_at_and_job_id, index_projects_on_mirror_user_id, index_notes_on_commit_id, index_notes_on_review_id, index_ci_pipelines_on_auto_canceled_by_id, index_ci_pipelines_on_pipeline_schedule_id, index_merge_requests_on_milestone_id, index_merge_requests_on_title, index_merge_requests_on_assignee_id, index_merge_requests_on_target_branch, index_projects_on_mirror_last_successful_update_at, index_projects_on_runners_token, index_projects_on_last_repository_check_failed, index_projects_on_last_repository_updated_at, index_merge_requests_on_head_pipeline_id, index_merge_requests_on_state_and_merge_status, index_projects_on_last_activity_at_and_id, index_projects_api_last_activity_at_id_desc, index_merge_requests_on_source_branch, index_merge_requests_on_latest_merge_request_diff_id, index_merge_requests_on_created_at, index_merge_request_metrics, index_merge_request_metrics_on_first_deployed_to_production_at, index_merge_request_metrics_on_latest_closed_by_id, index_todos_on_commit_id, index_todos_on_group_id, index_users_on_managing_group_id, index_users_on_group_view, users_reset_password_token_key, index_users_on_static_object_token, index_users_on_bot_type, index_users_on_ghost, index_users_on_state_and_internal, index_users_on_state_and_internal_ee, index_users_on_state, index_users_on_admin, index_resource_label_events_on_merge_request_id, index_users_on_accepted_term_id, index_projects_on_runners_token_encrypted, index_resource_label_events_on_epic_id, index_issues_on_closed_by_id, idx_issues_on_state_id, index_issues_on_confidential, index_issues_on_state, idx_merge_requests_on_state_id_and_merge_status, index_keys_on_last_used_at, project_settings_pkey, index_internal_ids_on_namespace_id, projects_pkey, index_users_on_incoming_email_token, index_keys_on_fingerprint_sha256, users_confirmation_token_key, index_members_on_expires_at, index_members_on_requested_at, index_protected_branch_push_access_levels_on_group_id, index_protected_branch_push_access_levels_on_user_id, index_ci_builds_project_id_and_status_for_live_jobs_partial2, index_protected_branch_merge_access_levels_on_user_id, index_protected_branch_merge_access_levels_on_group_id, index_gpg_signatures_on_gpg_key_subkey_id, index_uploads_on_checksum, keys_pkey, index_merge_requests_on_updated_by_id, index_on_users_name_lower, index_ci_pipelines_on_merge_request_id, index_ci_builds_on_artifacts_expire_at, index_projects_api_vis20_last_activity_at, index_namespaces_on_file_template_project_id, index_keys_on_user_id, index_projects_on_id_partial_for_visibility, index_remote_mirrors_on_last_successful_update_at, index_web_hooks_on_type, index_merge_requests_on_merge_user_id, ci_variables_pkey, index_timelogs_on_merge_request_id, index_index_statuses_on_project_id, index_boards_on_milestone_id, index_boards_on_group_id, web_hooks_pkey, index_container_expiration_policies_on_next_run_at_and_enabled, releases_pkey, ci_runner_projects_pkey, index_releases_on_author_id, index_statuses_pkey, index_merge_request_metrics_on_latest_closed_at, index_namespaces_on_type_partial, index_milestones_on_group_id, index_ci_runner_projects_on_runner_id, namespace_aggregation_schedules_pkey, index_namespace_aggregation_schedules_on_namespace_id, project_group_links_pkey, namespace_statistics_pkey, project_import_data_pkey, deploy_keys_projects_pkey, index_deploy_keys_projects_on_project_id, index_merge_requests_on_id_and_merge_jid, idx_merge_requests_on_id_and_merge_jid, index_snippets_on_project_id_and_visibility_level, index_project_import_data_on_project_id, index_protected_branch_unprotect_access, protected_branch_unprotect_access_levels_pkey, index_snippets_on_visibility_level_and_secret, index_protected_branch_unprotect_access_levels_on_user_id, index_web_hooks_on_project_id, ci_runner_namespaces_pkey, index_snippets_on_updated_at, index_import_export_uploads_on_project_id, import_export_uploads_pkey, index_snippets_on_created_at, pages_domains_pkey, snippets_pkey, index_snippets_on_author_id, index_pages_domains_on_verified_at_and_enabled_until, index_import_export_uploads_on_updated_at, index_pages_domains_on_project_id_and_enabled_until, index_ci_runner_namespaces_on_runner_id_and_namespace_id, index_pages_domains_on_verified_at, index_projects_on_mirror_and_mirror_trigger_builds_both_true, index_issues_on_moved_to_id, index_ci_pipelines_on_external_pull_request_id, index_users_on_public_email, index_pages_domains_on_remove_at, index_pages_domains_on_project_id, index_emails_on_confirmation_token, index_for_resource_group, approval_project_rules_pkey, ci_group_variables_pkey, remote_mirrors_pkey, index_clusters_on_enabled, index_remote_mirrors_on_project_id, index_epics_on_closed_by_id, index_epics_on_assignee_id, index_clusters_kubernetes_namespaces_on_cluster_project_id, index_projects_on_pool_repository_id, index_label_priorities_on_priority, label_priorities_pkey, index_epics_on_parent_id, index_approval_project_rules_on_project_id, index_pages_domains_need_auto_ssl_renewal, index_pages_domains_on_wildcard, index_badges_on_group_id, clusters_pkey, index_users_on_unconfirmed_email, index_epics_on_end_date, index_namespaces_on_trial_ends_on, index_pages_domains_on_usage, index_epics_on_start_date, index_clusters_on_user_id, clusters_kubernetes_namespaces_pkey, index_ci_triggers_on_project_id, draft_notes_pkey, index_epics_on_group_id, index_clusters_kubernetes_namespaces_on_cluster_id, index_protected_tag_create_access_levels_on_user_id, index_clusters_kubernetes_namespaces_on_environment_id, index_draft_notes_on_discussion_id, index_pages_domains_on_scope, index_board_group_recent_visits_on_group_id, any_approver_project_rule_type_unique_index.

  • And the following indexes also have size > 1 MiB and index bloat estimate > 40.00%. However, they belong to the highly bloated tables (see F004), so if you plan to process those tables you may not need to use this additional list. Here are these indexes: index_project_mirror_data_on_status, index_ci_runners_on_contacted_at, index_ci_runners_on_is_shared, index_services_on_type, index_ci_runners_on_locked, index_ci_runners_on_runner_type, index_ci_runners_on_token, services_pkey, index_services_on_project_id, index_services_on_template, index_project_mirror_data_on_last_update_at_and_retry_count, index_personal_access_tokens_on_token_digest, index_mirror_data_on_next_execution_and_retry_count, index_project_mirror_data_on_last_successful_update_at, personal_access_tokens_pkey, index_personal_access_tokens_on_user_id, ci_runners_pkey, index_lists_on_milestone_id, index_lists_on_user_id, index_ci_pipeline_schedules_on_next_run_at_and_active, ci_build_trace_chunks_pkey, issue_links_pkey, index_deploy_tokens_on_token_encrypted, idx_proj_feat_usg_on_jira_dvcs_server_last_sync_at_and_proj_id, index_issue_links_on_target_id, index_issue_links_on_source_id, index_ci_build_trace_chunks_on_build_id_and_chunk_index, index_project_feature_usages_on_project_id, project_feature_usages_pkey, index_issue_links_on_source_id_and_target_id, index_deploy_tokens_on_token, deploy_tokens_pkey, index_oauth_applications_on_uid, ci_pipeline_schedules_pkey, idx_proj_feat_usg_on_jira_dvcs_cloud_last_sync_at_and_proj_id, index_ci_pipeline_schedules_on_project_id, index_ci_pipeline_schedules_on_owner_id, oauth_applications_pkey, index_oauth_applications_on_owner_id_and_owner_type.

  • If you want to get exact bloat numbers, clone the database, get index sizes, then apply database-wide VACUUM FULL (it eliminates all the bloat), and get new table sizes. Then compare old and new numbers.

  • To reduce the index bloat, consider one of the following approaches:

    • VACUUM FULL (⚠ requires downtime / maintenance window),
    • REINDEX (REINDEX INDEX, REINDEX TABLE; ⚠ requires downtime / maintenance window),
    • recreating indexes online using CREATE INDEX CONCURRENTLY, DROP INDEX CONCURRENTLY and renaming (not trivial for indexes supporting PK, FK) // REINDEX CONCURRENTLY is available in Postgres 12+,
    • one of the tools reducing the bloat online, without interrupting the operations:

  • Read more on this topic:

  Table of contents

F008 Autovacuum: Resource Usage

Observations

Data collected: 2020-02-18 02:27:55 +0000 UTC

Settings

Setting name Value Unit Pretty value
autovacuum_max_workers 6
autovacuum_vacuum_cost_delay 5 ms
autovacuum_vacuum_cost_limit 6000
autovacuum_work_mem -1 kB
log_autovacuum_min_duration 0 ms
maintenance_work_mem 2097152 kB 2.00 GiB
max_connections 300
shared_buffers 14450688 8kB 110.25 GiB
vacuum_cost_limit 200
work_mem 102400 kB 100.00 MiB

CPU

Cpu count you can see in report A001

RAM

Ram amount you can see in report A001

Max workers memory: 12 GiB

DISK

⚠ Warning: collection of current impact on disks is not yet implemented. Please refer to Postgres logs and see current read and write IO bandwidth caused by autovacuum.

Conclusions

Recommendations

  Table of contents

G001 Memory-related Settings

Observations

Data collected: 2020-02-18 02:29:30 +0000 UTC

Master (10.220.16.106)

Setting name Value Unit Pretty value
autovacuum_max_workers 6
autovacuum_work_mem -1 kB
effective_cache_size 43352064 8kB 330.75 GiB
maintenance_work_mem 2097152 kB 2.00 GiB
max_connections 300
shared_buffers 14450688 8kB 110.25 GiB
temp_buffers 1024 8kB 8.00 MiB
work_mem 102400 kB 100.00 MiB

Replica servers:

Replica (10.220.16.101)

Setting name Value Unit Pretty value
autovacuum_max_workers 6
autovacuum_work_mem -1 kB
effective_cache_size 43352064 8kB 330.75 GiB
maintenance_work_mem 2097152 kB 2.00 GiB
max_connections 300
shared_buffers 14450688 8kB 110.25 GiB
temp_buffers 1024 8kB 8.00 MiB
work_mem 102400 kB 100.00 MiB

Replica (10.220.16.102)

Setting name Value Unit Pretty value
autovacuum_max_workers 6
autovacuum_work_mem -1 kB
effective_cache_size 43352064 8kB 330.75 GiB
maintenance_work_mem 2097152 kB 2.00 GiB
max_connections 300
shared_buffers 14450688 8kB 110.25 GiB
temp_buffers 1024 8kB 8.00 MiB
work_mem 102400 kB 100.00 MiB

Replica (10.220.16.103)

Setting name Value Unit Pretty value
autovacuum_max_workers 6
autovacuum_work_mem -1 kB
effective_cache_size 43352064 8kB 330.75 GiB
maintenance_work_mem 2097152 kB 2.00 GiB
max_connections 300
shared_buffers 14450688 8kB 110.25 GiB
temp_buffers 1024 8kB 8.00 MiB
work_mem 102400 kB 100.00 MiB

Replica (10.220.16.104)

Setting name Value Unit Pretty value
autovacuum_max_workers 6
autovacuum_work_mem -1 kB
effective_cache_size 43352064 8kB 330.75 GiB
maintenance_work_mem 2097152 kB 2.00 GiB
max_connections 300
shared_buffers 14450688 8kB 110.25 GiB
temp_buffers 1024 8kB 8.00 MiB
work_mem 102400 kB 100.00 MiB

Replica (10.220.16.105)

Setting name Value Unit Pretty value
autovacuum_max_workers 6
autovacuum_work_mem -1 kB
effective_cache_size 43352064 8kB 330.75 GiB
maintenance_work_mem 2097152 kB 2.00 GiB
max_connections 300
shared_buffers 14450688 8kB 110.25 GiB
temp_buffers 1024 8kB 8.00 MiB
work_mem 102400 kB 100.00 MiB

Replica (10.220.16.107)

Setting name Value Unit Pretty value
autovacuum_max_workers 6
autovacuum_work_mem -1 kB
effective_cache_size 43352064 8kB 330.75 GiB
maintenance_work_mem 2097152 kB 2.00 GiB
max_connections 300
shared_buffers 14450688 8kB 110.25 GiB
temp_buffers 1024 8kB 8.00 MiB
work_mem 102400 kB 100.00 MiB

Replica (10.220.16.108)

Setting name Value Unit Pretty value
autovacuum_max_workers 6
autovacuum_work_mem -1 kB
effective_cache_size 43352064 8kB 330.75 GiB
maintenance_work_mem 2097152 kB 2.00 GiB
max_connections 300
shared_buffers 14450688 8kB 110.25 GiB
temp_buffers 1024 8kB 8.00 MiB
work_mem 102400 kB 100.00 MiB

Replica (10.220.16.109)

Setting name Value Unit Pretty value
autovacuum_max_workers 6
autovacuum_work_mem -1 kB
effective_cache_size 43352064 8kB 330.75 GiB
maintenance_work_mem 2097152 kB 2.00 GiB
max_connections 300
shared_buffers 14450688 8kB 110.25 GiB
temp_buffers 1024 8kB 8.00 MiB
work_mem 102400 kB 100.00 MiB

Conclusions

Recommendations

  Table of contents

G002 Connections and Current Activity

Observations

Data collected: 2020-02-18 02:29:31 +0000 UTC

Master (10.220.16.106)

The list is limited to 20 items. Total: 20.

# User DB Current state Count State changed >1m ago State changed >1h ago Tx age >1m Tx age >1h
1 ALL users ALL databases ALL states 228 1 1 1 0
2 gitlab ALL databases active 7 0 0 0 0
3 gitlab-psql ALL databases active 1 0 0 0 0
4 gitlab-checkup ALL databases active 1 0 0 0 0
5 gitlab ALL databases idle 144 1 1 0 0
6 pgbouncer ALL databases idle 6 0 0 0 0
7 gitlab-superuser ALL databases idle 2 0 0 0 0
8 gitlab-monitor ALL databases idle 1 0 0 0 0
9 postgres_exporter ALL databases idle 1 0 0 0 0
10 gitlab ALL databases idle in transaction 65 0 0 1 0
11 gitlab gitlabhq_production active 7 0 0 0 0
12 gitlab-checkup gitlabhq_production active 1 0 0 0 0
13 gitlab-psql gitlabhq_production active 1 0 0 0 0
14 gitlab gitlabhq_production idle 144 1 1 0 0
15 pgbouncer gitlabhq_production idle 6 0 0 0 0
16 gitlab-monitor gitlabhq_production idle 1 0 0 0 0
17 postgres_exporter gitlabhq_production idle 1 0 0 0 0
18 gitlab-superuser gitlabhq_production idle 1 0 0 0 0
19 gitlab gitlabhq_production idle in transaction 65 0 0 1 0
20 gitlab-superuser postgres idle 1 0 0 0 0

Replica servers:

Replica (10.220.16.101)

# User DB Current state Count State changed >1m ago State changed >1h ago Tx age >1m Tx age >1h
1 ALL users ALL databases ALL states 40 1 0 0 0
2 gitlab ALL databases active 5 0 0 0 0
3 postgres_exporter ALL databases active 1 0 0 0 0
4 gitlab-checkup ALL databases active 1 0 0 0 0
5 gitlab ALL databases idle 28 1 0 0 0
6 pgbouncer ALL databases idle 3 0 0 0 0
7 gitlab-monitor ALL databases idle 1 0 0 0 0
8 gitlab-superuser ALL databases idle 1 0 0 0 0
9 gitlab gitlabhq_production active 5 0 0 0 0
10 gitlab-checkup gitlabhq_production active 1 0 0 0 0
11 postgres_exporter gitlabhq_production active 1 0 0 0 0
12 gitlab gitlabhq_production idle 28 1 0 0 0
13 pgbouncer gitlabhq_production idle 3 0 0 0 0
14 gitlab-monitor gitlabhq_production idle 1 0 0 0 0
15 gitlab-superuser postgres idle 1 0 0 0 0

Replica (10.220.16.102)

# User DB Current state Count State changed >1m ago State changed >1h ago Tx age >1m Tx age >1h
1 ALL users ALL databases ALL states 36 0 0 0 0
2 gitlab-checkup ALL databases active 1 0 0 0 0
3 gitlab ALL databases idle 29 0 0 0 0
4 pgbouncer ALL databases idle 3 0 0 0 0
5 gitlab-monitor ALL databases idle 1 0 0 0 0
6 postgres_exporter ALL databases idle 1 0 0 0 0
7 gitlab-superuser ALL databases idle 1 0 0 0 0
8 gitlab-checkup gitlabhq_production active 1 0 0 0 0
9 gitlab gitlabhq_production idle 29 0 0 0 0
10 pgbouncer gitlabhq_production idle 3 0 0 0 0
11 postgres_exporter gitlabhq_production idle 1 0 0 0 0
12 gitlab-monitor gitlabhq_production idle 1 0 0 0 0
13 gitlab-superuser postgres idle 1 0 0 0 0

Replica (10.220.16.103)

# User DB Current state Count State changed >1m ago State changed >1h ago Tx age >1m Tx age >1h
1 ALL users ALL databases ALL states 35 0 0 0 0
2 gitlab-checkup ALL databases active 1 0 0 0 0
3 gitlab ALL databases active 1 0 0 0 0
4 gitlab ALL databases idle 27 0 0 0 0
5 pgbouncer ALL databases idle 3 0 0 0 0
6 gitlab-monitor ALL databases idle 1 0 0 0 0
7 gitlab-superuser ALL databases idle 1 0 0 0 0
8 postgres_exporter ALL databases idle 1 0 0 0 0
9 gitlab-checkup gitlabhq_production active 1 0 0 0 0
10 gitlab gitlabhq_production active 1 0 0 0 0
11 gitlab gitlabhq_production idle 27 0 0 0 0
12 pgbouncer gitlabhq_production idle 3 0 0 0 0
13 postgres_exporter gitlabhq_production idle 1 0 0 0 0
14 gitlab-monitor gitlabhq_production idle 1 0 0 0 0
15 gitlab-superuser postgres idle 1 0 0 0 0

Replica (10.220.16.104)

# User DB Current state Count State changed >1m ago State changed >1h ago Tx age >1m Tx age >1h
1 ALL users ALL databases ALL states 33 0 0 0 0
2 gitlab-checkup ALL databases active 1 0 0 0 0
3 gitlab ALL databases idle 26 0 0 0 0
4 pgbouncer ALL databases idle 3 0 0 0 0
5 gitlab-monitor ALL databases idle 1 0 0 0 0
6 postgres_exporter ALL databases idle 1 0 0 0 0
7 gitlab-superuser ALL databases idle 1 0 0 0 0
8 gitlab-checkup gitlabhq_production active 1 0 0 0 0
9 gitlab gitlabhq_production idle 26 0 0 0 0
10 pgbouncer gitlabhq_production idle 3 0 0 0 0
11 postgres_exporter gitlabhq_production idle 1 0 0 0 0
12 gitlab-monitor gitlabhq_production idle 1 0 0 0 0
13 gitlab-superuser postgres idle 1 0 0 0 0

Replica (10.220.16.105)

# User DB Current state Count State changed >1m ago State changed >1h ago Tx age >1m Tx age >1h
1 ALL users ALL databases ALL states 34 0 0 0 0
2 gitlab ALL databases active 3 0 0 0 0
3 gitlab-checkup ALL databases active 1 0 0 0 0
4 gitlab ALL databases idle 24 0 0 0 0
5 pgbouncer ALL databases idle 3 0 0 0 0
6 gitlab-monitor ALL databases idle 1 0 0 0 0
7 gitlab-superuser ALL databases idle 1 0 0 0 0
8 postgres_exporter ALL databases idle 1 0 0 0 0
9 gitlab gitlabhq_production active 3 0 0 0 0
10 gitlab-checkup gitlabhq_production active 1 0 0 0 0
11 gitlab gitlabhq_production idle 24 0 0 0 0
12 pgbouncer gitlabhq_production idle 3 0 0 0 0
13 postgres_exporter gitlabhq_production idle 1 0 0 0 0
14 gitlab-monitor gitlabhq_production idle 1 0 0 0 0
15 gitlab-superuser postgres idle 1 0 0 0 0

Replica (10.220.16.107)

# User DB Current state Count State changed >1m ago State changed >1h ago Tx age >1m Tx age >1h
1 ALL users ALL databases ALL states 35 0 0 0 0
2 gitlab ALL databases active 5 0 0 0 0
3 gitlab-checkup ALL databases active 1 0 0 0 0
4 gitlab ALL databases idle 23 0 0 0 0
5 pgbouncer ALL databases idle 3 0 0 0 0
6 gitlab-monitor ALL databases idle 1 0 0 0 0
7 gitlab-superuser ALL databases idle 1 0 0 0 0
8 postgres_exporter ALL databases idle 1 0 0 0 0
9 gitlab gitlabhq_production active 5 0 0 0 0
10 gitlab-checkup gitlabhq_production active 1 0 0 0 0
11 gitlab gitlabhq_production idle 23 0 0 0 0
12 pgbouncer gitlabhq_production idle 3 0 0 0 0
13 postgres_exporter gitlabhq_production idle 1 0 0 0 0
14 gitlab-monitor gitlabhq_production idle 1 0 0 0 0
15 gitlab-superuser postgres idle 1 0 0 0 0

Replica (10.220.16.108)

# User DB Current state Count State changed >1m ago State changed >1h ago Tx age >1m Tx age >1h
1 ALL users ALL databases ALL states 33 0 0 0 0
2 gitlab ALL databases active 3 0 0 0 0
3 gitlab-checkup ALL databases active 1 0 0 0 0
4 gitlab ALL databases idle 23 0 0 0 0
5 pgbouncer ALL databases idle 3 0 0 0 0
6 gitlab-monitor ALL databases idle 1 0 0 0 0
7 gitlab-superuser ALL databases idle 1 0 0 0 0
8 postgres_exporter ALL databases idle 1 0 0 0 0
9 gitlab gitlabhq_production active 3 0 0 0 0
10 gitlab-checkup gitlabhq_production active 1 0 0 0 0
11 gitlab gitlabhq_production idle 23 0 0 0 0
12 pgbouncer gitlabhq_production idle 3 0 0 0 0
13 postgres_exporter gitlabhq_production idle 1 0 0 0 0
14 gitlab-monitor gitlabhq_production idle 1 0 0 0 0
15 gitlab-superuser postgres idle 1 0 0 0 0

Replica (10.220.16.109)

# User DB Current state Count State changed >1m ago State changed >1h ago Tx age >1m Tx age >1h
1 ALL users ALL databases ALL states 36 0 0 0 0
2 gitlab ALL databases active 3 0 0 0 0
3 gitlab-checkup ALL databases active 1 0 0 0 0
4 gitlab ALL databases idle 26 0 0 0 0
5 pgbouncer ALL databases idle 3 0 0 0 0
6 gitlab-monitor ALL databases idle 1 0 0 0 0
7 gitlab-superuser ALL databases idle 1 0 0 0 0
8 postgres_exporter ALL databases idle 1 0 0 0 0
9 gitlab gitlabhq_production active 3 0 0 0 0
10 gitlab-checkup gitlabhq_production active 1 0 0 0 0
11 gitlab gitlabhq_production idle 26 0 0 0 0
12 pgbouncer gitlabhq_production idle 3 0 0 0 0
13 postgres_exporter gitlabhq_production idle 1 0 0 0 0
14 gitlab-monitor gitlabhq_production idle 1 0 0 0 0
15 gitlab-superuser postgres idle 1 0 0 0 0

Conclusions

Recommendations

All good, no recommendations here.

  Table of contents

G003 Timeouts, Locks, Deadlocks

Observations

Data collected: 2020-02-18 02:29:31 +0000 UTC

Master (10.220.16.106)

Timeouts

Setting name Value Unit Pretty value
authentication_timeout 60 s
idle_in_transaction_session_timeout 30000 ms
statement_timeout 15000 ms

Locks

Setting name Value Unit Pretty value
deadlock_timeout 5000 ms
lock_timeout 0 ms
max_locks_per_transaction 128
max_pred_locks_per_transaction 64

Databases data

# Database Conflicts ▼ Deadlocks Stats reset at Stat reset
1 gitlabhq_production 4 938 2019-10-28T16:07:34.673503+00:00 112 days 10:20:23
2 postgres 0 0 2019-10-28T16:07:29.861973+00:00 112 days 10:20:28

Replica servers:

Replica (10.220.16.101)

Timeouts

Setting name Value Unit Pretty value
authentication_timeout 60 s
idle_in_transaction_session_timeout 30000 ms
statement_timeout 15000 ms

Locks

Setting name Value Unit Pretty value
deadlock_timeout 5000 ms
lock_timeout 0 ms
max_locks_per_transaction 128
max_pred_locks_per_transaction 64

Databases data

Database Conflicts ▼ Deadlocks Stats reset at Stat reset
postgres 0 0 2019-12-12T07:32:12.080501+00:00 67 days 18:53:06
gitlabhq_production 2 0 2019-12-12T07:32:12.114073+00:00 67 days 18:53:06

Replica (10.220.16.102)

Timeouts

Setting name Value Unit Pretty value
authentication_timeout 60 s
idle_in_transaction_session_timeout 30000 ms
statement_timeout 15000 ms

Locks

Setting name Value Unit Pretty value
deadlock_timeout 5000 ms
lock_timeout 0 ms
max_locks_per_transaction 128
max_pred_locks_per_transaction 64

Databases data

Database Conflicts ▼ Deadlocks Stats reset at Stat reset
postgres 0 0 2019-12-12T07:32:11.427924+00:00 67 days 18:53:34
gitlabhq_production 0 0 2019-12-12T07:32:11.45222+00:00 67 days 18:53:34

Replica (10.220.16.103)

Timeouts

Setting name Value Unit Pretty value
authentication_timeout 60 s
idle_in_transaction_session_timeout 30000 ms
statement_timeout 15000 ms

Locks

Setting name Value Unit Pretty value
deadlock_timeout 5000 ms
lock_timeout 0 ms
max_locks_per_transaction 128
max_pred_locks_per_transaction 64

Databases data

Database Conflicts ▼ Deadlocks Stats reset at Stat reset
postgres 0 0 2019-12-12T07:32:12.581377+00:00 67 days 18:54:02
gitlabhq_production 0 0 2019-12-12T07:32:12.982689+00:00 67 days 18:54:02

Replica (10.220.16.104)

Timeouts

Setting name Value Unit Pretty value
authentication_timeout 60 s
idle_in_transaction_session_timeout 30000 ms
statement_timeout 15000 ms

Locks

Setting name Value Unit Pretty value
deadlock_timeout 5000 ms
lock_timeout 0 ms
max_locks_per_transaction 128
max_pred_locks_per_transaction 64

Databases data

Database Conflicts ▼ Deadlocks Stats reset at Stat reset
postgres 0 0 2019-12-12T07:32:11.156846+00:00 67 days 18:54:33
gitlabhq_production 0 0 2019-12-12T07:32:12.131981+00:00 67 days 18:54:32

Replica (10.220.16.105)

Timeouts

Setting name Value Unit Pretty value
authentication_timeout 60 s
idle_in_transaction_session_timeout 30000 ms
statement_timeout 15000 ms

Locks

Setting name Value Unit Pretty value
deadlock_timeout 5000 ms
lock_timeout 0 ms
max_locks_per_transaction 128
max_pred_locks_per_transaction 64

Databases data

Database Conflicts ▼ Deadlocks Stats reset at Stat reset
postgres 0 0 2019-12-12T07:32:17.615779+00:00 67 days 18:54:56
gitlabhq_production 0 0 2019-12-12T07:32:20.485667+00:00 67 days 18:54:53

Replica (10.220.16.107)

Timeouts

Setting name Value Unit Pretty value
authentication_timeout 60 s
idle_in_transaction_session_timeout 30000 ms
statement_timeout 15000 ms

Locks

Setting name Value Unit Pretty value
deadlock_timeout 5000 ms
lock_timeout 0 ms
max_locks_per_transaction 128
max_pred_locks_per_transaction 64

Databases data

Database Conflicts ▼ Deadlocks Stats reset at Stat reset
postgres 0 0 2019-12-12T07:32:10.361007+00:00 67 days 18:56:20
gitlabhq_production 0 0 2019-12-12T07:32:11.376209+00:00 67 days 18:56:19

Replica (10.220.16.108)

Timeouts

Setting name Value Unit Pretty value
authentication_timeout 60 s
idle_in_transaction_session_timeout 30000 ms
statement_timeout 15000 ms

Locks

Setting name Value Unit Pretty value
deadlock_timeout 5000 ms
lock_timeout 0 ms
max_locks_per_transaction 128
max_pred_locks_per_transaction 64

Databases data

Database Conflicts ▼ Deadlocks Stats reset at Stat reset
postgres 0 0 2019-12-12T07:32:20.760583+00:00 67 days 18:56:40
gitlabhq_production 0 0 2019-12-12T07:32:20.698715+00:00 67 days 18:56:40

Replica (10.220.16.109)

Timeouts

Setting name Value Unit Pretty value
authentication_timeout 60 s
idle_in_transaction_session_timeout 30000 ms
statement_timeout 15000 ms

Locks

Setting name Value Unit Pretty value
deadlock_timeout 5000 ms
lock_timeout 0 ms
max_locks_per_transaction 128
max_pred_locks_per_transaction 64

Databases data

Database Conflicts ▼ Deadlocks Stats reset at Stat reset
postgres 0 0 2019-12-12T07:32:21.689386+00:00 67 days 18:57:11
gitlabhq_production 0 0 2019-12-12T07:32:24.58281+00:00 67 days 18:57:08

Conclusions

Recommendations

  Table of contents

H001 Invalid Indexes

Observations

Data collected: 2020-02-18 02:27:57 +0000 UTC
Current database: gitlabhq_production

Master (10.220.16.106)

Invalid indexes not found

Conclusions

Recommendations

  Table of contents

H002 Unused Indexes

Observations

Data collected: 2020-02-18 02:29:32 +0000 UTC
Current database: gitlabhq_production

Stats reset: 3 mons 20 days 10:20:00 ago (2019-10-28 16:07:35 +0000 UTC)

Never Used Indexes

The list is limited to 20 items. Total: 74.

# Table Index 10.220.16.106 usage 10.220.16.101 usage 10.220.16.102 usage 10.220.16.103 usage 10.220.16.104 usage 10.220.16.105 usage 10.220.16.107 usage 10.220.16.108 usage 10.220.16.109 usage ▼ Index size Table size Supports FK
  =====TOTAL===== 61.82 GiB 2.37 TiB
1 ci_builds index_ci_builds_on_queued_at 0 0 0 0 0 0 0 14.32 GiB 421.39 GiB
2 ci_builds index_ci_builds_on_protected 0 0 0 0 0 0 0 0 0 14.22 GiB 421.39 GiB
3 ci_job_artifacts index_ci_job_artifacts_on_file_store 0 0 0 0 0 0 0 0 10.64 GiB 53.89 GiB
4 audit_events analytics_index_audit_events_on_created_at_and_author_id 0 7.10 GiB 57.08 GiB
5 merge_request_diffs index_merge_request_diffs_on_merge_request_id_and_id_partial 0 0 0 0 0 0 0 0 0 1.89 GiB 14.15 GiB Yes
6 projects index_projects_on_runners_token 0 0 0 0 0 0 0 0 0 1.72 GiB 3.34 GiB Yes
7 projects index_projects_on_last_repository_check_failed 0 0 0 0 0 0 0 0 0 1.71 GiB 3.34 GiB Yes
8 merge_requests index_merge_requests_on_state_and_merge_status 0 0 0 0 0 0 0 0 1.46 GiB 18.28 GiB
9 issues index_issues_on_state 0 0 0 0 0 0 0 0 0 896.33 MiB 15.53 GiB Yes
10 projects idx_project_repository_check_partial 0 0 0 0 0 0 0 0 0 763.08 MiB 3.34 GiB Yes
11 merge_requests index_merge_requests_on_source_project_and_branch_state_opened 0 0 0 0 0 0 0 0 0 695.46 MiB 18.28 GiB
12 projects index_on_projects_lower_path 0 0 0 0 0 0 0 0 0 574.07 MiB 3.34 GiB Yes
13 users index_users_on_accepted_term_id 0 0 0 0 0 0 0 0 0 570.86 MiB 2.41 GiB Yes
14 members index_members_on_access_level 0 449.90 MiB 1.66 GiB
15 ci_runners index_ci_runners_on_contacted_at 0 409.10 MiB 371.92 MiB
16 ci_runners index_ci_runners_on_is_shared 0 0 0 0 0 0 0 0 0 399.94 MiB 371.92 MiB
17 ci_runners index_ci_runners_on_locked 0 0 0 0 0 0 0 0 0 386.25 MiB 371.92 MiB
18 ci_runners index_ci_runners_on_token 0 0 0 0 0 0 0 0 0 364.04 MiB 371.92 MiB
19 merge_requests index_merge_requests_on_target_project_id_and_iid_opened 0 0 0 0 0 0 0 329.48 MiB 18.28 GiB Yes
20 keys index_keys_on_last_used_at 0 0 0 0 0 0 325.32 MiB 1.94 GiB

Rarely Used Indexes

The list is limited to 20 items. Total: 291.

# Table Index 10.220.16.106 usage 10.220.16.101 usage 10.220.16.102 usage 10.220.16.103 usage 10.220.16.104 usage 10.220.16.105 usage 10.220.16.107 usage 10.220.16.108 usage 10.220.16.109 usage ▼ Index size Table size Comment Supports FK
  =====TOTAL===== 804.87 GiB 10.32 TiB
1 merge_request_diff_commits index_merge_request_diff_commits_on_sha scans: 118,870,428/hour, writes: 490,747,005/hour scans: 326,994/hour, writes: 0/hour scans: 326,586/hour, writes: 0/hour scans: 326,279/hour, writes: 0/hour scans: 327,588/hour, writes: 0/hour scans: 326,391/hour, writes: 0/hour scans: 327,160/hour, writes: 0/hour scans: 326,234/hour, writes: 0/hour scans: 326,338/hour, writes: 0/hour 110.78 GiB 600.96 GiB Low Scans, High Writes
2 ci_build_trace_sections index_ci_build_trace_sections_on_section_name_id scans: 397,671/hour, writes: 674,375,248/hour 52.45 GiB 146.29 GiB Low Scans, High Writes
3 ci_build_trace_sections index_ci_build_trace_sections_on_project_id scans: 514,241/hour, writes: 674,375,248/hour 51.50 GiB 146.29 GiB Low Scans, High Writes
4 ci_builds index_ci_builds_on_status_and_type_and_runner_id scans: 259,897,499/hour, writes: 409,220,444/hour scans: 24,569,271/hour, writes: 0/hour scans: 24,569,552/hour, writes: 0/hour scans: 24,570,631/hour, writes: 0/hour scans: 24,572,360/hour, writes: 0/hour scans: 24,573,845/hour, writes: 0/hour scans: 24,571,273/hour, writes: 0/hour scans: 24,569,333/hour, writes: 0/hour scans: 24,541,774/hour, writes: 0/hour 22.87 GiB 421.39 GiB Low Scans, High Writes
5 events index_events_on_project_id_and_created_at scans: 42,181/hour, writes: 123,599,439/hour scans: 715,976/hour, writes: 0/hour scans: 788,140/hour, writes: 0/hour scans: 728,154/hour, writes: 0/hour scans: 700,600/hour, writes: 0/hour scans: 722,480/hour, writes: 0/hour scans: 744,648/hour, writes: 0/hour scans: 655,323/hour, writes: 0/hour scans: 705,461/hour, writes: 0/hour 22.59 GiB 37.39 GiB Low Scans, High Writes
6 ci_builds ci_builds_gitlab_monitor_metrics scans: 54,695/hour, writes: 409,220,444/hour scans: 8,938/hour, writes: 0/hour scans: 9,165/hour, writes: 0/hour scans: 9,088/hour, writes: 0/hour scans: 9,005/hour, writes: 0/hour scans: 8,944/hour, writes: 0/hour scans: 9,014/hour, writes: 0/hour scans: 9,049/hour, writes: 0/hour scans: 8,980/hour, writes: 0/hour 19.38 GiB 421.39 GiB Low Scans, High Writes
7 notes index_notes_on_discussion_id scans: 42,157,635/hour, writes: 81,964,440/hour scans: 298,153/hour, writes: 0/hour scans: 298,527/hour, writes: 0/hour scans: 297,503/hour, writes: 0/hour scans: 299,008/hour, writes: 0/hour scans: 297,449/hour, writes: 0/hour scans: 297,560/hour, writes: 0/hour scans: 298,517/hour, writes: 0/hour scans: 298,045/hour, writes: 0/hour 17.52 GiB 162.46 GiB Low Scans, High Writes
8 events analytics_index_events_on_created_at_and_author_id scans: 315,102/hour, writes: 123,599,439/hour scans: 1,461,302/hour, writes: 0/hour scans: 1,457,640/hour, writes: 0/hour scans: 1,457,119/hour, writes: 0/hour scans: 1,456,359/hour, writes: 0/hour scans: 1,460,290/hour, writes: 0/hour scans: 1,457,582/hour, writes: 0/hour scans: 1,461,039/hour, writes: 0/hour scans: 1,458,276/hour, writes: 0/hour 16.79 GiB 37.39 GiB Low Scans, High Writes
9 events index_events_on_author_id_and_project_id scans: 17,549,076/hour, writes: 123,599,439/hour 15.01 GiB 37.39 GiB Low Scans, High Writes
10 events index_events_on_project_id_and_id scans: 21,182,676/hour, writes: 123,599,439/hour 14.79 GiB 37.39 GiB Low Scans, High Writes
11 ci_builds index_ci_builds_on_auto_canceled_by_id scans: 2,427,192/hour, writes: 409,220,444/hour 14.28 GiB 421.39 GiB Low Scans, High Writes Yes
12 ci_builds tmp_build_stage_position_index scans: 1,038/hour, writes: 409,220,444/hour 14.21 GiB 421.39 GiB Low Scans, High Writes
13 ci_builds index_ci_builds_on_project_id_and_name_and_ref scans: 102/hour, writes: 409,220,444/hour scans: 9/hour, writes: 0/hour 14.16 GiB 421.39 GiB Low Scans, High Writes
14 ci_job_artifacts index_ci_job_artifacts_on_expire_at_and_job_id scans: 283,127/hour, writes: 283,381,819/hour 13.95 GiB 53.89 GiB Low Scans, High Writes
15 events index_events_on_action scans: 22/hour, writes: 123,599,439/hour scans: 1,886/hour, writes: 0/hour scans: 1,770/hour, writes: 0/hour scans: 1,899/hour, writes: 0/hour scans: 1,878/hour, writes: 0/hour scans: 1,898/hour, writes: 0/hour scans: 1,888/hour, writes: 0/hour scans: 1,840/hour, writes: 0/hour scans: 1,772/hour, writes: 0/hour 13.78 GiB 37.39 GiB Low Scans, High Writes
16 ci_builds index_ci_builds_on_runner_id scans: 62,691,585/hour, writes: 409,220,444/hour scans: 6,859,048/hour, writes: 0/hour scans: 6,858,435/hour, writes: 0/hour scans: 6,860,849/hour, writes: 0/hour scans: 6,858,599/hour, writes: 0/hour scans: 6,859,250/hour, writes: 0/hour scans: 6,856,751/hour, writes: 0/hour scans: 6,855,412/hour, writes: 0/hour scans: 6,857,081/hour, writes: 0/hour 13.77 GiB 421.39 GiB Low Scans, High Writes Yes
17 ci_builds index_ci_builds_on_updated_at scans: 17,518/hour, writes: 409,220,444/hour 12.49 GiB 421.39 GiB Low Scans, High Writes
18 ci_builds index_ci_builds_on_user_id scans: 21,342/hour, writes: 409,220,444/hour scans: 2/hour, writes: 0/hour 11.50 GiB 421.39 GiB Low Scans, High Writes Yes
19 ci_job_artifacts index_ci_job_artifacts_on_project_id scans: 517,751/hour, writes: 283,381,819/hour scans: 1,275/hour, writes: 0/hour scans: 1,212/hour, writes: 0/hour scans: 1,278/hour, writes: 0/hour scans: 1,338/hour, writes: 0/hour scans: 1,410/hour, writes: 0/hour scans: 1,280/hour, writes: 0/hour scans: 1,281/hour, writes: 0/hour scans: 1,326/hour, writes: 0/hour 9.45 GiB 53.89 GiB Low Scans, High Writes
20 ci_builds_metadata index_ci_builds_metadata_on_project_id scans: 514,238/hour, writes: 182,932,109/hour 9.39 GiB 17.92 GiB Low Scans, High Writes

Conclusions

  • [P3] 74 unused index(es) have been found.

Recommendations

  • [P3] Use the database migration provided below to drop the unused indexes. Keep in mind, that under load, it is recommended to use DROP INDEX CONCURRENTLY (and CREATE INDEX CONCURRENTLY if reverting is needed) to avoid blocking issues.
  • Be careful dropping the indexes. If you have multiple setups of your software, the analysis of just a single setup might be not enough. Some indexes might be used (and therefore, needed) only on a limited number of setups. Also, in some cases, developers prepare indexes for new features in advance – in such cases, dropping those indexes is not a good idea.
  • If there are some doubts, consider a more careful approach. Before actualdropping, indexes disable listed in this report. For this, use queries like `UPDATE pg_index SET indisvalid = false WHERE indexrelid::regclass = (select oid from pg_class where relname = 'u_users_email');. Indexes will continue to get updates. In case of some performance degradations, re-enable the corresponding indexes, setting indisvalid to true. If everything looks fine, after a significant period of observations, proceed with DROP INDEX CONCURRENTLY.
  • "DO" database migrations
DROP INDEX CONCURRENTLY analytics_index_audit_events_on_created_at_and_author_id; -- 7262 MB, Never Used Indexes, table audit_events  
DROP INDEX CONCURRENTLY index_ci_builds_on_artifacts_expire_at; -- 82 MB, Never Used Indexes, table ci_builds  
DROP INDEX CONCURRENTLY index_ci_builds_on_name_for_security_reports_values; -- 123 MB, Never Used Indexes, table ci_builds  
DROP INDEX CONCURRENTLY index_ci_builds_on_project_id_for_successfull_pages_deploy; -- 99 MB, Never Used Indexes, table ci_builds  
DROP INDEX CONCURRENTLY index_ci_builds_on_protected; -- 14 GB, Never Used Indexes, table ci_builds  
DROP INDEX CONCURRENTLY index_ci_builds_on_queued_at; -- 14 GB, Never Used Indexes, table ci_builds  
DROP INDEX CONCURRENTLY index_ci_builds_metadata_on_build_id_and_has_exposed_artifacts; -- 1576 kB, Never Used Indexes, table ci_builds_metadata  
DROP INDEX CONCURRENTLY index_ci_job_artifacts_on_file_store; -- 11 GB, Never Used Indexes, table ci_job_artifacts  
DROP INDEX CONCURRENTLY index_ci_pipeline_schedules_on_next_run_at_and_active; -- 31 MB, Never Used Indexes, table ci_pipeline_schedules  
DROP INDEX CONCURRENTLY index_ci_runners_on_contacted_at; -- 409 MB, Never Used Indexes, table ci_runners  
DROP INDEX CONCURRENTLY index_ci_runners_on_is_shared; -- 400 MB, Never Used Indexes, table ci_runners  
DROP INDEX CONCURRENTLY index_ci_runners_on_locked; -- 386 MB, Never Used Indexes, table ci_runners  
DROP INDEX CONCURRENTLY index_ci_runners_on_token; -- 364 MB, Never Used Indexes, table ci_runners  
DROP INDEX CONCURRENTLY index_cluster_providers_gcp_on_cloud_run; -- 328 kB, Never Used Indexes, table cluster_providers_gcp  
DROP INDEX CONCURRENTLY index_deploy_tokens_on_token_and_expires_at_and_id; -- 15 MB, Never Used Indexes, table deploy_tokens  
DROP INDEX CONCURRENTLY idx_deployment_clusters_on_cluster_id_and_kubernetes_namespace; -- 3128 kB, Never Used Indexes, table deployment_clusters  
DROP INDEX CONCURRENTLY partial_index_deployments_for_legacy_successful_deployments; -- 16 kB, Never Used Indexes, table deployments  
DROP INDEX CONCURRENTLY index_design_management_designs_versions_on_event; -- 160 kB, Never Used Indexes, table design_management_designs_versions  
DROP INDEX CONCURRENTLY index_elasticsearch_indexed_namespaces_on_created_at; -- 16 kB, Never Used Indexes, table elasticsearch_indexed_namespaces  
DROP INDEX CONCURRENTLY index_environments_on_state_and_auto_stop_at; -- 16 kB, Never Used Indexes, table environments  
DROP INDEX CONCURRENTLY index_gitlab_subscription_histories_on_gitlab_subscription_id; -- 1128 kB, Never Used Indexes, table gitlab_subscription_histories  
DROP INDEX CONCURRENTLY index_grafana_integrations_on_enabled; -- 16 kB, Never Used Indexes, table grafana_integrations  
DROP INDEX CONCURRENTLY index_import_failures_on_correlation_id_value; -- 200 kB, Never Used Indexes, table import_failures  
DROP INDEX CONCURRENTLY index_import_failures_on_project_id_not_null; -- 120 kB, Never Used Indexes, table import_failures  
DROP INDEX CONCURRENTLY index_issues_on_state; -- 896 MB, Never Used Indexes, table issues  
DROP INDEX CONCURRENTLY issue_id_issues_self_managed_rometheus_alert_events_index; -- 16 kB, Never Used Indexes, table issues_self_managed_prometheus_alert_events  
DROP INDEX CONCURRENTLY idx_jira_connect_subscriptions_on_installation_id; -- 16 kB, Never Used Indexes, table jira_connect_subscriptions  
DROP INDEX CONCURRENTLY index_keys_on_last_used_at; -- 325 MB, Never Used Indexes, table keys  
DROP INDEX CONCURRENTLY index_label_priorities_on_priority; -- 3792 kB, Never Used Indexes, table label_priorities  
DROP INDEX CONCURRENTLY index_labels_on_group_id_and_title; -- 8192 bytes, Never Used Indexes, table labels  
DROP INDEX CONCURRENTLY index_labels_on_project_id_and_title; -- 8192 bytes, Never Used Indexes, table labels  
DROP INDEX CONCURRENTLY index_members_on_access_level; -- 450 MB, Never Used Indexes, table members  
DROP INDEX CONCURRENTLY index_merge_request_diffs_on_merge_request_id_and_id_partial; -- 1933 MB, Never Used Indexes, table merge_request_diffs  
DROP INDEX CONCURRENTLY index_merge_request_metrics_on_latest_closed_at; -- 51 MB, Never Used Indexes, table merge_request_metrics  
DROP INDEX CONCURRENTLY idx_merge_requests_on_state_id_and_merge_status; -- 270 MB, Never Used Indexes, table merge_requests  
DROP INDEX CONCURRENTLY index_merge_requests_on_id_and_merge_jid; -- 11 MB, Never Used Indexes, table merge_requests  
DROP INDEX CONCURRENTLY index_merge_requests_on_source_project_and_branch_state_opened; -- 695 MB, Never Used Indexes, table merge_requests  
DROP INDEX CONCURRENTLY index_merge_requests_on_state_and_merge_status; -- 1487 MB, Never Used Indexes, table merge_requests  
DROP INDEX CONCURRENTLY index_merge_requests_on_target_project_id_and_iid_opened; -- 329 MB, Never Used Indexes, table merge_requests  
DROP INDEX CONCURRENTLY index_namespaces_on_created_at; -- 142 MB, Never Used Indexes, table namespaces  
DROP INDEX CONCURRENTLY index_namespaces_on_ldap_sync_last_successful_update_at; -- 148 MB, Never Used Indexes, table namespaces  
DROP INDEX CONCURRENTLY index_namespaces_on_ldap_sync_last_update_at; -- 148 MB, Never Used Indexes, table namespaces  
DROP INDEX CONCURRENTLY index_namespaces_on_plan_id; -- 148 MB, Never Used Indexes, table namespaces  
DROP INDEX CONCURRENTLY index_namespaces_on_require_two_factor_authentication; -- 148 MB, Never Used Indexes, table namespaces  
DROP INDEX CONCURRENTLY index_packages_dependency_links_on_dependency_id; -- 4552 kB, Never Used Indexes, table packages_dependency_links  
DROP INDEX CONCURRENTLY index_pages_domains_need_auto_ssl_renewal; -- 1784 kB, Never Used Indexes, table pages_domains  
DROP INDEX CONCURRENTLY index_pages_domains_on_verified_at_and_enabled_until; -- 6080 kB, Never Used Indexes, table pages_domains  
DROP INDEX CONCURRENTLY index_project_custom_attributes_on_key_and_value; -- 16 kB, Never Used Indexes, table project_custom_attributes  
DROP INDEX CONCURRENTLY index_project_mirror_data_on_last_successful_update_at; -- 162 MB, Never Used Indexes, table project_mirror_data  
DROP INDEX CONCURRENTLY index_project_repositories_on_shard_id; -- 324 MB, Never Used Indexes, table project_repositories  
DROP INDEX CONCURRENTLY idx_repository_states_on_last_repository_verification_ran_at; -- 227 MB, Never Used Indexes, table project_repository_states  
DROP INDEX CONCURRENTLY idx_repository_states_on_last_wiki_verification_ran_at; -- 243 MB, Never Used Indexes, table project_repository_states  
DROP INDEX CONCURRENTLY idx_repository_states_on_repository_failure_partial; -- 16 kB, Never Used Indexes, table project_repository_states  
DROP INDEX CONCURRENTLY idx_repository_states_on_wiki_failure_partial; -- 8192 bytes, Never Used Indexes, table project_repository_states  
DROP INDEX CONCURRENTLY idx_repository_states_outdated_checksums; -- 23 MB, Never Used Indexes, table project_repository_states  
DROP INDEX CONCURRENTLY idx_project_repository_check_partial; -- 763 MB, Never Used Indexes, table projects  
DROP INDEX CONCURRENTLY index_on_projects_lower_path; -- 574 MB, Never Used Indexes, table projects  
DROP INDEX CONCURRENTLY index_projects_api_vis20_name; -- 72 MB, Never Used Indexes, table projects  
DROP INDEX CONCURRENTLY index_projects_api_vis20_path; -- 72 MB, Never Used Indexes, table projects  
DROP INDEX CONCURRENTLY index_projects_api_vis20_updated_at; -- 70 MB, Never Used Indexes, table projects  
DROP INDEX CONCURRENTLY index_projects_on_last_repository_check_at; -- 16 kB, Never Used Indexes, table projects  
DROP INDEX CONCURRENTLY index_projects_on_last_repository_check_failed; -- 1743 MB, Never Used Indexes, table projects  
DROP INDEX CONCURRENTLY index_projects_on_mirror_and_mirror_trigger_builds_both_true; -- 5592 kB, Never Used Indexes, table projects  
DROP INDEX CONCURRENTLY index_projects_on_runners_token; -- 1753 MB, Never Used Indexes, table projects  
DROP INDEX CONCURRENTLY index_prometheus_metrics_on_group; -- 40 kB, Never Used Indexes, table prometheus_metrics  
DROP INDEX CONCURRENTLY index_remote_mirrors_on_last_successful_update_at; -- 56 MB, Never Used Indexes, table remote_mirrors  
DROP INDEX CONCURRENTLY idx_security_scans_on_scan_type; -- 680 kB, Never Used Indexes, table security_scans  
DROP INDEX CONCURRENTLY index_term_agreements_on_term_id; -- 110 MB, Never Used Indexes, table term_agreements  
DROP INDEX CONCURRENTLY index_timelogs_on_user_id; -- 44 MB, Never Used Indexes, table timelogs  
DROP INDEX CONCURRENTLY index_user_custom_attributes_on_key_and_value; -- 16 kB, Never Used Indexes, table user_custom_attributes  
DROP INDEX CONCURRENTLY index_users_on_accepted_term_id; -- 571 MB, Never Used Indexes, table users  
DROP INDEX CONCURRENTLY index_x509_certificates_on_x509_issuer_id; -- 16 kB, Never Used Indexes, table x509_certificates  
DROP INDEX CONCURRENTLY index_x509_commit_signatures_on_x509_certificate_id; -- 16 kB, Never Used Indexes, table x509_commit_signatures  
DROP INDEX CONCURRENTLY index_zoom_meetings_on_issue_status; -- 16 kB, Never Used Indexes, table zoom_meetings
  • "UNDO" database migrations
CREATE INDEX CONCURRENTLY analytics_index_audit_events_on_created_at_and_author_id ON public.audit_events USING btree (created_at, author_id); -- table audit_events  
CREATE INDEX CONCURRENTLY index_ci_builds_on_artifacts_expire_at ON public.ci_builds USING btree (artifacts_expire_at) WHERE (artifacts_file <> ''::text); -- table ci_builds  
CREATE INDEX CONCURRENTLY index_ci_builds_on_name_for_security_reports_values ON public.ci_builds USING btree (name) WHERE ((name)::text = ANY (ARRAY[('container_scanning'::character varying)::text, ('dast'::character varying)::text, ('dependency_scanning'::character varying)::text, ('license_management'::character varying)::text, ('sast'::character varying)::text, ('license_scanning'::character varying)::text])); -- table ci_builds  
CREATE INDEX CONCURRENTLY index_ci_builds_on_project_id_for_successfull_pages_deploy ON public.ci_builds USING btree (project_id) WHERE (((type)::text = 'GenericCommitStatus'::text) AND ((stage)::text = 'deploy'::text) AND ((name)::text = 'pages:deploy'::text) AND ((status)::text = 'success'::text)); -- table ci_builds  
CREATE INDEX CONCURRENTLY index_ci_builds_on_protected ON public.ci_builds USING btree (protected); -- table ci_builds  
CREATE INDEX CONCURRENTLY index_ci_builds_on_queued_at ON public.ci_builds USING btree (queued_at); -- table ci_builds  
CREATE INDEX CONCURRENTLY index_ci_builds_metadata_on_build_id_and_has_exposed_artifacts ON public.ci_builds_metadata USING btree (build_id) WHERE (has_exposed_artifacts IS TRUE); -- table ci_builds_metadata  
CREATE INDEX CONCURRENTLY index_ci_job_artifacts_on_file_store ON public.ci_job_artifacts USING btree (file_store); -- table ci_job_artifacts  
CREATE INDEX CONCURRENTLY index_ci_pipeline_schedules_on_next_run_at_and_active ON public.ci_pipeline_schedules USING btree (next_run_at, active); -- table ci_pipeline_schedules  
CREATE INDEX CONCURRENTLY index_ci_runners_on_contacted_at ON public.ci_runners USING btree (contacted_at); -- table ci_runners  
CREATE INDEX CONCURRENTLY index_ci_runners_on_is_shared ON public.ci_runners USING btree (is_shared); -- table ci_runners  
CREATE INDEX CONCURRENTLY index_ci_runners_on_locked ON public.ci_runners USING btree (locked); -- table ci_runners  
CREATE INDEX CONCURRENTLY index_ci_runners_on_token ON public.ci_runners USING btree (token); -- table ci_runners  
CREATE INDEX CONCURRENTLY index_cluster_providers_gcp_on_cloud_run ON public.cluster_providers_gcp USING btree (cloud_run); -- table cluster_providers_gcp  
CREATE INDEX CONCURRENTLY index_deploy_tokens_on_token_and_expires_at_and_id ON public.deploy_tokens USING btree (token, expires_at, id) WHERE (revoked IS FALSE); -- table deploy_tokens  
CREATE INDEX CONCURRENTLY idx_deployment_clusters_on_cluster_id_and_kubernetes_namespace ON public.deployment_clusters USING btree (cluster_id, kubernetes_namespace); -- table deployment_clusters  
CREATE INDEX CONCURRENTLY partial_index_deployments_for_legacy_successful_deployments ON public.deployments USING btree (id) WHERE ((finished_at IS NULL) AND (status = 2)); -- table deployments  
CREATE INDEX CONCURRENTLY index_design_management_designs_versions_on_event ON public.design_management_designs_versions USING btree (event); -- table design_management_designs_versions  
CREATE INDEX CONCURRENTLY index_elasticsearch_indexed_namespaces_on_created_at ON public.elasticsearch_indexed_namespaces USING btree (created_at); -- table elasticsearch_indexed_namespaces  
CREATE INDEX CONCURRENTLY index_environments_on_state_and_auto_stop_at ON public.environments USING btree (state, auto_stop_at) WHERE ((auto_stop_at IS NOT NULL) AND ((state)::text = 'available'::text)); -- table environments  
CREATE INDEX CONCURRENTLY index_gitlab_subscription_histories_on_gitlab_subscription_id ON public.gitlab_subscription_histories USING btree (gitlab_subscription_id); -- table gitlab_subscription_histories  
CREATE INDEX CONCURRENTLY index_grafana_integrations_on_enabled ON public.grafana_integrations USING btree (enabled) WHERE (enabled IS TRUE); -- table grafana_integrations  
CREATE INDEX CONCURRENTLY index_import_failures_on_correlation_id_value ON public.import_failures USING btree (correlation_id_value); -- table import_failures  
CREATE INDEX CONCURRENTLY index_import_failures_on_project_id_not_null ON public.import_failures USING btree (project_id) WHERE (project_id IS NOT NULL); -- table import_failures  
CREATE INDEX CONCURRENTLY index_issues_on_state ON public.issues USING btree (state); -- table issues  
CREATE INDEX CONCURRENTLY issue_id_issues_self_managed_rometheus_alert_events_index ON public.issues_self_managed_prometheus_alert_events USING btree (self_managed_prometheus_alert_event_id); -- table issues_self_managed_prometheus_alert_events  
CREATE INDEX CONCURRENTLY idx_jira_connect_subscriptions_on_installation_id ON public.jira_connect_subscriptions USING btree (jira_connect_installation_id); -- table jira_connect_subscriptions  
CREATE INDEX CONCURRENTLY index_keys_on_last_used_at ON public.keys USING btree (last_used_at DESC NULLS LAST); -- table keys  
CREATE INDEX CONCURRENTLY index_label_priorities_on_priority ON public.label_priorities USING btree (priority); -- table label_priorities  
CREATE INDEX CONCURRENTLY index_labels_on_group_id_and_title ON public.labels USING btree (group_id, title) WHERE (project_id = NULL::integer); -- table labels  
CREATE INDEX CONCURRENTLY index_labels_on_project_id_and_title ON public.labels USING btree (project_id, title) WHERE (group_id = NULL::integer); -- table labels  
CREATE INDEX CONCURRENTLY index_members_on_access_level ON public.members USING btree (access_level); -- table members  
CREATE INDEX CONCURRENTLY index_merge_request_diffs_on_merge_request_id_and_id_partial ON public.merge_request_diffs USING btree (merge_request_id, id) WHERE ((NOT stored_externally) OR (stored_externally IS NULL)); -- table merge_request_diffs  
CREATE INDEX CONCURRENTLY index_merge_request_metrics_on_latest_closed_at ON public.merge_request_metrics USING btree (latest_closed_at) WHERE (latest_closed_at IS NOT NULL); -- table merge_request_metrics  
CREATE INDEX CONCURRENTLY idx_merge_requests_on_state_id_and_merge_status ON public.merge_requests USING btree (state_id, merge_status) WHERE ((state_id = 1) AND ((merge_status)::text = 'can_be_merged'::text)); -- table merge_requests  
CREATE INDEX CONCURRENTLY index_merge_requests_on_id_and_merge_jid ON public.merge_requests USING btree (id, merge_jid) WHERE ((merge_jid IS NOT NULL) AND ((state)::text = 'locked'::text)); -- table merge_requests  
CREATE INDEX CONCURRENTLY index_merge_requests_on_source_project_and_branch_state_opened ON public.merge_requests USING btree (source_project_id, source_branch) WHERE ((state)::text = 'opened'::text); -- table merge_requests  
CREATE INDEX CONCURRENTLY index_merge_requests_on_state_and_merge_status ON public.merge_requests USING btree (state, merge_status) WHERE (((state)::text = 'opened'::text) AND ((merge_status)::text = 'can_be_merged'::text)); -- table merge_requests  
CREATE INDEX CONCURRENTLY index_merge_requests_on_target_project_id_and_iid_opened ON public.merge_requests USING btree (target_project_id, iid) WHERE ((state)::text = 'opened'::text); -- table merge_requests  
CREATE INDEX CONCURRENTLY index_namespaces_on_created_at ON public.namespaces USING btree (created_at); -- table namespaces  
CREATE INDEX CONCURRENTLY index_namespaces_on_ldap_sync_last_successful_update_at ON public.namespaces USING btree (ldap_sync_last_successful_update_at); -- table namespaces  
CREATE INDEX CONCURRENTLY index_namespaces_on_ldap_sync_last_update_at ON public.namespaces USING btree (ldap_sync_last_update_at); -- table namespaces  
CREATE INDEX CONCURRENTLY index_namespaces_on_plan_id ON public.namespaces USING btree (plan_id); -- table namespaces  
CREATE INDEX CONCURRENTLY index_namespaces_on_require_two_factor_authentication ON public.namespaces USING btree (require_two_factor_authentication); -- table namespaces  
CREATE INDEX CONCURRENTLY index_packages_dependency_links_on_dependency_id ON public.packages_dependency_links USING btree (dependency_id); -- table packages_dependency_links  
CREATE INDEX CONCURRENTLY index_pages_domains_need_auto_ssl_renewal ON public.pages_domains USING btree (certificate_source, certificate_valid_not_after) WHERE (auto_ssl_enabled = true); -- table pages_domains  
CREATE INDEX CONCURRENTLY index_pages_domains_on_verified_at_and_enabled_until ON public.pages_domains USING btree (verified_at, enabled_until); -- table pages_domains  
CREATE INDEX CONCURRENTLY index_project_custom_attributes_on_key_and_value ON public.project_custom_attributes USING btree (key, value); -- table project_custom_attributes  
CREATE INDEX CONCURRENTLY index_project_mirror_data_on_last_successful_update_at ON public.project_mirror_data USING btree (last_successful_update_at); -- table project_mirror_data  
CREATE INDEX CONCURRENTLY index_project_repositories_on_shard_id ON public.project_repositories USING btree (shard_id); -- table project_repositories  
CREATE INDEX CONCURRENTLY idx_repository_states_on_last_repository_verification_ran_at ON public.project_repository_states USING btree (project_id, last_repository_verification_ran_at) WHERE ((repository_verification_checksum IS NOT NULL) AND (last_repository_verification_failure IS NULL)); -- table project_repository_states  
CREATE INDEX CONCURRENTLY idx_repository_states_on_last_wiki_verification_ran_at ON public.project_repository_states USING btree (project_id, last_wiki_verification_ran_at) WHERE ((wiki_verification_checksum IS NOT NULL) AND (last_wiki_verification_failure IS NULL)); -- table project_repository_states  
CREATE INDEX CONCURRENTLY idx_repository_states_on_repository_failure_partial ON public.project_repository_states USING btree (last_repository_verification_failure) WHERE (last_repository_verification_failure IS NOT NULL); -- table project_repository_states  
CREATE INDEX CONCURRENTLY idx_repository_states_on_wiki_failure_partial ON public.project_repository_states USING btree (last_wiki_verification_failure) WHERE (last_wiki_verification_failure IS NOT NULL); -- table project_repository_states  
CREATE INDEX CONCURRENTLY idx_repository_states_outdated_checksums ON public.project_repository_states USING btree (project_id) WHERE (((repository_verification_checksum IS NULL) AND (last_repository_verification_failure IS NULL)) OR ((wiki_verification_checksum IS NULL) AND (last_wiki_verification_failure IS NULL))); -- table project_repository_states  
CREATE INDEX CONCURRENTLY idx_project_repository_check_partial ON public.projects USING btree (repository_storage, created_at) WHERE (last_repository_check_at IS NULL); -- table projects  
CREATE INDEX CONCURRENTLY index_on_projects_lower_path ON public.projects USING btree (lower((path)::text)); -- table projects  
CREATE INDEX CONCURRENTLY index_projects_api_vis20_name ON public.projects USING btree (name, id) WHERE (visibility_level = 20); -- table projects  
CREATE INDEX CONCURRENTLY index_projects_api_vis20_path ON public.projects USING btree (path, id) WHERE (visibility_level = 20); -- table projects  
CREATE INDEX CONCURRENTLY index_projects_api_vis20_updated_at ON public.projects USING btree (updated_at, id) WHERE (visibility_level = 20); -- table projects  
CREATE INDEX CONCURRENTLY index_projects_on_last_repository_check_at ON public.projects USING btree (last_repository_check_at) WHERE (last_repository_check_at IS NOT NULL); -- table projects  
CREATE INDEX CONCURRENTLY index_projects_on_last_repository_check_failed ON public.projects USING btree (last_repository_check_failed); -- table projects  
CREATE INDEX CONCURRENTLY index_projects_on_mirror_and_mirror_trigger_builds_both_true ON public.projects USING btree (id) WHERE ((mirror IS TRUE) AND (mirror_trigger_builds IS TRUE)); -- table projects  
CREATE INDEX CONCURRENTLY index_projects_on_runners_token ON public.projects USING btree (runners_token); -- table projects  
CREATE INDEX CONCURRENTLY index_prometheus_metrics_on_group ON public.prometheus_metrics USING btree ("group"); -- table prometheus_metrics  
CREATE INDEX CONCURRENTLY index_remote_mirrors_on_last_successful_update_at ON public.remote_mirrors USING btree (last_successful_update_at); -- table remote_mirrors  
CREATE INDEX CONCURRENTLY idx_security_scans_on_scan_type ON public.security_scans USING btree (scan_type); -- table security_scans  
CREATE INDEX CONCURRENTLY index_term_agreements_on_term_id ON public.term_agreements USING btree (term_id); -- table term_agreements  
CREATE INDEX CONCURRENTLY index_timelogs_on_user_id ON public.timelogs USING btree (user_id); -- table timelogs  
CREATE INDEX CONCURRENTLY index_user_custom_attributes_on_key_and_value ON public.user_custom_attributes USING btree (key, value); -- table user_custom_attributes  
CREATE INDEX CONCURRENTLY index_users_on_accepted_term_id ON public.users USING btree (accepted_term_id); -- table users  
CREATE INDEX CONCURRENTLY index_x509_certificates_on_x509_issuer_id ON public.x509_certificates USING btree (x509_issuer_id); -- table x509_certificates  
CREATE INDEX CONCURRENTLY index_x509_commit_signatures_on_x509_certificate_id ON public.x509_commit_signatures USING btree (x509_certificate_id); -- table x509_commit_signatures  
CREATE INDEX CONCURRENTLY index_zoom_meetings_on_issue_status ON public.zoom_meetings USING btree (issue_status); -- table zoom_meetings

  Table of contents

H003 Non-indexed Foreign Keys

Observations

Data collected: 2020-02-18 02:27:59 +0000 UTC
Current database: gitlabhq_production

Master (10.220.16.106)

Num Schema name Table name FK name Issue Table mb writes Table scans Parent name Parent mb Parent writes Cols list Indexdef
1 public design_management_versions fk_c1440b4896 no index 0 5860 21224 users 2460 100950451 [author_id]
2 public ci_builds fk_6661f4f0e8 questionable index 431494 409226041 48 ci_resource_groups 1 7012 [resource_group_id] CREATE INDEX index_for_resource_group ON public.ci_builds USING btree (resource_group_id, id) WHERE (resource_group_id IS NOT NULL)
3 public ci_builds fk_87f4cefcda questionable index 431494 409226041 48 ci_pipelines 23507 108822875 [upstream_pipeline_id] CREATE INDEX index_ci_builds_on_upstream_pipeline_id ON public.ci_builds USING btree (upstream_pipeline_id) WHERE (upstream_pipeline_id IS NOT NULL)
4 public ci_builds fk_d3130c9a7f questionable index 431494 409226041 48 ci_pipelines 23507 108822875 [commit_id] CREATE INDEX index_ci_builds_on_commit_id_and_artifacts_expireatandidpartial ON public.ci_builds USING btree (commit_id, artifacts_expire_at, id) WHERE (((type)::text = 'Ci::Build'::text) AND ((retried = false) OR (retried IS NULL)) AND ((name)::text = ANY ((ARRAY['sast'::character varying, 'dependency_scanning'::character varying, 'sast:container'::character varying, 'container_scanning'::character varying, 'dast'::character varying])::text[])))
5 public ci_builds fk_d3130c9a7f questionable index 431494 409226041 48 ci_pipelines 23507 108822875 [commit_id] CREATE INDEX index_ci_builds_on_commit_id_and_type_and_ref ON public.ci_builds USING btree (commit_id, type, ref)
6 public ci_builds fk_d3130c9a7f questionable index 431494 409226041 48 ci_pipelines 23507 108822875 [commit_id] CREATE INDEX index_ci_builds_on_commit_id_and_type_and_name_and_ref ON public.ci_builds USING btree (commit_id, type, name, ref)
7 public ci_builds fk_d3130c9a7f questionable index 431494 409226041 48 ci_pipelines 23507 108822875 [commit_id] CREATE INDEX index_ci_builds_on_commit_id_and_status_and_type ON public.ci_builds USING btree (commit_id, status, type)
8 public ci_builds fk_d3130c9a7f questionable index 431494 409226041 48 ci_pipelines 23507 108822875 [commit_id] CREATE INDEX index_ci_builds_on_commit_id_and_stage_idx_and_created_at ON public.ci_builds USING btree (commit_id, stage_idx, created_at)
9 public events fk_61fbf6ca48 questionable index 38283 123599448 0 namespaces 832 1528440 [group_id] CREATE INDEX index_events_on_group_id_partial ON public.events USING btree (group_id) WHERE (group_id IS NOT NULL)
10 public ci_pipelines fk_190998ef09 questionable index 23507 108822875 14 external_pull_requests 9 294991 [external_pull_request_id] CREATE INDEX index_ci_pipelines_on_external_pull_request_id ON public.ci_pipelines USING btree (external_pull_request_id) WHERE (external_pull_request_id IS NOT NULL)
11 public ci_pipelines fk_a23be95014 questionable index 23507 108822875 14 merge_requests 18709 167218128 [merge_request_id] CREATE INDEX index_ci_pipelines_on_merge_request_id ON public.ci_pipelines USING btree (merge_request_id) WHERE (merge_request_id IS NOT NULL)
12 public merge_requests fk_641731faff questionable index 18709 167218128 62 users 2460 100950451 [updated_by_id] CREATE INDEX index_merge_requests_on_updated_by_id ON public.merge_requests USING btree (updated_by_id) WHERE (updated_by_id IS NOT NULL)
13 public merge_requests fk_ad525e1f87 questionable index 18709 167218128 62 users 2460 100950451 [merge_user_id] CREATE INDEX index_merge_requests_on_merge_user_id ON public.merge_requests USING btree (merge_user_id) WHERE (merge_user_id IS NOT NULL)
14 public issues fk_9c4516d665 questionable index 15893 32764254 15659 issues 15893 32764254 [duplicated_to_id] CREATE INDEX index_issues_on_duplicated_to_id ON public.issues USING btree (duplicated_to_id) WHERE (duplicated_to_id IS NOT NULL)
15 public issues fk_a194299be1 questionable index 15893 32764254 15659 issues 15893 32764254 [moved_to_id] CREATE INDEX index_issues_on_moved_to_id ON public.issues USING btree (moved_to_id) WHERE (moved_to_id IS NOT NULL)
16 public issues fk_df75a7c8b8 questionable index 15893 32764254 15659 epics 11 313425 [promoted_to_epic_id] CREATE INDEX index_issues_on_promoted_to_epic_id ON public.issues USING btree (promoted_to_epic_id) WHERE (promoted_to_epic_id IS NOT NULL)
17 public issues fk_ffed080f01 questionable index 15893 32764254 15659 users 2460 100950451 [updated_by_id] CREATE INDEX index_issues_on_updated_by_id ON public.issues USING btree (updated_by_id) WHERE (updated_by_id IS NOT NULL)
18 public system_note_metadata fk_fbd87415c9 questionable index 10268 36906631 0 description_versions 38 50519 [description_version_id] CREATE UNIQUE INDEX index_system_note_metadata_on_description_version_id ON public.system_note_metadata USING btree (description_version_id) WHERE (description_version_id IS NOT NULL)
19 public projects fk_0a31cca0b8 questionable index 3417 119757204 91816 users 2460 100950451 [marked_for_deletion_by_user_id] CREATE INDEX index_projects_on_marked_for_deletion_by_user_id ON public.projects USING btree (marked_for_deletion_by_user_id) WHERE (marked_for_deletion_by_user_id IS NOT NULL)
20 public projects fk_6e5c14658a questionable index 3417 119757204 91816 pool_repositories 3 50519 [pool_repository_id] CREATE INDEX index_projects_on_pool_repository_id ON public.projects USING btree (pool_repository_id) WHERE (pool_repository_id IS NOT NULL)

Conclusions

Recommendations

  Table of contents

H004 Redundant Indexes

Observations

Data collected: 2020-02-18 02:29:34 +0000 UTC
Current database: gitlabhq_production

Stats reset: 3 mons 20 days 10:21:00 ago (2019-10-28 16:07:35 +0000 UTC)

The list is limited to 20 items. Total: 46.

# Table Index Redundant to 10.220.16.106 usage 10.220.16.101 usage 10.220.16.102 usage 10.220.16.103 usage 10.220.16.104 usage 10.220.16.105 usage 10.220.16.107 usage 10.220.16.108 usage 10.220.16.109 usage ▼ Index size Table size Supports FK
  =====TOTAL===== 25.10 GiB 76.27 GiB
1 taggings index_taggings_on_taggable_id_and_taggable_type index_taggings_on_taggable_id_and_taggable_type_and_context
 0 6.74 GiB 11.14 GiB
2 ci_stages index_ci_stages_on_pipeline_id index_ci_stages_on_pipeline_id_and_name
index_ci_stages_on_pipeline_id_and_position
 0 5.29 GiB 16.77 GiB Yes
3 taggings index_taggings_on_tag_id taggings_idx
 0 4.35 GiB 11.14 GiB
4 projects index_projects_api_last_activity_at_id_desc index_projects_on_last_activity_at_and_id
 0 1.56 GiB 3.34 GiB
5 deployments index_deployments_on_project_id_and_status index_deployments_on_project_id_and_status_and_created_at
 0 1.43 GiB 7.94 GiB
6 projects index_on_projects_path index_projects_api_path_id_desc
index_projects_on_path_and_id
index_projects_on_runners_token
 0 580.86 MiB 3.34 GiB Yes
7 projects index_projects_api_path_id_desc index_projects_on_path_and_id
 0 551.93 MiB 3.34 GiB
8 projects index_projects_api_name_id_desc index_projects_on_name_and_id
 0 551.09 MiB 3.34 GiB
9 projects index_projects_api_updated_at_id_desc index_projects_on_updated_at_and_id
 0 532.65 MiB 3.34 GiB
10 notification_settings index_notification_settings_on_user_id index_notifications_on_user_id_and_source_id_and_source_type
 0 530.59 MiB 1.27 GiB
11 issue_metrics index_issue_metrics index_issue_metrics_on_issue_id_and_timestamps
 0 518.19 MiB 1.16 GiB
12 projects index_projects_api_created_at_id_desc index_projects_on_created_at_and_id
 0 498.20 MiB 3.34 GiB
13 users index_users_on_email_trigram index_users_on_username_trigram
 0 442.73 MiB 2.41 GiB
14 merge_request_assignees index_merge_request_assignees_on_merge_request_id index_merge_request_assignees_on_merge_request_id_and_user_id
 0 391.51 MiB 540.08 MiB
15 ci_runners index_ci_runners_on_token index_ci_runners_on_token_encrypted
 0 364.04 MiB 371.92 MiB
16 namespaces index_namespaces_on_path index_namespaces_on_runners_token
index_namespaces_on_runners_token_encrypted
 0 259.62 MiB 832.44 MiB Yes
17 ci_pipelines_config index_ci_pipelines_config_on_pipeline_id ci_pipelines_config_pkey
 0 244.58 MiB 822.21 MiB
18 personal_access_tokens index_personal_access_tokens_on_user_id index_pat_on_user_id_and_expires_at
 0 125.18 MiB 623.96 MiB
19 term_agreements index_term_agreements_on_user_id term_agreements_unique_index
 0 92.25 MiB 232.99 MiB
20 namespace_root_storage_statistics index_namespace_root_storage_statistics_on_namespace_id namespace_root_storage_statistics_pkey
 0 32.34 MiB 99.11 MiB

Conclusions

  • [P3] 46 redundant index(es) have been found.

Recommendations

  • [P3] Use the database migration provided below to drop the redundant indexes. Keep in mind, that under load, it is recommended to use DROP INDEX CONCURRENTLY (and CREATE INDEX CONCURRENTLY if reverting is needed) to avoid blocking issues.
  • Be careful dropping the indexes. If you have multiple setups of your software, the analysis of just a single setup might be not enough. Some indexes might be used (and therefore, needed) only on a limited number of setups. Also, in some cases, developers prepare indexes for new features in advance – in such cases, dropping those indexes is not a good idea.
  • If there are some doubts, consider a more careful approach. Before actualdropping, indexes disable listed in this report. For this, use queries like `UPDATE pg_index SET indisvalid = false WHERE indexrelid::regclass = (select oid from pg_class where relname = 'u_users_email');. Indexes will continue to get updates. In case of some performance degradations, re-enable the corresponding indexes, setting indisvalid to true. If everything looks fine, after a significant period of observations, proceed with DROP INDEX CONCURRENTLY.
  • "DO" database migrations
DROP INDEX CONCURRENTLY index_analytics_ca_group_stages_on_group_id; -- 8192 bytes, index_analytics_ca_group_stages_on_group_id_and_name, table analytics_cycle_analytics_group_stages  
DROP INDEX CONCURRENTLY index_analytics_ca_project_stages_on_project_id; -- 8192 bytes, index_analytics_ca_project_stages_on_project_id_and_name, table analytics_cycle_analytics_project_stages  
DROP INDEX CONCURRENTLY index_approval_rules_code_owners_rule_type; -- 5720 kB, index_approval_rule_name_for_code_owners_rule_type, table approval_merge_request_rules  
DROP INDEX CONCURRENTLY index_aws_roles_on_user_id; -- 32 kB, aws_roles_pkey, table aws_roles  
DROP INDEX CONCURRENTLY index_board_group_recent_visits_on_user_id; -- 1008 kB, index_board_group_recent_visits_on_user_group_and_board, table board_group_recent_visits  
DROP INDEX CONCURRENTLY index_board_project_recent_visits_on_user_id; -- 3560 kB, index_board_project_recent_visits_on_user_project_and_board, table board_project_recent_visits  
DROP INDEX CONCURRENTLY index_ci_pipelines_config_on_pipeline_id; -- 245 MB, ci_pipelines_config_pkey, table ci_pipelines_config  
DROP INDEX CONCURRENTLY index_ci_runners_on_token; -- 364 MB, index_ci_runners_on_token_encrypted, table ci_runners  
DROP INDEX CONCURRENTLY index_ci_stages_on_pipeline_id; -- 5412 MB, index_ci_stages_on_pipeline_id_and_name, index_ci_stages_on_pipeline_id_and_position, table ci_stages  
DROP INDEX CONCURRENTLY index_clusters_kubernetes_namespaces_on_cluster_id; -- 1680 kB, index_kubernetes_namespaces_on_cluster_project_environment_id, kubernetes_namespaces_cluster_and_namespace, table clusters_kubernetes_namespaces  
DROP INDEX CONCURRENTLY index_container_repositories_on_project_id; -- 20 MB, index_container_repositories_on_project_id_and_name, table container_repositories  
DROP INDEX CONCURRENTLY index_deployments_on_project_id_and_status; -- 1461 MB, index_deployments_on_project_id_and_status_and_created_at, table deployments  
DROP INDEX CONCURRENTLY index_design_management_designs_versions_on_design_id; -- 128 kB, design_management_designs_versions_uniqueness, table design_management_designs_versions  
DROP INDEX CONCURRENTLY index_geo_node_namespace_links_on_geo_node_id; -- 8192 bytes, index_geo_node_namespace_links_on_geo_node_id_and_namespace_id, table geo_node_namespace_links  
DROP INDEX CONCURRENTLY index_issue_links_on_source_id; -- 23 MB, index_issue_links_on_source_id_and_target_id, table issue_links  
DROP INDEX CONCURRENTLY index_issue_metrics; -- 518 MB, index_issue_metrics_on_issue_id_and_timestamps, table issue_metrics  
DROP INDEX CONCURRENTLY idx_jira_connect_subscriptions_on_installation_id; -- 16 kB, idx_jira_connect_subscriptions_on_installation_id_namespace_id, table jira_connect_subscriptions  
DROP INDEX CONCURRENTLY index_list_user_preferences_on_user_id; -- 6200 kB, index_list_user_preferences_on_user_id_and_list_id, table list_user_preferences  
DROP INDEX CONCURRENTLY index_merge_request_assignees_on_merge_request_id; -- 392 MB, index_merge_request_assignees_on_merge_request_id_and_user_id, table merge_request_assignees  
DROP INDEX CONCURRENTLY idx_mr_cc_diff_files_on_mr_cc_id; -- 8192 bytes, idx_mr_cc_diff_files_on_mr_cc_id_and_sha, table merge_request_context_commit_diff_files  
DROP INDEX CONCURRENTLY index_merge_request_context_commits_on_merge_request_id; -- 8192 bytes, index_mr_context_commits_on_merge_request_id_and_sha, table merge_request_context_commits  
DROP INDEX CONCURRENTLY index_namespace_aggregation_schedules_on_namespace_id; -- 15 MB, namespace_aggregation_schedules_pkey, table namespace_aggregation_schedules  
DROP INDEX CONCURRENTLY index_namespace_root_storage_statistics_on_namespace_id; -- 32 MB, namespace_root_storage_statistics_pkey, table namespace_root_storage_statistics  
DROP INDEX CONCURRENTLY index_namespaces_on_path; -- 260 MB, index_namespaces_on_runners_token, index_namespaces_on_runners_token_encrypted, table namespaces  
DROP INDEX CONCURRENTLY index_notification_settings_on_user_id; -- 531 MB, index_notifications_on_user_id_and_source_id_and_source_type, table notification_settings  
DROP INDEX CONCURRENTLY index_packages_tags_on_package_id; -- 40 kB, index_packages_tags_on_package_id_and_updated_at, table packages_tags  
DROP INDEX CONCURRENTLY index_pages_domains_on_project_id; -- 3712 kB, index_pages_domains_on_project_id_and_enabled_until, table pages_domains  
DROP INDEX CONCURRENTLY index_pages_domains_on_verified_at; -- 4696 kB, index_pages_domains_on_verified_at_and_enabled_until, table pages_domains  
DROP INDEX CONCURRENTLY index_personal_access_tokens_on_user_id; -- 125 MB, index_pat_on_user_id_and_expires_at, table personal_access_tokens  
DROP INDEX CONCURRENTLY index_project_feature_usages_on_project_id; -- 11 MB, project_feature_usages_pkey, table project_feature_usages  
DROP INDEX CONCURRENTLY index_on_projects_path; -- 581 MB, index_projects_api_path_id_desc, index_projects_on_path_and_id, index_projects_on_runners_token, table projects  
DROP INDEX CONCURRENTLY index_projects_api_created_at_id_desc; -- 498 MB, index_projects_on_created_at_and_id, table projects  
DROP INDEX CONCURRENTLY index_projects_api_last_activity_at_id_desc; -- 1588 MB, index_projects_on_last_activity_at_and_id, table projects  
DROP INDEX CONCURRENTLY index_projects_api_name_id_desc; -- 551 MB, index_projects_on_name_and_id, table projects  
DROP INDEX CONCURRENTLY index_projects_api_path_id_desc; -- 552 MB, index_projects_on_path_and_id, table projects  
DROP INDEX CONCURRENTLY index_projects_api_updated_at_id_desc; -- 533 MB, index_projects_on_updated_at_and_id, table projects  
DROP INDEX CONCURRENTLY index_protected_environments_on_project_id; -- 168 kB, index_protected_environments_on_project_id_and_name, table protected_environments  
DROP INDEX CONCURRENTLY index_protected_tags_on_project_id; -- 688 kB, index_protected_tags_on_project_id_and_name, table protected_tags  
DROP INDEX CONCURRENTLY index_taggings_on_tag_id; -- 4449 MB, taggings_idx, table taggings  
DROP INDEX CONCURRENTLY index_taggings_on_taggable_id_and_taggable_type; -- 6901 MB, index_taggings_on_taggable_id_and_taggable_type_and_context, table taggings  
DROP INDEX CONCURRENTLY index_term_agreements_on_user_id; -- 92 MB, term_agreements_unique_index, table term_agreements  
DROP INDEX CONCURRENTLY index_user_callouts_on_user_id; -- 29 MB, index_user_callouts_on_user_id_and_feature_name, table user_callouts  
DROP INDEX CONCURRENTLY index_user_statuses_on_user_id; -- 2832 kB, user_statuses_pkey, table user_statuses  
DROP INDEX CONCURRENTLY index_users_on_email_trigram; -- 443 MB, index_users_on_username_trigram, table users  
DROP INDEX CONCURRENTLY index_vulnerabilities_on_epic_id; -- 20 MB, index_vulnerabilities_on_confirmed_by_id, table vulnerabilities  
DROP INDEX CONCURRENTLY index_vulnerabilities_on_milestone_id; -- 20 MB, index_vulnerabilities_on_resolved_by_id, table vulnerabilities
  • "UNDO" database migrations
CREATE INDEX CONCURRENTLY index_analytics_ca_group_stages_on_group_id ON public.analytics_cycle_analytics_group_stages USING btree (group_id); -- table analytics_cycle_analytics_group_stages  
CREATE INDEX CONCURRENTLY index_analytics_ca_project_stages_on_project_id ON public.analytics_cycle_analytics_project_stages USING btree (project_id); -- table analytics_cycle_analytics_project_stages  
CREATE INDEX CONCURRENTLY index_approval_rules_code_owners_rule_type ON public.approval_merge_request_rules USING btree (merge_request_id, rule_type) WHERE (rule_type = 2); -- table approval_merge_request_rules  
CREATE UNIQUE INDEX index_aws_roles_on_user_id ON public.aws_roles USING btree (user_id); -- table aws_roles  
CREATE INDEX CONCURRENTLY index_board_group_recent_visits_on_user_id ON public.board_group_recent_visits USING btree (user_id); -- table board_group_recent_visits  
CREATE INDEX CONCURRENTLY index_board_project_recent_visits_on_user_id ON public.board_project_recent_visits USING btree (user_id); -- table board_project_recent_visits  
CREATE INDEX CONCURRENTLY index_ci_pipelines_config_on_pipeline_id ON public.ci_pipelines_config USING btree (pipeline_id); -- table ci_pipelines_config  
CREATE INDEX CONCURRENTLY index_ci_runners_on_token ON public.ci_runners USING btree (token); -- table ci_runners  
CREATE INDEX CONCURRENTLY index_ci_stages_on_pipeline_id ON public.ci_stages USING btree (pipeline_id); -- table ci_stages  
CREATE INDEX CONCURRENTLY index_clusters_kubernetes_namespaces_on_cluster_id ON public.clusters_kubernetes_namespaces USING btree (cluster_id); -- table clusters_kubernetes_namespaces  
CREATE INDEX CONCURRENTLY index_container_repositories_on_project_id ON public.container_repositories USING btree (project_id); -- table container_repositories  
CREATE INDEX CONCURRENTLY index_deployments_on_project_id_and_status ON public.deployments USING btree (project_id, status); -- table deployments  
CREATE INDEX CONCURRENTLY index_design_management_designs_versions_on_design_id ON public.design_management_designs_versions USING btree (design_id); -- table design_management_designs_versions  
CREATE INDEX CONCURRENTLY index_geo_node_namespace_links_on_geo_node_id ON public.geo_node_namespace_links USING btree (geo_node_id); -- table geo_node_namespace_links  
CREATE INDEX CONCURRENTLY index_issue_links_on_source_id ON public.issue_links USING btree (source_id); -- table issue_links  
CREATE INDEX CONCURRENTLY index_issue_metrics ON public.issue_metrics USING btree (issue_id); -- table issue_metrics  
CREATE INDEX CONCURRENTLY idx_jira_connect_subscriptions_on_installation_id ON public.jira_connect_subscriptions USING btree (jira_connect_installation_id); -- table jira_connect_subscriptions  
CREATE INDEX CONCURRENTLY index_list_user_preferences_on_user_id ON public.list_user_preferences USING btree (user_id); -- table list_user_preferences  
CREATE INDEX CONCURRENTLY index_merge_request_assignees_on_merge_request_id ON public.merge_request_assignees USING btree (merge_request_id); -- table merge_request_assignees  
CREATE INDEX CONCURRENTLY idx_mr_cc_diff_files_on_mr_cc_id ON public.merge_request_context_commit_diff_files USING btree (merge_request_context_commit_id); -- table merge_request_context_commit_diff_files  
CREATE INDEX CONCURRENTLY index_merge_request_context_commits_on_merge_request_id ON public.merge_request_context_commits USING btree (merge_request_id); -- table merge_request_context_commits  
CREATE UNIQUE INDEX index_namespace_aggregation_schedules_on_namespace_id ON public.namespace_aggregation_schedules USING btree (namespace_id); -- table namespace_aggregation_schedules  
CREATE UNIQUE INDEX index_namespace_root_storage_statistics_on_namespace_id ON public.namespace_root_storage_statistics USING btree (namespace_id); -- table namespace_root_storage_statistics  
CREATE INDEX CONCURRENTLY index_namespaces_on_path ON public.namespaces USING btree (path); -- table namespaces  
CREATE INDEX CONCURRENTLY index_notification_settings_on_user_id ON public.notification_settings USING btree (user_id); -- table notification_settings  
CREATE INDEX CONCURRENTLY index_packages_tags_on_package_id ON public.packages_tags USING btree (package_id); -- table packages_tags  
CREATE INDEX CONCURRENTLY index_pages_domains_on_project_id ON public.pages_domains USING btree (project_id); -- table pages_domains  
CREATE INDEX CONCURRENTLY index_pages_domains_on_verified_at ON public.pages_domains USING btree (verified_at); -- table pages_domains  
CREATE INDEX CONCURRENTLY index_personal_access_tokens_on_user_id ON public.personal_access_tokens USING btree (user_id); -- table personal_access_tokens  
CREATE INDEX CONCURRENTLY index_project_feature_usages_on_project_id ON public.project_feature_usages USING btree (project_id); -- table project_feature_usages  
CREATE INDEX CONCURRENTLY index_on_projects_path ON public.projects USING btree (path); -- table projects  
CREATE INDEX CONCURRENTLY index_projects_api_created_at_id_desc ON public.projects USING btree (created_at, id DESC); -- table projects  
CREATE INDEX CONCURRENTLY index_projects_api_last_activity_at_id_desc ON public.projects USING btree (last_activity_at, id DESC); -- table projects  
CREATE INDEX CONCURRENTLY index_projects_api_name_id_desc ON public.projects USING btree (name, id DESC); -- table projects  
CREATE INDEX CONCURRENTLY index_projects_api_path_id_desc ON public.projects USING btree (path, id DESC); -- table projects  
CREATE INDEX CONCURRENTLY index_projects_api_updated_at_id_desc ON public.projects USING btree (updated_at, id DESC); -- table projects  
CREATE INDEX CONCURRENTLY index_protected_environments_on_project_id ON public.protected_environments USING btree (project_id); -- table protected_environments  
CREATE INDEX CONCURRENTLY index_protected_tags_on_project_id ON public.protected_tags USING btree (project_id); -- table protected_tags  
CREATE INDEX CONCURRENTLY index_taggings_on_tag_id ON public.taggings USING btree (tag_id); -- table taggings  
CREATE INDEX CONCURRENTLY index_taggings_on_taggable_id_and_taggable_type ON public.taggings USING btree (taggable_id, taggable_type); -- table taggings  
CREATE INDEX CONCURRENTLY index_term_agreements_on_user_id ON public.term_agreements USING btree (user_id); -- table term_agreements  
CREATE INDEX CONCURRENTLY index_user_callouts_on_user_id ON public.user_callouts USING btree (user_id); -- table user_callouts  
CREATE INDEX CONCURRENTLY index_user_statuses_on_user_id ON public.user_statuses USING btree (user_id); -- table user_statuses  
CREATE INDEX CONCURRENTLY index_users_on_email_trigram ON public.users USING gin (email gin_trgm_ops); -- table users  
CREATE INDEX CONCURRENTLY index_vulnerabilities_on_epic_id ON public.vulnerabilities USING btree (epic_id); -- table vulnerabilities  
CREATE INDEX CONCURRENTLY index_vulnerabilities_on_milestone_id ON public.vulnerabilities USING btree (milestone_id); -- table vulnerabilities

  Table of contents

K001 Globally Aggregated Query Metrics

Observations

Data collected: 2020-02-18 02:29:35 +0000 UTC
Current database: gitlabhq_production

Master (10.220.16.106)

Start: 2020-02-18T01:55:06.322528+00:00
End: 2020-02-18T02:28:01.581982+00:00
Period seconds: 1975.25945
Period age: 00:32:55.259454

Error (calls): 0.00 (0.00%)
Error (total time): 0.00 (0.00%)

Calls Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
20,180,530
10.22K/sec
1.00/call
100.00%		 3,897,948.09 ms
1973.385 ms/sec
0.193 ms/call
100.00%		 172,320,532
87.24K/sec
8.54/call
100.00%		 1,242,347,790 blks
628.96K blks/sec
61.56 blks/call
100.00%		 547,326 blks
277.09 blks/sec
0.03 blks/call
100.00%		 832,887 blks
421.66 blks/sec
0.04 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 402,312.18 ms
203.676 ms/sec
0.020 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica servers:

Replica (10.220.16.101)

Start: 2020-02-18T01:54:59.494149+00:00
End: 2020-02-18T02:25:19.993584+00:00
Period seconds: 1820.49943
Period age: 00:30:20.499435

Calls Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
6,547,944
3.60K/sec
1.00/call
100.00%		 871,987.57 ms
478.983 ms/sec
0.133 ms/call
100.00%		 30,633,098
16.83K/sec
4.68/call
100.00%		 331,117,013 blks
181.89K blks/sec
50.57 blks/call
100.00%		 699,907 blks
384.46 blks/sec
0.11 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 63,982.14 ms
35.145 ms/sec
0.010 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.102)

Start: 2020-02-18T01:55:01.617415+00:00
End: 2020-02-18T02:25:48.233784+00:00
Period seconds: 1846.61637
Period age: 00:30:46.616369

Calls Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
6,461,701
3.50K/sec
1.00/call
100.00%		 901,535.82 ms
488.210 ms/sec
0.140 ms/call
100.00%		 30,896,699
16.74K/sec
4.78/call
100.00%		 311,620,684 blks
168.76K blks/sec
48.23 blks/call
100.00%		 705,000 blks
381.78 blks/sec
0.11 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 75,678.28 ms
40.982 ms/sec
0.012 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.103)

Start: 2020-02-18T01:55:02.7466+00:00
End: 2020-02-18T02:26:17.588+00:00
Period seconds: 1874.8414
Period age: 00:31:14.8414

Calls Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
9,501,675
5.07K/sec
1.00/call
100.00%		 781,029.91 ms
416.585 ms/sec
0.082 ms/call
100.00%		 29,699,101
15.85K/sec
3.13/call
100.00%		 296,808,481 blks
158.32K blks/sec
31.24 blks/call
100.00%		 660,165 blks
352.12 blks/sec
0.07 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 72,718.46 ms
38.786 ms/sec
0.008 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.104)

Start: 2020-02-18T01:55:03.870674+00:00
End: 2020-02-18T02:26:46.339032+00:00
Period seconds: 1902.46836
Period age: 00:31:42.468358

Calls Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
8,302,352
4.37K/sec
1.00/call
100.00%		 825,067.85 ms
433.683 ms/sec
0.099 ms/call
100.00%		 30,933,784
16.26K/sec
3.73/call
100.00%		 306,805,149 blks
161.27K blks/sec
36.95 blks/call
100.00%		 823,109 blks
432.65 blks/sec
0.10 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 84,678.99 ms
44.510 ms/sec
0.010 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.105)

Start: 2020-02-18T01:55:05.051858+00:00
End: 2020-02-18T02:27:16.207053+00:00
Period seconds: 1931.15519
Period age: 00:32:11.155195

Calls Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
9,269,937
4.81K/sec
1.00/call
100.00%		 845,425.20 ms
437.782 ms/sec
0.091 ms/call
100.00%		 31,037,426
16.08K/sec
3.35/call
100.00%		 314,810,479 blks
163.02K blks/sec
33.96 blks/call
100.00%		 757,231 blks
392.11 blks/sec
0.08 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 90,963.68 ms
47.103 ms/sec
0.010 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.107)

Start: 2020-02-18T01:55:07.473459+00:00
End: 2020-02-18T02:28:33.945751+00:00
Period seconds: 2006.47229
Period age: 00:33:26.472292

Calls Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
7,098,494
3.54K/sec
1.00/call
100.00%		 879,956.55 ms
438.559 ms/sec
0.124 ms/call
100.00%		 33,529,798
16.72K/sec
4.72/call
100.00%		 331,832,514 blks
165.39K blks/sec
46.75 blks/call
100.00%		 774,076 blks
385.79 blks/sec
0.11 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 75,132.20 ms
37.445 ms/sec
0.011 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.108)

Start: 2020-02-18T01:55:08.619906+00:00
End: 2020-02-18T02:29:03.937883+00:00
Period seconds: 2035.31797
Period age: 00:33:55.317977

Calls Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
9,098,128
4.48K/sec
1.00/call
100.00%		 849,223.52 ms
417.244 ms/sec
0.093 ms/call
100.00%		 33,427,442
16.43K/sec
3.67/call
100.00%		 326,839,848 blks
160.59K blks/sec
35.92 blks/call
100.00%		 857,170 blks
421.15 blks/sec
0.09 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 61,801.27 ms
30.364 ms/sec
0.007 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.109)

Start: 2020-02-18T01:55:09.746181+00:00
End: 2020-02-18T02:29:35.563156+00:00
Period seconds: 2065.81698
Period age: 00:34:25.816975

Calls Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
10,634,760
5.15K/sec
1.00/call
100.00%		 899,929.34 ms
435.629 ms/sec
0.085 ms/call
100.00%		 32,657,772
15.81K/sec
3.07/call
100.00%		 324,814,846 blks
157.24K blks/sec
30.54 blks/call
100.00%		 635,830 blks
307.79 blks/sec
0.06 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 60,592.92 ms
29.331 ms/sec
0.006 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Conclusions

Recommendations

  Table of contents

K002 Workload Type ("The First Word" Analysis)

Observations

Data collected: 2020-02-18 02:29:35 +0000 UTC
Current database: gitlabhq_production

Master (10.220.16.106)

Start: 2020-02-18T01:55:06.322528+00:00
End: 2020-02-18T02:28:01.581982+00:00
Period seconds: 1975.25945
Period age: 00:32:55.259454

Error (calls): 0.00 (0.00%)
Error (total time): 0.00 (0.00%)

# Workload type Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1 select 18,637,578
9.44K/sec
1.00/call
92.35%		 3,236,076.03 ms
1638.304 ms/sec
0.174 ms/call
83.02%		 171,309,182
86.73K/sec
9.19/call
99.41%		 1,209,584,397 blks
612.37K blks/sec
64.90 blks/call
97.36%		 350,420 blks
177.40 blks/sec
0.02 blks/call
64.02%		 26,124 blks
13.23 blks/sec
0.00 blks/call
3.14%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 270,794.74 ms
137.093 ms/sec
0.015 ms/call
67.31%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2 update 758,335
383.92/sec
1.00/call
3.76%		 515,859.48 ms
261.160 ms/sec
0.680 ms/call
13.23%		 717,160
363.07/sec
0.95/call
0.42%		 23,647,783 blks
11.98K blks/sec
31.18 blks/call
1.90%		 101,943 blks
51.61 blks/sec
0.13 blks/call
18.63%		 632,407 blks
320.16 blks/sec
0.83 blks/call
75.93%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 61,791.38 ms
31.283 ms/sec
0.081 ms/call
15.36%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3 insert 203,043
102.79/sec
1.00/call
1.01%		 84,424.32 ms
42.741 ms/sec
0.416 ms/call
2.17%		 273,747
138.59/sec
1.35/call
0.16%		 5,903,086 blks
2.99K blks/sec
29.07 blks/call
0.48%		 65,887 blks
33.36 blks/sec
0.32 blks/call
12.04%		 171,234 blks
86.69 blks/sec
0.84 blks/call
20.56%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 46,729.72 ms
23.658 ms/sec
0.230 ms/call
11.62%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
4 with 118,556
60.02/sec
1.00/call
0.59%		 55,673.41 ms
28.185 ms/sec
0.470 ms/call
1.43%		 12,165
6.16/sec
0.10/call
0.01%		 3,169,543 blks
1.61K blks/sec
26.73 blks/call
0.26%		 28,578 blks
14.47 blks/sec
0.24 blks/call
5.22%		 952 blks
0.48 blks/sec
0.01 blks/call
0.11%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 22,985.06 ms
11.636 ms/sec
0.194 ms/call
5.71%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
5 set 454,740
230.22/sec
1.00/call
2.25%		 4,681.61 ms
2.370 ms/sec
0.010 ms/call
0.12%		 0
0.00/sec
0.00/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
6 select ... for [no key] update 8,278
4.19/sec
1.00/call
0.04%		 1,233.24 ms
0.624 ms/sec
0.149 ms/call
0.03%		 8,278
4.19/sec
1.00/call
0.00%		 42,981 blks
21.76 blks/sec
5.19 blks/call
0.00%		 498 blks
0.25 blks/sec
0.06 blks/call
0.09%		 2,170 blks
1.10 blks/sec
0.26 blks/call
0.26%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 11.26 ms
0.006 ms/sec
0.001 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica servers:

Replica (10.220.16.101)

Start: 2020-02-18T01:54:59.494149+00:00
End: 2020-02-18T02:25:19.993584+00:00
Period seconds: 1820.49943
Period age: 00:30:20.499435

# Workload type Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1 select 6,241,897
3.43K/sec
1.00/call
95.33%		 844,467.63 ms
463.866 ms/sec
0.135 ms/call
96.84%		 30,098,793
16.54K/sec
4.82/call
98.26%		 321,687,426 blks
176.71K blks/sec
51.54 blks/call
97.15%		 699,905 blks
384.46 blks/sec
0.11 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 63,982.10 ms
35.145 ms/sec
0.010 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2 with 306,047
168.11/sec
1.00/call
4.67%		 27,519.93 ms
15.117 ms/sec
0.090 ms/call
3.16%		 534,305
293.49/sec
1.75/call
1.74%		 9,429,587 blks
5.18K blks/sec
30.81 blks/call
2.85%		 2 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.04 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.102)

Start: 2020-02-18T01:55:01.617415+00:00
End: 2020-02-18T02:25:48.233784+00:00
Period seconds: 1846.61637
Period age: 00:30:46.616369

# Workload type Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1 select 6,152,712
3.34K/sec
1.00/call
95.22%		 871,610.31 ms
472.004 ms/sec
0.142 ms/call
96.68%		 30,357,570
16.44K/sec
4.93/call
98.26%		 301,486,844 blks
163.27K blks/sec
49.00 blks/call
96.75%		 704,995 blks
381.78 blks/sec
0.11 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 75,677.31 ms
40.982 ms/sec
0.012 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2 with 308,989
167.33/sec
1.00/call
4.78%		 29,925.51 ms
16.206 ms/sec
0.097 ms/call
3.32%		 539,129
291.96/sec
1.74/call
1.74%		 10,133,840 blks
5.49K blks/sec
32.80 blks/call
3.25%		 5 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.98 ms
0.001 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.103)

Start: 2020-02-18T01:55:02.7466+00:00
End: 2020-02-18T02:26:17.588+00:00
Period seconds: 1874.8414
Period age: 00:31:14.8414

# Workload type Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1 select 5,671,233
3.03K/sec
1.00/call
59.69%		 734,743.16 ms
391.896 ms/sec
0.130 ms/call
94.07%		 29,152,519
15.55K/sec
5.14/call
98.16%		 287,305,537 blks
153.25K blks/sec
50.66 blks/call
96.80%		 660,164 blks
352.12 blks/sec
0.12 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 72,718.44 ms
38.786 ms/sec
0.013 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2 with 313,649
167.29/sec
1.00/call
3.30%		 28,280.83 ms
15.084 ms/sec
0.090 ms/call
3.62%		 546,582
291.54/sec
1.74/call
1.84%		 9,502,944 blks
5.07K blks/sec
30.30 blks/call
3.20%		 1 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.02 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3 set 3,516,793
1.88K/sec
1.00/call
37.01%		 18,005.93 ms
9.604 ms/sec
0.005 ms/call
2.31%		 0
0.00/sec
0.00/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.104)

Start: 2020-02-18T01:55:03.870674+00:00
End: 2020-02-18T02:26:46.339032+00:00
Period seconds: 1902.46836
Period age: 00:31:42.468358

# Workload type Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1 select 6,267,368
3.30K/sec
1.00/call
75.49%		 787,302.05 ms
413.832 ms/sec
0.126 ms/call
95.42%		 30,374,180
15.97K/sec
4.85/call
98.19%		 297,472,091 blks
156.37K blks/sec
47.46 blks/call
96.96%		 823,107 blks
432.65 blks/sec
0.13 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 84,678.95 ms
44.510 ms/sec
0.014 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2 with 321,234
168.85/sec
1.00/call
3.87%		 28,867.02 ms
15.173 ms/sec
0.090 ms/call
3.50%		 559,604
294.15/sec
1.74/call
1.81%		 9,333,058 blks
4.91K blks/sec
29.05 blks/call
3.04%		 2 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.04 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3 set 1,713,750
900.80/sec
1.00/call
20.64%		 8,898.78 ms
4.677 ms/sec
0.005 ms/call
1.08%		 0
0.00/sec
0.00/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.105)

Start: 2020-02-18T01:55:05.051858+00:00
End: 2020-02-18T02:27:16.207053+00:00
Period seconds: 1931.15519
Period age: 00:32:11.155195

# Workload type Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1 select 5,903,990
3.06K/sec
1.00/call
63.69%		 801,634.77 ms
415.106 ms/sec
0.136 ms/call
94.82%		 30,473,154
15.78K/sec
5.16/call
98.18%		 306,116,426 blks
158.52K blks/sec
51.85 blks/call
97.24%		 757,231 blks
392.11 blks/sec
0.13 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 90,963.68 ms
47.103 ms/sec
0.015 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2 with 323,528
167.53/sec
1.00/call
3.49%		 27,742.40 ms
14.366 ms/sec
0.086 ms/call
3.28%		 564,272
292.19/sec
1.74/call
1.82%		 8,694,053 blks
4.51K blks/sec
26.87 blks/call
2.76%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3 set 3,042,419
1.58K/sec
1.00/call
32.82%		 16,048.03 ms
8.310 ms/sec
0.005 ms/call
1.90%		 0
0.00/sec
0.00/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.107)

Start: 2020-02-18T01:55:07.473459+00:00
End: 2020-02-18T02:28:33.945751+00:00
Period seconds: 2006.47229
Period age: 00:33:26.472292

# Workload type Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1 select 6,762,728
3.38K/sec
1.00/call
95.27%		 851,786.18 ms
424.519 ms/sec
0.126 ms/call
96.80%		 32,945,439
16.42K/sec
4.87/call
98.26%		 322,145,860 blks
160.56K blks/sec
47.64 blks/call
97.08%		 774,071 blks
385.79 blks/sec
0.11 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 75,132.12 ms
37.445 ms/sec
0.011 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2 with 335,766
167.34/sec
1.00/call
4.73%		 28,170.37 ms
14.040 ms/sec
0.084 ms/call
3.20%		 584,359
291.24/sec
1.74/call
1.74%		 9,686,654 blks
4.83K blks/sec
28.85 blks/call
2.92%		 5 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.09 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.108)

Start: 2020-02-18T01:55:08.619906+00:00
End: 2020-02-18T02:29:03.937883+00:00
Period seconds: 2035.31797
Period age: 00:33:55.317977

# Workload type Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1 select 6,726,387
3.31K/sec
1.00/call
73.93%		 811,348.52 ms
398.635 ms/sec
0.121 ms/call
95.54%		 32,833,671
16.14K/sec
4.88/call
98.22%		 317,934,364 blks
156.21K blks/sec
47.27 blks/call
97.28%		 857,167 blks
421.15 blks/sec
0.13 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 61,798.34 ms
30.363 ms/sec
0.009 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2 with 340,786
167.44/sec
1.00/call
3.75%		 27,809.27 ms
13.663 ms/sec
0.082 ms/call
3.27%		 593,771
291.73/sec
1.74/call
1.78%		 8,905,484 blks
4.38K blks/sec
26.13 blks/call
2.72%		 3 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 2.94 ms
0.001 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3 set 2,030,955
997.86/sec
1.00/call
22.32%		 10,065.73 ms
4.946 ms/sec
0.005 ms/call
1.19%		 0
0.00/sec
0.00/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.109)

Start: 2020-02-18T01:55:09.746181+00:00
End: 2020-02-18T02:29:35.563156+00:00
Period seconds: 2065.81698
Period age: 00:34:25.816975

# Workload type Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1 select 6,248,333
3.03K/sec
1.00/call
58.75%		 847,651.88 ms
410.323 ms/sec
0.136 ms/call
94.19%		 32,057,110
15.52K/sec
5.13/call
98.16%		 314,675,132 blks
152.33K blks/sec
50.36 blks/call
96.88%		 635,828 blks
307.79 blks/sec
0.10 blks/call
100.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 60,592.87 ms
29.331 ms/sec
0.010 ms/call
100.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2 with 344,684
166.85/sec
1.00/call
3.24%		 31,409.19 ms
15.204 ms/sec
0.091 ms/call
3.49%		 600,662
290.76/sec
1.74/call
1.84%		 10,139,714 blks
4.91K blks/sec
29.42 blks/call
3.12%		 2 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.04 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3 set 4,041,743
1.96K/sec
1.00/call
38.01%		 20,868.28 ms
10.102 ms/sec
0.005 ms/call
2.32%		 0
0.00/sec
0.00/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Conclusions

Recommendations

  Table of contents

K003 Top-20 Queries by total_time

Observations

Data collected: 2020-02-18 02:29:35 +0000 UTC
Current database: gitlabhq_production

Master (10.220.16.106)

Start: 2020-02-18T01:55:06.322528+00:00
End: 2020-02-18T02:28:01.581982+00:00
Period seconds: 1975.25945
Period age: 00:32:55.259454

Error (calls): 0.00 (0.00%)
Error (total time): 0.00 (0.00%)

The list is limited to 20 items.

#
(query id)		 Query Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1
(1535141318)		 SELECT ? AS one FROM ((SELECT "projects".* 
FROM "projects" WHERE "projects"."namespace_id" 
IN (WITH RECURSIVE "base_and_descendants" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE "namespaces"."id" 
IN (SELECT "elasticsearch_indexed_namespaces"."namespace_id" 
FROM "elasticsearch_indexed_namespaces"))
UNION
(
SELECT "namespaces".* FROM "namespaces",
 "base_and_descendants" WHERE "namespaces"."parent_id" 
= "base_and_descendants"."id")) 
SELECT "id" FROM "base_and_descendants" 
AS "namespaces"))
UNION
(SELECT 
"projects".* FROM "projects" WHERE 
"projects"."id" IN (SELECT "elasticsearch_indexed_projects"."project_id" 
FROM "elasticsearch_indexed_projects"))) 
projects WHERE "projects"."id" 
= ? LIMIT ?
Full query 		147,947
74.90/sec
1.00/call
0.73%		 1,671,237.24 ms
846.085 ms/sec
11.296 ms/call
42.87%		 3,043
1.54/sec
0.02/call
0.00%		 790,191,819 blks
400.05K blks/sec
5.35K blks/call
63.60%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1,070 blks
0.54 blks/sec
0.01 blks/call
0.13%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2
(3258414343)		 UPDATE "ci_builds" SET "runner_id" 
= ?, "status" = ?, "started_at" 
= ?, "updated_at" = ?, "lock_version" 
= ? WHERE "ci_builds"."type" IN 
(?) AND "ci_builds"."lock_version" 
= ? AND "ci_builds"."id" = ?
Full query 		43,979
22.26/sec
1.00/call
0.22%		 184,607.85 ms
93.460 ms/sec
4.198 ms/call
4.74%		 11,455
5.80/sec
0.26/call
0.01%		 1,317,091 blks
666.79 blks/sec
29.95 blks/call
0.11%		 3,967 blks
2.01 blks/sec
0.09 blks/call
0.72%		 11,252 blks
5.70 blks/sec
0.26 blks/call
1.35%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1,124.49 ms
0.569 ms/sec
0.026 ms/call
0.28%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3
(722013345)		 SELECT  "users".* FROM "users" WHERE 
"users"."unlock_token" = ? ORDER 
BY "users"."id" ASC LIMIT ?
Full query 		17
0.01/sec
1.00/call
0.00%		 183,873.34 ms
93.088 ms/sec
10816.079 ms/call
4.72%		 0
0.00/sec
0.00/call
0.00%		 85,082,001 blks
43.08K blks/sec
5.01M blks/call
6.85%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 2,093 blks
1.06 blks/sec
123.12 blks/call
0.25%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
4
(3670659708)		 SELECT "project_authorizations"."project_id",
 "project_authorizations"."access_level" 
FROM "project_authorizations" WHERE 
"project_authorizations"."user_id" 
= ?
Full query 		53,496
27.08/sec
1.00/call
0.27%		 110,236.92 ms
55.809 ms/sec
2.061 ms/call
2.83%		 49,610,302
25.12K/sec
927.36/call
28.79%		 27,255,082 blks
13.80K blks/sec
509.48 blks/call
2.19%		 6,424 blks
3.25 blks/sec
0.12 blks/call
1.17%		 3,049 blks
1.54 blks/sec
0.06 blks/call
0.37%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 4,668.40 ms
2.363 ms/sec
0.087 ms/call
1.16%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
5
(22434950)		 SELECT "projects".* FROM "projects" 
INNER JOIN project_mirror_data 
import_state ON import_state.project_id 
= projects.id WHERE "projects"."archived" 
= ? AND "projects"."mirror" = ? 
AND "import_state"."status" NOT 
IN (?, ?) AND (import_state.next_execution_timestamp 
<= ?) AND (import_state.retry_count 
<= ?) ORDER BY import_state.next_execution_timestamp 
LIMIT ?
Full query 		423
0.21/sec
1.00/call
0.00%		 96,990.03 ms
49.102 ms/sec
229.291 ms/call
2.49%		 69,152
35.01/sec
163.48/call
0.04%		 43,838,206 blks
22.20K blks/sec
103.64K blks/call
3.53%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 2,106 blks
1.07 blks/sec
4.98 blks/call
0.25%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
6
(3220074313)		 UPDATE "project_mirror_data" SET 
"status" = ?, "last_update_started_at" 
= ? WHERE "project_mirror_data"."id" 
= ?
Full query 		118,226
59.85/sec
1.00/call
0.59%		 96,358.13 ms
48.783 ms/sec
0.815 ms/call
2.47%		 118,226
59.85/sec
1.00/call
0.07%		 3,844,346 blks
1.95K blks/sec
32.52 blks/call
0.31%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 2,551 blks
1.29 blks/sec
0.02 blks/call
0.31%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
7
(1608875156)		 SELECT (CASE
          WHEN (SELECT 
count(*) FROM "ci_builds" WHERE 
"ci_builds"."stage_id" = ? AND 
("ci_builds"."retried" = ? OR "ci_builds"."retried" 
IS NULL) AND (allow_failure = ? 
OR status IN (?,?,?,?,?,?,?,?)))=(
SELECT count(*) FROM "ci_builds" 
WHERE "ci_builds"."stage_id" = 
? AND ("ci_builds"."retried" = 
? OR "ci_builds"."retried" IS NULL) 
AND (allow_failure = ? OR status 
IN (?,?,?,?,?,?,?,?)) AND ("ci_builds"."status" 
IN (?))) AND (SELECT count(*) > 
? FROM "ci_builds" WHERE "ci_builds"."stage_id" 
= ? AND ("ci_builds"."retried" 
= ? OR "ci_builds"."retried" IS 
NULL) AND "ci_builds"."allow_failure" 
= ? AND "ci_builds"."status" IN 
(?, ?)) THEN ?
          WHEN (
SELECT count(*) FROM "ci_builds" 
WHERE "ci_builds"."stage_id" = 
? AND ("ci_builds"."retried" = 
? OR "ci_builds"."retried" IS NULL) 
AND (allow_failure = ? OR status 
IN (?,?,?,?,?,?,?,?)))=(SELECT 
count(*) FROM "ci_builds" WHERE 
"ci_builds"."stage_id" = ? AND 
("ci_builds"."retried" = ? OR "ci_builds"."retried" 
IS NULL) AND (al...
Full query 		38,887
19.69/sec
1.00/call
0.19%		 92,924.51 ms
47.044 ms/sec
2.390 ms/call
2.38%		 1,478,076
748.29/sec
38.01/call
0.86%		 60,179,001 blks
30.47K blks/sec
1.55K blks/call
4.84%		 31 blks
0.02 blks/sec
0.00 blks/call
0.01%		 308 blks
0.16 blks/sec
0.01 blks/call
0.04%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 27.63 ms
0.014 ms/sec
0.001 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
8
(82761870)		 SELECT COUNT(*) FROM "merge_requests" 
INNER JOIN "projects" ON "projects"."id" 
= "merge_requests"."target_project_id" 
LEFT JOIN project_features ON projects.id 
= project_features.project_id WHERE 
(EXISTS (SELECT ? FROM "project_authorizations" 
WHERE "project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id) AND (project_authorizations.access_level 
>= ?)) OR projects.visibility_level 
IN (?,?)) AND ("project_features"."merge_requests_access_level" 
IS NULL OR "project_features"."merge_requests_access_level" 
IN (?,?) OR ("project_features"."merge_requests_access_level" 
= ? AND EXISTS (SELECT ? FROM "project_authorizations" 
WHERE "project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id) AND (project_authorizations.access_level 
>= ?)))) AND ("merge_requests"."state_id" 
IN (?)) AND (EXISTS (SELECT ? FROM 
merge_request_assignees WHERE user_id 
= ? AND merge_request_id = merge_requests.id)) 
AND "projects"."archived" = ?
Full query 		2,165
1.10/sec
1.00/call
0.01%		 56,975.50 ms
28.845 ms/sec
26.317 ms/call
1.46%		 2,165
1.10/sec
1.00/call
0.00%		 668,759 blks
338.57 blks/sec
308.90 blks/call
0.05%		 69,823 blks
35.35 blks/sec
32.25 blks/call
12.76%		 285 blks
0.14 blks/sec
0.13 blks/call
0.03%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 51,932.19 ms
26.291 ms/sec
23.987 ms/call
12.91%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
9
(473577831)		 SELECT "taggings".* FROM "taggings" 
WHERE "taggings"."taggable_id" 
= ? AND "taggings"."taggable_type" 
= ?
Full query 		1,011,770
512.22/sec
1.00/call
5.01%		 47,679.84 ms
24.139 ms/sec
0.047 ms/call
1.22%		 1,041,286
527.16/sec
1.03/call
0.60%		 4,475,761 blks
2.27K blks/sec
4.42 blks/call
0.36%		 29,140 blks
14.75 blks/sec
0.03 blks/call
5.32%		 377 blks
0.19 blks/sec
0.00 blks/call
0.05%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 23,417.13 ms
11.855 ms/sec
0.023 ms/call
5.82%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
10
(2555545475)		 SELECT  "projects".* FROM "projects" 
WHERE "projects"."id" = ? LIMIT 
?
Full query 		856,968
433.85/sec
1.00/call
4.25%		 46,672.89 ms
23.629 ms/sec
0.054 ms/call
1.20%		 856,874
433.80/sec
1.00/call
0.50%		 3,604,041 blks
1.83K blks/sec
4.21 blks/call
0.29%		 32 blks
0.02 blks/sec
0.00 blks/call
0.01%		 310 blks
0.16 blks/sec
0.00 blks/call
0.04%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 25.40 ms
0.013 ms/sec
0.000 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
11
(3926131182)		 SELECT  ? AS one FROM "merge_requests" 
WHERE "merge_requests"."target_project_id" 
= ? AND ("merge_requests"."state_id" 
IN (?)) AND "merge_requests"."in_progress_merge_commit_sha" 
= ? AND "merge_requests"."target_branch" 
= ? LIMIT ?
Full query 		7,754
3.93/sec
1.00/call
0.04%		 46,672.60 ms
23.629 ms/sec
6.019 ms/call
1.20%		 439
0.22/sec
0.06/call
0.00%		 295,792 blks
149.75 blks/sec
38.15 blks/call
0.02%		 62,221 blks
31.50 blks/sec
8.02 blks/call
11.37%		 418 blks
0.21 blks/sec
0.05 blks/call
0.05%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 43,259.53 ms
21.901 ms/sec
5.579 ms/call
10.75%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
12
(3502758514)		 SELECT (CASE
          WHEN (SELECT 
count(*) FROM "ci_builds" WHERE 
"ci_builds"."commit_id" = ? AND 
("ci_builds"."retried" = ? OR "ci_builds"."retried" 
IS NULL) AND (allow_failure = ? 
OR status IN (?,?,?,?,?,?,?,?)))=(
SELECT count(*) FROM "ci_builds" 
WHERE "ci_builds"."commit_id" = 
? AND ("ci_builds"."retried" = 
? OR "ci_builds"."retried" IS NULL) 
AND (allow_failure = ? OR status 
IN (?,?,?,?,?,?,?,?)) AND ("ci_builds"."status" 
IN (?))) AND (SELECT count(*) > 
? FROM "ci_builds" WHERE "ci_builds"."commit_id" 
= ? AND ("ci_builds"."retried" 
= ? OR "ci_builds"."retried" IS 
NULL) AND "ci_builds"."allow_failure" 
= ? AND "ci_builds"."status" IN 
(?, ?)) THEN ?
          WHEN (
SELECT count(*) FROM "ci_builds" 
WHERE "ci_builds"."commit_id" = 
? AND ("ci_builds"."retried" = 
? OR "ci_builds"."retried" IS NULL) 
AND (allow_failure = ? OR status 
IN (?,?,?,?,?,?,?,?)))=(SELECT 
count(*) FROM "ci_builds" WHERE 
"ci_builds"."commit_id" = ? AND 
("ci_builds"."retried" = ? OR "ci_builds"."retried" 
IS NULL) AN...
Full query 		42,104
21.32/sec
1.00/call
0.21%		 45,312.91 ms
22.940 ms/sec
1.076 ms/call
1.16%		 1,897,971
960.87/sec
45.08/call
1.10%		 31,962,447 blks
16.19K blks/sec
759.13 blks/call
2.57%		 170 blks
0.09 blks/sec
0.00 blks/call
0.03%		 162 blks
0.08 blks/sec
0.00 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 152.02 ms
0.077 ms/sec
0.004 ms/call
0.04%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
13
(3931118300)		 WITH "shas" AS (SELECT  "merge_request_diff_commits"."sha" 
FROM "merge_request_diff_commits" 
WHERE "merge_request_diff_commits"."merge_request_diff_id" 
IN (SELECT  "merge_request_diffs"."id" 
FROM "merge_request_diffs" WHERE 
"merge_request_diffs"."merge_request_id" 
= ? ORDER BY "merge_request_diffs"."id" 
DESC LIMIT ?) LIMIT ?) SELECT  
? AS one FROM ((SELECT "ci_pipelines".* 
FROM "ci_pipelines" INNER JOIN 
"shas" ON "shas"."sha" = "ci_pipelines"."source_sha" 
WHERE "ci_pipelines"."project_id" 
= ? AND ("ci_pipelines"."config_source" 
IN (?, ?, ?, ?) OR "ci_pipelines"."config_source" 
IS NULL) AND "ci_pipelines"."source" 
= ? AND "ci_pipelines"."merge_request_id" 
= ?)
UNION
(SELECT "ci_pipelines".* 
FROM "ci_pipelines" INNER JOIN 
"shas" ON encode("shas"."sha", 
?) = "ci_pipelines"."sha" WHERE 
"ci_pipelines"."project_id" = ? 
AND ("ci_pipelines"."config_source" 
IN (?, ?, ?, ?) OR "ci_pipelines"."config_source" 
IS NULL) AND "ci_pipelines"."source" 
= ? AND "ci_pipelines"."merge_request_id" 
= ?)
UNIO...
Full query 		107,724
54.54/sec
1.00/call
0.53%		 39,091.04 ms
19.790 ms/sec
0.363 ms/call
1.00%		 2,908
1.47/sec
0.03/call
0.00%		 2,549,589 blks
1.30K blks/sec
23.67 blks/call
0.21%		 23,251 blks
11.77 blks/sec
0.22 blks/call
4.25%		 715 blks
0.36 blks/sec
0.01 blks/call
0.09%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 19,085.95 ms
9.663 ms/sec
0.177 ms/call
4.74%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
14
(694815)		 UPDATE "projects" SET "last_activity_at" 
= ? WHERE "projects"."id" = ? AND 
(last_activity_at <= ?)
Full query 		5,012
2.54/sec
1.00/call
0.02%		 36,916.05 ms
18.689 ms/sec
7.366 ms/call
0.95%		 4,843
2.45/sec
0.97/call
0.00%		 741,457 blks
375.37 blks/sec
147.94 blks/call
0.06%		 53,163 blks
26.91 blks/sec
10.61 blks/call
9.71%		 145,661 blks
73.74 blks/sec
29.06 blks/call
17.49%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 26,548.48 ms
13.441 ms/sec
5.297 ms/call
6.60%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
15
(2388959352)		 SELECT  ? AS one FROM "ci_builds" 
WHERE "ci_builds"."type" IN (?) 
AND "ci_builds"."commit_id" = ? 
AND ("ci_builds"."retried" = ? 
OR "ci_builds"."retried" IS NULL) 
AND (EXISTS (SELECT ? FROM "ci_job_artifacts" 
WHERE (ci_builds.id = ci_job_artifacts.job_id) 
AND "ci_job_artifacts"."file_type" 
= ?)) LIMIT ?
Full query 		139,344
70.54/sec
1.00/call
0.69%		 35,487.00 ms
17.966 ms/sec
0.255 ms/call
0.91%		 17,850
9.04/sec
0.13/call
0.01%		 5,997,614 blks
3.04K blks/sec
43.04 blks/call
0.48%		 22,185 blks
11.23 blks/sec
0.16 blks/call
4.05%		 51 blks
0.03 blks/sec
0.00 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 17,033.26 ms
8.623 ms/sec
0.122 ms/call
4.23%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
16
(1850364306)		 SELECT  "routes".* FROM "routes" 
WHERE "routes"."source_id" = ? 
AND "routes"."source_type" = ? 
LIMIT ?
Full query 		725,810
367.45/sec
1.00/call
3.60%		 34,445.59 ms
17.439 ms/sec
0.047 ms/call
0.88%		 725,809
367.45/sec
1.00/call
0.42%		 3,627,989 blks
1.84K blks/sec
5.00 blks/call
0.29%		 3,526 blks
1.79 blks/sec
0.00 blks/call
0.64%		 58 blks
0.03 blks/sec
0.00 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 3,319.66 ms
1.681 ms/sec
0.005 ms/call
0.83%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
17
(2869434099)		 SELECT  ? AS one FROM "keys" WHERE 
"keys"."fingerprint" = ? AND "keys"."id" 
!= ? LIMIT ?
Full query 		776,304
393.01/sec
1.00/call
3.85%		 32,904.73 ms
16.658 ms/sec
0.042 ms/call
0.84%		 0
0.00/sec
0.00/call
0.00%		 3,893,627 blks
1.98K blks/sec
5.02 blks/call
0.31%		 2,379 blks
1.20 blks/sec
0.00 blks/call
0.43%		 954 blks
0.48 blks/sec
0.00 blks/call
0.11%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 365.84 ms
0.185 ms/sec
0.000 ms/call
0.09%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
18
(985994114)		 UPDATE "project_mirror_data" SET 
"status" = ?, "next_execution_timestamp" 
= ?, "last_update_at" = ?, "last_successful_update_at" 
= ? WHERE "project_mirror_data"."id" 
= ?
Full query 		118,115
59.80/sec
1.00/call
0.59%		 31,705.84 ms
16.051 ms/sec
0.268 ms/call
0.81%		 118,115
59.80/sec
1.00/call
0.07%		 4,097,058 blks
2.08K blks/sec
34.69 blks/call
0.33%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 3,848 blks
1.95 blks/sec
0.03 blks/call
0.46%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
19
(3589441560)		 SELECT ?
Full query 		8,714,316
4.42K/sec
1.00/call
43.18%		 31,674.57 ms
16.036 ms/sec
0.004 ms/call
0.81%		 8,714,316
4.42K/sec
1.00/call
5.06%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
20
(1427145140)		 SELECT  "deployments".* FROM "deployments" 
INNER JOIN "environments" ON "environments"."id" 
= "deployments"."environment_id" 
WHERE "deployments"."project_id" 
= ? AND "deployments"."status" 
= ? AND "environments"."name" = 
? AND "deployments"."id" != ? ORDER 
BY "deployments"."id" DESC LIMIT 
?
Full query 		932
0.47/sec
1.00/call
0.00%		 30,427.87 ms
15.404 ms/sec
32.648 ms/call
0.78%		 849
0.43/sec
0.91/call
0.00%		 897,159 blks
454.20 blks/sec
962.62 blks/call
0.07%		 34,028 blks
17.23 blks/sec
36.51 blks/call
6.22%		 111 blks
0.06 blks/sec
0.12 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 25,521.97 ms
12.921 ms/sec
27.384 ms/call
6.34%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica servers:

Replica (10.220.16.101)

Start: 2020-02-18T01:54:59.494149+00:00
End: 2020-02-18T02:25:19.993584+00:00
Period seconds: 1820.49943
Period age: 00:30:20.499435

Top 50 rows

#
(query id)		 Query Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1
(308654979)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		394
0.22/sec
1.00/call
0.01%		 115,769.51 ms
63.592 ms/sec
293.831 ms/call
13.28%		 2,300
1.26/sec
5.84/call
0.01%		 81,557,389 blks
44.80K blks/sec
207.00K blks/call
24.63%		 103 blks
0.06 blks/sec
0.26 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 3.61 ms
0.002 ms/sec
0.009 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2
(1272236258)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		365
0.20/sec
1.00/call
0.01%		 106,373.92 ms
58.431 ms/sec
291.435 ms/call
12.20%		 2,338
1.28/sec
6.41/call
0.01%		 75,748,200 blks
41.61K blks/sec
207.53K blks/call
22.88%		 89 blks
0.05 blks/sec
0.24 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 3.23 ms
0.002 ms/sec
0.009 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3
(2146878610)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_builds" WHERE "ci_builds"."type" 
IN (?) AND "ci_builds"."project_id" 
= ? LIMIT ?) subquery_for_count
Full query 		2,004
1.10/sec
1.00/call
0.03%		 49,918.95 ms
27.420 ms/sec
24.910 ms/call
5.72%		 2,004
1.10/sec
1.00/call
0.01%		 6,843,390 blks
3.76K blks/sec
3.42K blks/call
2.07%		 68,886 blks
37.84 blks/sec
34.37 blks/call
9.84%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 27,100.62 ms
14.886 ms/sec
13.523 ms/call
42.36%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
4
(2550092883)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		179
0.10/sec
1.00/call
0.00%		 41,512.98 ms
22.803 ms/sec
231.916 ms/call
4.76%		 9,224
5.07/sec
51.53/call
0.03%		 27,745,864 blks
15.25K blks/sec
155.01K blks/call
8.38%		 13 blks
0.01 blks/sec
0.07 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 6.05 ms
0.003 ms/sec
0.034 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
5
(1682658247)		 SELECT "environments".* FROM "environments" 
WHERE "environments"."project_id" 
= ? AND ("environments"."state" 
IN (?)) AND "environments"."id" 
IN (SELECT "deployments"."environment_id" 
FROM "deployments" WHERE "deployments"."project_id" 
= ? AND "deployments"."sha" = ? 
GROUP BY "deployments"."environment_id") 
ORDER BY (SELECT MAX("deployments"."id") 
FROM "deployments" WHERE "deployments"."environment_id" 
= "environments"."id") DESC NULLS 
LAST
Full query 		3,483
1.91/sec
1.00/call
0.05%		 31,378.25 ms
17.236 ms/sec
9.009 ms/call
3.60%		 528
0.29/sec
0.15/call
0.00%		 12,354,634 blks
6.79K blks/sec
3.55K blks/call
3.73%		 10,454 blks
5.74 blks/sec
3.00 blks/call
1.49%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 379.01 ms
0.208 ms/sec
0.109 ms/call
0.59%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
6
(3182947923)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "projects" WHERE (EXISTS 
(SELECT ? FROM "project_authorizations" 
WHERE "project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?)) AND "projects"."archived" 
= ? AND (("projects"."path" ILIKE 
? OR "projects"."name" ILIKE ?) 
OR "projects"."description" ILIKE 
?) LIMIT ?) subquery_for_count
Full query 		178
0.10/sec
1.00/call
0.00%		 25,713.83 ms
14.125 ms/sec
144.460 ms/call
2.95%		 178
0.10/sec
1.00/call
0.00%		 1,323,547 blks
727.02 blks/sec
7.44K blks/call
0.40%		 4,885 blks
2.68 blks/sec
27.44 blks/call
0.70%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 249.06 ms
0.137 ms/sec
1.399 ms/call
0.39%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
7
(3357552630)		 SELECT  "projects"."id" AS t0_r0,
 "projects"."name" AS t0_r1, "projects"."path" 
AS t0_r2, "projects"."description" 
AS t0_r3, "projects"."created_at" 
AS t0_r4, "projects"."updated_at" 
AS t0_r5, "projects"."creator_id" 
AS t0_r6, "projects"."namespace_id" 
AS t0_r7, "projects"."last_activity_at" 
AS t0_r8, "projects"."import_url" 
AS t0_r9, "projects"."visibility_level" 
AS t0_r10, "projects"."archived" 
AS t0_r11, "projects"."merge_requests_template" 
AS t0_r12, "projects"."star_count" 
AS t0_r13, "projects"."merge_requests_rebase_enabled" 
AS t0_r14, "projects"."import_type" 
AS t0_r15, "projects"."import_source" 
AS t0_r16, "projects"."avatar" 
AS t0_r17, "projects"."approvals_before_merge" 
AS t0_r18, "projects"."reset_approvals_on_push" 
AS t0_r19, "projects"."merge_requests_ff_only_enabled" 
AS t0_r20, "projects"."issues_template" 
AS t0_r21, "projects"."mirror" 
AS t0_r22, "projects"."mirror_user_id" 
AS t0_r23, "projects"."shared_runners_enabled" 
AS t0_r24, "projects"."runners_token" 
AS t0_r25, "...
Full query 		356,706
195.94/sec
1.00/call
5.45%		 24,774.05 ms
13.608 ms/sec
0.069 ms/call
2.84%		 347,150
190.69/sec
0.97/call
1.13%		 3,165,761 blks
1.74K blks/sec
8.87 blks/call
0.96%		 11,889 blks
6.53 blks/sec
0.03 blks/call
1.70%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 400.44 ms
0.220 ms/sec
0.001 ms/call
0.63%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
8
(1187489245)		 SELECT  "projects".* FROM "projects" 
WHERE (EXISTS (SELECT ? FROM "project_authorizations" 
WHERE "project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?)) AND "projects"."archived" 
= ? AND (("projects"."path" ILIKE 
? OR "projects"."name" ILIKE ?) 
OR "projects"."description" ILIKE 
?) ORDER BY "projects"."id" DESC 
LIMIT ? OFFSET ?
Full query 		177
0.10/sec
1.00/call
0.00%		 24,612.86 ms
13.520 ms/sec
139.056 ms/call
2.82%		 30
0.02/sec
0.17/call
0.00%		 1,326,917 blks
728.88 blks/sec
7.50K blks/call
0.40%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
9
(3938502189)		 SELECT COUNT(DISTINCT "events"."id") 
FROM "events" INNER JOIN "projects" 
ON "projects"."id" = "events"."project_id" 
LEFT OUTER JOIN "project_features" 
ON "project_features"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"project_import_data" ON "project_import_data"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"namespaces" ON "namespaces"."id" 
= "projects"."namespace_id" LEFT 
OUTER JOIN "users" ON "users"."id" 
= "events"."author_id" WHERE "events"."project_id" 
= ? AND (EXISTS (SELECT ? FROM 
"project_authorizations" WHERE 
"project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?))
Full query 		1,378
0.76/sec
1.00/call
0.02%		 24,003.88 ms
13.185 ms/sec
17.419 ms/call
2.75%		 1,378
0.76/sec
1.00/call
0.00%		 6,996,842 blks
3.85K blks/sec
5.08K blks/call
2.11%		 9,697 blks
5.33 blks/sec
7.04 blks/call
1.39%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 123.63 ms
0.068 ms/sec
0.090 ms/call
0.19%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
10
(2576098393)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW()
;
Full query 		121
0.07/sec
1.00/call
0.00%		 22,589.35 ms
12.408 ms/sec
186.689 ms/call
2.59%		 121
0.07/sec
1.00/call
0.00%		 14,520,490 blks
7.98K blks/sec
120.01K blks/call
4.39%		 1 blks
0.00 blks/sec
0.01 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.01 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
11
(746170934)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW() - ?::interval
;
Full query 		121
0.07/sec
1.00/call
0.00%		 19,988.85 ms
10.980 ms/sec
165.197 ms/call
2.29%		 121
0.07/sec
1.00/call
0.00%		 13,954,639 blks
7.67K blks/sec
115.33K blks/call
4.21%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
12
(2329378283)		 SELECT  "users".* FROM "users" WHERE 
"users"."id" = ? LIMIT ?
Full query 		374,777
205.86/sec
1.00/call
5.72%		 15,679.42 ms
8.613 ms/sec
0.042 ms/call
1.80%		 374,720
205.83/sec
1.00/call
1.22%		 1,499,089 blks
823.45 blks/sec
4.00 blks/call
0.45%		 5 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.09 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
13
(1850364306)		 SELECT  "routes".* FROM "routes" 
WHERE "routes"."source_id" = ? 
AND "routes"."source_type" = ? 
LIMIT ?
Full query 		402,862
221.29/sec
1.00/call
6.15%		 12,216.04 ms
6.710 ms/sec
0.030 ms/call
1.40%		 402,862
221.29/sec
1.00/call
1.32%		 2,010,024 blks
1.11K blks/sec
4.99 blks/call
0.61%		 5,964 blks
3.28 blks/sec
0.01 blks/call
0.85%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 153.76 ms
0.084 ms/sec
0.000 ms/call
0.24%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
14
(2555545475)		 SELECT  "projects".* FROM "projects" 
WHERE "projects"."id" = ? LIMIT 
?
Full query 		252,819
138.87/sec
1.00/call
3.86%		 11,300.11 ms
6.207 ms/sec
0.045 ms/call
1.30%		 252,813
138.87/sec
1.00/call
0.83%		 1,098,815 blks
603.58 blks/sec
4.35 blks/call
0.33%		 9 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.24 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
15
(2747454572)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND (project_mirror_data.next_execution_timestamp 
- project_mirror_data.last_update_at) 
<= ?::interval
AND project_mirror_data.last_update_at 
< NOW() - ?::interval
;
Full query 		121
0.07/sec
1.00/call
0.00%		 11,226.82 ms
6.167 ms/sec
92.784 ms/call
1.29%		 121
0.07/sec
1.00/call
0.00%		 6,515,398 blks
3.58K blks/sec
53.85K blks/call
1.97%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
16
(3498832929)		 SELECT COUNT(*) FROM (WITH RECURSIVE 
"base_and_ancestors" AS ((SELECT 
"namespaces".* FROM ((SELECT "namespaces".* 
FROM "namespaces" INNER JOIN "members" 
ON "namespaces"."id" = "members"."source_id" 
WHERE "members"."type" = ? AND 
"members"."source_type" = ? AND 
"namespaces"."type" = ? AND "members"."user_id" 
= ? AND "members"."requested_at" 
IS NULL)
UNION
(SELECT namespaces.* 
FROM "projects" INNER JOIN "project_authorizations" 
ON "projects"."id" = "project_authorizations"."project_id" 
INNER JOIN "namespaces" ON "namespaces"."id" 
= "projects"."namespace_id" WHERE 
"project_authorizations"."user_id" 
= ?)) namespaces WHERE "namespaces"."type" 
= ?)
UNION
(SELECT "namespaces".* 
FROM "namespaces", "base_and_ancestors" 
WHERE "namespaces"."type" = ? AND 
"namespaces"."id" = "base_and_ancestors"."parent_id")),
 "base_and_descendants" AS ((SELECT 
"namespaces".* FROM "namespaces" 
INNER JOIN "members" ON "namespaces"."id" 
= "members"."source_id" WHERE "members"."type" 
= ? AND "members"."source_type" 
...
Full query 		234
0.13/sec
1.00/call
0.00%		 10,194.05 ms
5.600 ms/sec
43.564 ms/call
1.17%		 234
0.13/sec
1.00/call
0.00%		 6,455,615 blks
3.55K blks/sec
27.59K blks/call
1.95%		 31 blks
0.02 blks/sec
0.13 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.43 ms
0.000 ms/sec
0.002 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
17
(2418469088)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."id" = ? LIMIT 
?
Full query 		356,852
196.02/sec
1.00/call
5.45%		 10,035.98 ms
5.513 ms/sec
0.028 ms/call
1.15%		 356,852
196.02/sec
1.00/call
1.16%		 1,428,161 blks
784.49 blks/sec
4.00 blks/call
0.43%		 21 blks
0.01 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.36 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
18
(2856151481)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."type" IN (?) 
AND "namespaces"."id" = ? AND "namespaces"."type" 
= ? LIMIT ?
Full query 		328,912
180.67/sec
1.00/call
5.02%		 10,022.01 ms
5.505 ms/sec
0.030 ms/call
1.15%		 270,356
148.51/sec
0.82/call
0.88%		 1,316,208 blks
722.99 blks/sec
4.00 blks/call
0.40%		 57 blks
0.03 blks/sec
0.00 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1.83 ms
0.001 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
19
(1180769399)		 SELECT MAX("project_authorizations"."access_level") 
AS maximum_access_level, "project_authorizations"."user_id" 
AS project_authorizations_user_id 
FROM "project_authorizations" WHERE 
"project_authorizations"."project_id" 
= ? AND "project_authorizations"."user_id" 
= ? GROUP BY "project_authorizations"."user_id"
Full query 		318,535
174.97/sec
1.00/call
4.86%		 9,910.71 ms
5.444 ms/sec
0.031 ms/call
1.14%		 314,626
172.82/sec
0.99/call
1.03%		 1,696,142 blks
931.69 blks/sec
5.32 blks/call
0.51%		 8,486 blks
4.66 blks/sec
0.03 blks/call
1.21%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 440.66 ms
0.242 ms/sec
0.001 ms/call
0.69%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
20
(282616091)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "users" WHERE (("users"."name" 
ILIKE ? OR "users"."username" ILIKE 
?) OR "users"."email" = ?) AND 
"users"."external" != ? LIMIT ?) 
subquery_for_count
Full query 		321
0.18/sec
1.00/call
0.00%		 9,680.59 ms
5.318 ms/sec
30.158 ms/call
1.11%		 321
0.18/sec
1.00/call
0.00%		 589,361 blks
323.74 blks/sec
1.84K blks/call
0.18%		 144 blks
0.08 blks/sec
0.45 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 5.54 ms
0.003 ms/sec
0.017 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.102)

Start: 2020-02-18T01:55:01.617415+00:00
End: 2020-02-18T02:25:48.233784+00:00
Period seconds: 1846.61637
Period age: 00:30:46.616369

Top 50 rows

#
(query id)		 Query Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1
(308654979)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		430
0.23/sec
1.00/call
0.01%		 131,822.63 ms
71.386 ms/sec
306.564 ms/call
14.62%		 1,906
1.03/sec
4.43/call
0.01%		 88,821,115 blks
48.10K blks/sec
206.57K blks/call
28.50%		 115 blks
0.06 blks/sec
0.27 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 3.97 ms
0.002 ms/sec
0.009 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2
(1272236258)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		370
0.20/sec
1.00/call
0.01%		 110,329.04 ms
59.747 ms/sec
298.187 ms/call
12.24%		 2,103
1.14/sec
5.68/call
0.01%		 76,548,115 blks
41.46K blks/sec
206.89K blks/call
24.56%		 112 blks
0.06 blks/sec
0.30 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 3.43 ms
0.002 ms/sec
0.009 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3
(2146878610)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_builds" WHERE "ci_builds"."type" 
IN (?) AND "ci_builds"."project_id" 
= ? LIMIT ?) subquery_for_count
Full query 		2,048
1.11/sec
1.00/call
0.03%		 56,269.06 ms
30.471 ms/sec
27.475 ms/call
6.24%		 2,048
1.11/sec
1.00/call
0.01%		 7,276,649 blks
3.95K blks/sec
3.56K blks/call
2.34%		 82,268 blks
44.55 blks/sec
40.17 blks/call
11.67%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 29,493.94 ms
15.972 ms/sec
14.401 ms/call
38.97%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
4
(1682658247)		 SELECT "environments".* FROM "environments" 
WHERE "environments"."project_id" 
= ? AND ("environments"."state" 
IN (?)) AND "environments"."id" 
IN (SELECT "deployments"."environment_id" 
FROM "deployments" WHERE "deployments"."project_id" 
= ? AND "deployments"."sha" = ? 
GROUP BY "deployments"."environment_id") 
ORDER BY (SELECT MAX("deployments"."id") 
FROM "deployments" WHERE "deployments"."environment_id" 
= "environments"."id") DESC NULLS 
LAST
Full query 		3,437
1.86/sec
1.00/call
0.05%		 36,547.09 ms
19.791 ms/sec
10.633 ms/call
4.05%		 581
0.31/sec
0.17/call
0.00%		 11,559,539 blks
6.26K blks/sec
3.37K blks/call
3.71%		 17,887 blks
9.69 blks/sec
5.20 blks/call
2.54%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 851.49 ms
0.461 ms/sec
0.248 ms/call
1.13%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
5
(3182947923)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "projects" WHERE (EXISTS 
(SELECT ? FROM "project_authorizations" 
WHERE "project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?)) AND "projects"."archived" 
= ? AND (("projects"."path" ILIKE 
? OR "projects"."name" ILIKE ?) 
OR "projects"."description" ILIKE 
?) LIMIT ?) subquery_for_count
Full query 		190
0.10/sec
1.00/call
0.00%		 32,867.02 ms
17.799 ms/sec
172.984 ms/call
3.65%		 190
0.10/sec
1.00/call
0.00%		 1,581,320 blks
856.33 blks/sec
8.33K blks/call
0.51%		 6,313 blks
3.42 blks/sec
33.23 blks/call
0.90%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 233.06 ms
0.126 ms/sec
1.227 ms/call
0.31%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
6
(1187489245)		 SELECT  "projects".* FROM "projects" 
WHERE (EXISTS (SELECT ? FROM "project_authorizations" 
WHERE "project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?)) AND "projects"."archived" 
= ? AND (("projects"."path" ILIKE 
? OR "projects"."name" ILIKE ?) 
OR "projects"."description" ILIKE 
?) ORDER BY "projects"."id" DESC 
LIMIT ? OFFSET ?
Full query 		190
0.10/sec
1.00/call
0.00%		 31,711.07 ms
17.173 ms/sec
166.900 ms/call
3.52%		 47
0.03/sec
0.25/call
0.00%		 1,587,161 blks
859.50 blks/sec
8.36K blks/call
0.51%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
7
(3357552630)		 SELECT  "projects"."id" AS t0_r0,
 "projects"."name" AS t0_r1, "projects"."path" 
AS t0_r2, "projects"."description" 
AS t0_r3, "projects"."created_at" 
AS t0_r4, "projects"."updated_at" 
AS t0_r5, "projects"."creator_id" 
AS t0_r6, "projects"."namespace_id" 
AS t0_r7, "projects"."last_activity_at" 
AS t0_r8, "projects"."import_url" 
AS t0_r9, "projects"."visibility_level" 
AS t0_r10, "projects"."archived" 
AS t0_r11, "projects"."merge_requests_template" 
AS t0_r12, "projects"."star_count" 
AS t0_r13, "projects"."merge_requests_rebase_enabled" 
AS t0_r14, "projects"."import_type" 
AS t0_r15, "projects"."import_source" 
AS t0_r16, "projects"."avatar" 
AS t0_r17, "projects"."approvals_before_merge" 
AS t0_r18, "projects"."reset_approvals_on_push" 
AS t0_r19, "projects"."merge_requests_ff_only_enabled" 
AS t0_r20, "projects"."issues_template" 
AS t0_r21, "projects"."mirror" 
AS t0_r22, "projects"."mirror_user_id" 
AS t0_r23, "projects"."shared_runners_enabled" 
AS t0_r24, "projects"."runners_token" 
AS t0_r25, "...
Full query 		361,318
195.66/sec
1.00/call
5.59%		 27,080.78 ms
14.665 ms/sec
0.075 ms/call
3.00%		 351,635
190.42/sec
0.97/call
1.14%		 3,204,101 blks
1.74K blks/sec
8.87 blks/call
1.03%		 14,236 blks
7.71 blks/sec
0.04 blks/call
2.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 787.78 ms
0.427 ms/sec
0.002 ms/call
1.04%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
8
(2576098393)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= true
AND project_mirror_data.retry_count 
<= 14
AND (projects.visibility_level 
= 20 OR plans.name IN ('early_adopter',
 'bronze', 'silver', 'gold'))
AND 
project_mirror_data.status NOT 
IN ('scheduled', 'started')
AND 
project_mirror_data.next_execution_timestamp 
<= NOW()
;
Full query 		124
0.07/sec
1.00/call
0.00%		 23,363.45 ms
12.652 ms/sec
188.415 ms/call
2.59%		 124
0.07/sec
1.00/call
0.00%		 14,897,307 blks
8.07K blks/sec
120.14K blks/call
4.78%		 2 blks
0.00 blks/sec
0.02 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.04 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
9
(746170934)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW() - ?::interval
;
Full query 		124
0.07/sec
1.00/call
0.00%		 21,251.31 ms
11.508 ms/sec
171.381 ms/call
2.36%		 124
0.07/sec
1.00/call
0.00%		 14,309,329 blks
7.75K blks/sec
115.40K blks/call
4.59%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
10
(2329378283)		 SELECT  "users".* FROM "users" WHERE 
"users"."id" = ? LIMIT ?
Full query 		376,411
203.84/sec
1.00/call
5.83%		 16,480.94 ms
8.925 ms/sec
0.044 ms/call
1.83%		 376,357
203.81/sec
1.00/call
1.22%		 1,505,662 blks
815.36 blks/sec
4.00 blks/call
0.48%		 4 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.86 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
11
(1850364306)		 SELECT  "routes".* FROM "routes" 
WHERE "routes"."source_id" = ? 
AND "routes"."source_type" = ? 
LIMIT ?
Full query 		402,439
217.93/sec
1.00/call
6.23%		 13,349.88 ms
7.229 ms/sec
0.033 ms/call
1.48%		 402,439
217.93/sec
1.00/call
1.30%		 2,006,471 blks
1.09K blks/sec
4.99 blks/call
0.64%		 7,743 blks
4.19 blks/sec
0.02 blks/call
1.10%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 406.46 ms
0.220 ms/sec
0.001 ms/call
0.54%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
12
(3938502189)		 SELECT COUNT(DISTINCT "events"."id") 
FROM "events" INNER JOIN "projects" 
ON "projects"."id" = "events"."project_id" 
LEFT OUTER JOIN "project_features" 
ON "project_features"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"project_import_data" ON "project_import_data"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"namespaces" ON "namespaces"."id" 
= "projects"."namespace_id" LEFT 
OUTER JOIN "users" ON "users"."id" 
= "events"."author_id" WHERE "events"."project_id" 
= ? AND (EXISTS (SELECT ? FROM 
"project_authorizations" WHERE 
"project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?))
Full query 		1,304
0.71/sec
1.00/call
0.02%		 12,574.74 ms
6.810 ms/sec
9.643 ms/call
1.39%		 1,304
0.71/sec
1.00/call
0.00%		 2,492,997 blks
1.36K blks/sec
1.92K blks/call
0.80%		 6,181 blks
3.35 blks/sec
4.74 blks/call
0.88%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 169.89 ms
0.092 ms/sec
0.130 ms/call
0.22%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
13
(1189808325)		 SELECT  "users".* FROM "users" WHERE 
("users"."state" IN (?)) AND (ghost 
IS NOT TRUE) AND "users"."bot_type" 
IS NULL AND (("users"."name" ILIKE 
? OR "users"."username" ILIKE ?) 
OR "users"."email" = ?) ORDER BY 
CASE
  WHEN users.name = ? THEN 
?
  WHEN users.username = ? THEN 
?
  WHEN users.email = ? THEN ?
 ELSE ?
END
, "users"."name" ASC 
LIMIT ?
Full query 		170
0.09/sec
1.00/call
0.00%		 12,168.81 ms
6.590 ms/sec
71.581 ms/call
1.35%		 1,648
0.89/sec
9.69/call
0.01%		 928,607 blks
502.87 blks/sec
5.47K blks/call
0.30%		 608 blks
0.33 blks/sec
3.58 blks/call
0.09%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 6.24 ms
0.003 ms/sec
0.037 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
14
(2038040293)		 SELECT  "events"."id" AS t0_r0, 
"events"."project_id" AS t0_r1,
 "events"."author_id" AS t0_r2,
 "events"."target_id" AS t0_r3,
 "events"."created_at" AS t0_r4,
 "events"."updated_at" AS t0_r5,
 "events"."action" AS t0_r6, "events"."target_type" 
AS t0_r7, "events"."group_id" AS 
t0_r8, "users"."id" AS t1_r0, "users"."email" 
AS t1_r1, "users"."encrypted_password" 
AS t1_r2, "users"."reset_password_token" 
AS t1_r3, "users"."reset_password_sent_at" 
AS t1_r4, "users"."remember_created_at" 
AS t1_r5, "users"."sign_in_count" 
AS t1_r6, "users"."current_sign_in_at" 
AS t1_r7, "users"."last_sign_in_at" 
AS t1_r8, "users"."current_sign_in_ip" 
AS t1_r9, "users"."last_sign_in_ip" 
AS t1_r10, "users"."created_at" 
AS t1_r11, "users"."updated_at" 
AS t1_r12, "users"."name" AS t1_r13,
 "users"."admin" AS t1_r14, "users"."projects_limit" 
AS t1_r15, "users"."skype" AS t1_r16,
 "users"."linkedin" AS t1_r17, 
"users"."twitter" AS t1_r18, "users"."bio" 
AS t1_r19, "users"."failed_attempts" 
AS t1_r20, "users"."locked_at" 
...
Full query 		226
0.12/sec
1.00/call
0.00%		 12,068.04 ms
6.535 ms/sec
53.398 ms/call
1.34%		 3,032
1.64/sec
13.42/call
0.01%		 4,847,968 blks
2.63K blks/sec
21.46K blks/call
1.56%		 78,353 blks
42.43 blks/sec
346.69 blks/call
11.11%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 6,899.86 ms
3.736 ms/sec
30.530 ms/call
9.12%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
15
(2555545475)		 SELECT  "projects".* FROM "projects" 
WHERE "projects"."id" = ? LIMIT 
?
Full query 		254,288
137.70/sec
1.00/call
3.94%		 11,820.14 ms
6.401 ms/sec
0.046 ms/call
1.31%		 254,286
137.70/sec
1.00/call
0.82%		 1,102,674 blks
597.13 blks/sec
4.34 blks/call
0.35%		 11 blks
0.01 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.21 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
16
(2747454572)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= true
AND project_mirror_data.retry_count 
<= 14
AND (projects.visibility_level 
= 20 OR plans.name IN ('early_adopter',
 'bronze', 'silver', 'gold'))
AND 
project_mirror_data.status NOT 
IN ('scheduled', 'started')
AND 
(project_mirror_data.next_execution_timestamp 
- project_mirror_data.last_update_at) 
<= '30 minutes'::interval
AND project_mirror_data.last_update_at 
< NOW() - '30 minutes'::interval
;
Full query 		124
0.07/sec
1.00/call
0.00%		 11,777.78 ms
6.378 ms/sec
94.982 ms/call
1.31%		 124
0.07/sec
1.00/call
0.00%		 6,756,144 blks
3.66K blks/sec
54.49K blks/call
2.17%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
17
(3842224781)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_pipelines" WHERE 
"ci_pipelines"."project_id" = ? 
AND "ci_pipelines"."source" != 
? AND "ci_pipelines"."ref" = ? 
LIMIT ?) subquery_for_count
Full query 		15,238
8.25/sec
1.00/call
0.24%		 11,373.51 ms
6.159 ms/sec
0.746 ms/call
1.26%		 15,238
8.25/sec
1.00/call
0.05%		 1,815,207 blks
982.99 blks/sec
119.12 blks/call
0.58%		 43,798 blks
23.72 blks/sec
2.87 blks/call
6.21%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1,131.40 ms
0.613 ms/sec
0.074 ms/call
1.50%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
18
(3498832929)		 SELECT COUNT(*) FROM (WITH RECURSIVE 
"base_and_ancestors" AS ((SELECT 
"namespaces".* FROM ((SELECT "namespaces".* 
FROM "namespaces" INNER JOIN "members" 
ON "namespaces"."id" = "members"."source_id" 
WHERE "members"."type" = ? AND 
"members"."source_type" = ? AND 
"namespaces"."type" = ? AND "members"."user_id" 
= ? AND "members"."requested_at" 
IS NULL)
UNION
(SELECT namespaces.* 
FROM "projects" INNER JOIN "project_authorizations" 
ON "projects"."id" = "project_authorizations"."project_id" 
INNER JOIN "namespaces" ON "namespaces"."id" 
= "projects"."namespace_id" WHERE 
"project_authorizations"."user_id" 
= ?)) namespaces WHERE "namespaces"."type" 
= ?)
UNION
(SELECT "namespaces".* 
FROM "namespaces", "base_and_ancestors" 
WHERE "namespaces"."type" = ? AND 
"namespaces"."id" = "base_and_ancestors"."parent_id")),
 "base_and_descendants" AS ((SELECT 
"namespaces".* FROM "namespaces" 
INNER JOIN "members" ON "namespaces"."id" 
= "members"."source_id" WHERE "members"."type" 
= ? AND "members"."source_type" 
...
Full query 		223
0.12/sec
1.00/call
0.00%		 11,263.14 ms
6.099 ms/sec
50.507 ms/call
1.25%		 223
0.12/sec
1.00/call
0.00%		 7,132,996 blks
3.87K blks/sec
31.99K blks/call
2.29%		 38 blks
0.02 blks/sec
0.17 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1.09 ms
0.001 ms/sec
0.005 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
19
(1180769399)		 SELECT MAX("project_authorizations"."access_level") 
AS maximum_access_level, "project_authorizations"."user_id" 
AS project_authorizations_user_id 
FROM "project_authorizations" WHERE 
"project_authorizations"."project_id" 
= ? AND "project_authorizations"."user_id" 
= ? GROUP BY "project_authorizations"."user_id"
Full query 		322,667
174.73/sec
1.00/call
4.99%		 11,204.04 ms
6.067 ms/sec
0.035 ms/call
1.24%		 318,703
172.59/sec
0.99/call
1.03%		 1,717,667 blks
930.17 blks/sec
5.32 blks/call
0.55%		 8,981 blks
4.86 blks/sec
0.03 blks/call
1.27%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 923.73 ms
0.500 ms/sec
0.003 ms/call
1.22%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
20
(4276706237)		 SELECT  "deployments".* FROM "deployments" 
WHERE "deployments"."environment_id" 
= ? AND "deployments"."sha" = ? 
LIMIT ?
Full query 		3,505
1.90/sec
1.00/call
0.05%		 11,080.47 ms
6.000 ms/sec
3.161 ms/call
1.23%		 3,505
1.90/sec
1.00/call
0.01%		 3,055,513 blks
1.66K blks/sec
871.76 blks/call
0.98%		 7,265 blks
3.93 blks/sec
2.07 blks/call
1.03%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 264.69 ms
0.143 ms/sec
0.076 ms/call
0.35%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.103)

Start: 2020-02-18T01:55:02.7466+00:00
End: 2020-02-18T02:26:17.588+00:00
Period seconds: 1874.8414
Period age: 00:31:14.8414

Top 50 rows

#
(query id)		 Query Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1
(308654979)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		399
0.21/sec
1.00/call
0.00%		 118,424.28 ms
63.165 ms/sec
296.803 ms/call
15.16%		 2,013
1.07/sec
5.05/call
0.01%		 82,565,821 blks
44.04K blks/sec
206.94K blks/call
27.82%		 95 blks
0.05 blks/sec
0.24 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 4.79 ms
0.003 ms/sec
0.012 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2
(1272236258)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		381
0.20/sec
1.00/call
0.00%		 111,369.46 ms
59.402 ms/sec
292.308 ms/call
14.26%		 2,360
1.26/sec
6.19/call
0.01%		 78,453,589 blks
41.85K blks/sec
205.92K blks/call
26.43%		 99 blks
0.05 blks/sec
0.26 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 6.58 ms
0.004 ms/sec
0.017 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3
(2146878610)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_builds" WHERE "ci_builds"."type" 
IN (?) AND "ci_builds"."project_id" 
= ? LIMIT ?) subquery_for_count
Full query 		1,988
1.06/sec
1.00/call
0.02%		 40,429.02 ms
21.564 ms/sec
20.337 ms/call
5.18%		 1,988
1.06/sec
1.00/call
0.01%		 6,987,023 blks
3.73K blks/sec
3.52K blks/call
2.35%		 70,257 blks
37.47 blks/sec
35.34 blks/call
10.64%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 16,406.36 ms
8.751 ms/sec
8.253 ms/call
22.56%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
4
(3357552630)		 SELECT  "projects"."id" AS t0_r0,
 "projects"."name" AS t0_r1, "projects"."path" 
AS t0_r2, "projects"."description" 
AS t0_r3, "projects"."created_at" 
AS t0_r4, "projects"."updated_at" 
AS t0_r5, "projects"."creator_id" 
AS t0_r6, "projects"."namespace_id" 
AS t0_r7, "projects"."last_activity_at" 
AS t0_r8, "projects"."import_url" 
AS t0_r9, "projects"."visibility_level" 
AS t0_r10, "projects"."archived" 
AS t0_r11, "projects"."merge_requests_template" 
AS t0_r12, "projects"."star_count" 
AS t0_r13, "projects"."merge_requests_rebase_enabled" 
AS t0_r14, "projects"."import_type" 
AS t0_r15, "projects"."import_source" 
AS t0_r16, "projects"."avatar" 
AS t0_r17, "projects"."approvals_before_merge" 
AS t0_r18, "projects"."reset_approvals_on_push" 
AS t0_r19, "projects"."merge_requests_ff_only_enabled" 
AS t0_r20, "projects"."issues_template" 
AS t0_r21, "projects"."mirror" 
AS t0_r22, "projects"."mirror_user_id" 
AS t0_r23, "projects"."shared_runners_enabled" 
AS t0_r24, "projects"."runners_token" 
AS t0_r25, "...
Full query 		367,406
195.97/sec
1.00/call
3.87%		 25,966.12 ms
13.850 ms/sec
0.071 ms/call
3.32%		 357,566
190.72/sec
0.97/call
1.20%		 3,263,259 blks
1.75K blks/sec
8.88 blks/call
1.10%		 9,767 blks
5.21 blks/sec
0.03 blks/call
1.48%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 701.31 ms
0.374 ms/sec
0.002 ms/call
0.96%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
5
(1682658247)		 SELECT "environments".* FROM "environments" 
WHERE "environments"."project_id" 
= ? AND ("environments"."state" 
IN (?)) AND "environments"."id" 
IN (SELECT "deployments"."environment_id" 
FROM "deployments" WHERE "deployments"."project_id" 
= ? AND "deployments"."sha" = ? 
GROUP BY "deployments"."environment_id") 
ORDER BY (SELECT MAX("deployments"."id") 
FROM "deployments" WHERE "deployments"."environment_id" 
= "environments"."id") DESC NULLS 
LAST
Full query 		3,560
1.90/sec
1.00/call
0.04%		 25,948.13 ms
13.840 ms/sec
7.289 ms/call
3.32%		 606
0.32/sec
0.17/call
0.00%		 10,580,548 blks
5.65K blks/sec
2.98K blks/call
3.56%		 5,124 blks
2.73 blks/sec
1.44 blks/call
0.78%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 335.12 ms
0.179 ms/sec
0.094 ms/call
0.46%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
6
(2576098393)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW()
;
Full query 		125
0.07/sec
1.00/call
0.00%		 22,763.63 ms
12.142 ms/sec
182.109 ms/call
2.91%		 125
0.07/sec
1.00/call
0.00%		 15,075,461 blks
8.05K blks/sec
120.61K blks/call
5.08%		 1 blks
0.00 blks/sec
0.01 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.01 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
7
(746170934)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW() - ?::interval
;
Full query 		125
0.07/sec
1.00/call
0.00%		 20,605.84 ms
10.991 ms/sec
164.847 ms/call
2.64%		 125
0.07/sec
1.00/call
0.00%		 14,485,203 blks
7.73K blks/sec
115.89K blks/call
4.88%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
8
(3938502189)		 SELECT COUNT(DISTINCT "events"."id") 
FROM "events" INNER JOIN "projects" 
ON "projects"."id" = "events"."project_id" 
LEFT OUTER JOIN "project_features" 
ON "project_features"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"project_import_data" ON "project_import_data"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"namespaces" ON "namespaces"."id" 
= "projects"."namespace_id" LEFT 
OUTER JOIN "users" ON "users"."id" 
= "events"."author_id" WHERE "events"."project_id" 
= ? AND (EXISTS (SELECT ? FROM 
"project_authorizations" WHERE 
"project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?))
Full query 		1,364
0.73/sec
1.00/call
0.01%		 16,699.31 ms
8.907 ms/sec
12.243 ms/call
2.14%		 1,364
0.73/sec
1.00/call
0.00%		 3,970,524 blks
2.12K blks/sec
2.92K blks/call
1.34%		 21,268 blks
11.34 blks/sec
15.59 blks/call
3.22%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1,504.40 ms
0.802 ms/sec
1.103 ms/call
2.07%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
9
(2329378283)		 SELECT  "users".* FROM "users" WHERE 
"users"."id" = ? LIMIT ?
Full query 		385,115
205.41/sec
1.00/call
4.05%		 16,266.66 ms
8.676 ms/sec
0.042 ms/call
2.08%		 385,051
205.38/sec
1.00/call
1.30%		 1,540,454 blks
821.64 blks/sec
4.00 blks/call
0.52%		 1 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.03 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
10
(1189808325)		 SELECT  "users".* FROM "users" WHERE 
("users"."state" IN (?)) AND (ghost 
IS NOT TRUE) AND "users"."bot_type" 
IS NULL AND (("users"."name" ILIKE 
? OR "users"."username" ILIKE ?) 
OR "users"."email" = ?) ORDER BY 
CASE
  WHEN users.name = ? THEN 
?
  WHEN users.username = ? THEN 
?
  WHEN users.email = ? THEN ?
 ELSE ?
END
, "users"."name" ASC 
LIMIT ?
Full query 		182
0.10/sec
1.00/call
0.00%		 15,701.44 ms
8.375 ms/sec
86.272 ms/call
2.01%		 1,561
0.83/sec
8.58/call
0.01%		 1,371,721 blks
731.65 blks/sec
7.54K blks/call
0.46%		 100 blks
0.05 blks/sec
0.55 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 6.08 ms
0.003 ms/sec
0.033 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
11
(1850364306)		 SELECT  "routes".* FROM "routes" 
WHERE "routes"."source_id" = ? 
AND "routes"."source_type" = ? 
LIMIT ?
Full query 		412,936
220.25/sec
1.00/call
4.35%		 12,854.71 ms
6.856 ms/sec
0.031 ms/call
1.65%		 412,936
220.25/sec
1.00/call
1.39%		 2,061,571 blks
1.10K blks/sec
4.99 blks/call
0.69%		 4,770 blks
2.54 blks/sec
0.01 blks/call
0.72%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 355.78 ms
0.190 ms/sec
0.001 ms/call
0.49%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
12
(3842224781)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_pipelines" WHERE 
"ci_pipelines"."project_id" = ? 
AND "ci_pipelines"."source" != 
? AND "ci_pipelines"."ref" = ? 
LIMIT ?) subquery_for_count
Full query 		15,455
8.24/sec
1.00/call
0.16%		 12,051.85 ms
6.428 ms/sec
0.780 ms/call
1.54%		 15,455
8.24/sec
1.00/call
0.05%		 1,868,187 blks
996.45 blks/sec
120.88 blks/call
0.63%		 44,280 blks
23.62 blks/sec
2.87 blks/call
6.71%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 2,731.11 ms
1.457 ms/sec
0.177 ms/call
3.76%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
13
(2555545475)		 SELECT  "projects".* FROM "projects" 
WHERE "projects"."id" = ? LIMIT 
?
Full query 		259,685
138.51/sec
1.00/call
2.73%		 11,752.13 ms
6.268 ms/sec
0.045 ms/call
1.50%		 259,684
138.51/sec
1.00/call
0.87%		 1,126,176 blks
600.68 blks/sec
4.34 blks/call
0.38%		 7 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.88 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
14
(2747454572)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND (project_mirror_data.next_execution_timestamp 
- project_mirror_data.last_update_at) 
<= ?::interval
AND project_mirror_data.last_update_at 
< NOW() - ?::interval
;
Full query 		125
0.07/sec
1.00/call
0.00%		 11,504.16 ms
6.136 ms/sec
92.033 ms/call
1.47%		 125
0.07/sec
1.00/call
0.00%		 6,773,036 blks
3.62K blks/sec
54.19K blks/call
2.28%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
15
(1263248578)		 SELECT "notes".* FROM "notes" WHERE 
"notes"."type" IN (?, ?) AND "notes"."noteable_type" 
IN (?, ?) AND "notes"."system" 
= ? AND "notes"."resolved_at" IS 
NULL AND "notes"."noteable_id" 
IN (?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
 ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
 ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
 ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
 ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?)
Full query 		338
0.18/sec
1.00/call
0.00%		 11,323.22 ms
6.040 ms/sec
33.501 ms/call
1.45%		 17,027
9.08/sec
50.38/call
0.06%		 416,092 blks
221.93 blks/sec
1.24K blks/call
0.14%		 74,070 blks
39.51 blks/sec
219.14 blks/call
11.22%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 9,657.85 ms
5.151 ms/sec
28.574 ms/call
13.28%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
16
(282616091)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "users" WHERE (("users"."name" 
ILIKE ? OR "users"."username" ILIKE 
?) OR "users"."email" = ?) AND 
"users"."external" != ? LIMIT ?) 
subquery_for_count
Full query 		316
0.17/sec
1.00/call
0.00%		 11,044.37 ms
5.891 ms/sec
34.951 ms/call
1.41%		 316
0.17/sec
1.00/call
0.00%		 584,981 blks
312.02 blks/sec
1.86K blks/call
0.20%		 135 blks
0.07 blks/sec
0.43 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 13.37 ms
0.007 ms/sec
0.042 ms/call
0.02%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
17
(1180769399)		 SELECT MAX("project_authorizations"."access_level") 
AS maximum_access_level, "project_authorizations"."user_id" 
AS project_authorizations_user_id 
FROM "project_authorizations" WHERE 
"project_authorizations"."project_id" 
= ? AND "project_authorizations"."user_id" 
= ? GROUP BY "project_authorizations"."user_id"
Full query 		326,768
174.29/sec
1.00/call
3.44%		 10,702.09 ms
5.708 ms/sec
0.033 ms/call
1.37%		 322,762
172.15/sec
0.99/call
1.09%		 1,739,506 blks
927.82 blks/sec
5.32 blks/call
0.59%		 8,629 blks
4.60 blks/sec
0.03 blks/call
1.31%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 818.99 ms
0.437 ms/sec
0.003 ms/call
1.13%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
18
(2856151481)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."type" IN (?) 
AND "namespaces"."id" = ? AND "namespaces"."type" 
= ? LIMIT ?
Full query 		338,568
180.58/sec
1.00/call
3.56%		 10,598.40 ms
5.653 ms/sec
0.031 ms/call
1.36%		 278,058
148.31/sec
0.82/call
0.94%		 1,354,771 blks
722.61 blks/sec
4.00 blks/call
0.46%		 101 blks
0.05 blks/sec
0.00 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 29.69 ms
0.016 ms/sec
0.000 ms/call
0.04%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
19
(2418469088)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."id" = ? LIMIT 
?
Full query 		362,359
193.27/sec
1.00/call
3.81%		 10,385.39 ms
5.539 ms/sec
0.029 ms/call
1.33%		 362,358
193.27/sec
1.00/call
1.22%		 1,450,144 blks
773.48 blks/sec
4.00 blks/call
0.49%		 25 blks
0.01 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 3.92 ms
0.002 ms/sec
0.000 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
20
(3498832929)		 SELECT COUNT(*) FROM (WITH RECURSIVE 
"base_and_ancestors" AS ((SELECT 
"namespaces".* FROM ((SELECT "namespaces".* 
FROM "namespaces" INNER JOIN "members" 
ON "namespaces"."id" = "members"."source_id" 
WHERE "members"."type" = ? AND 
"members"."source_type" = ? AND 
"namespaces"."type" = ? AND "members"."user_id" 
= ? AND "members"."requested_at" 
IS NULL)
UNION
(SELECT namespaces.* 
FROM "projects" INNER JOIN "project_authorizations" 
ON "projects"."id" = "project_authorizations"."project_id" 
INNER JOIN "namespaces" ON "namespaces"."id" 
= "projects"."namespace_id" WHERE 
"project_authorizations"."user_id" 
= ?)) namespaces WHERE "namespaces"."type" 
= ?)
UNION
(SELECT "namespaces".* 
FROM "namespaces", "base_and_ancestors" 
WHERE "namespaces"."type" = ? AND 
"namespaces"."id" = "base_and_ancestors"."parent_id")),
 "base_and_descendants" AS ((SELECT 
"namespaces".* FROM "namespaces" 
INNER JOIN "members" ON "namespaces"."id" 
= "members"."source_id" WHERE "members"."type" 
= ? AND "members"."source_type" 
...
Full query 		234
0.12/sec
1.00/call
0.00%		 10,279.46 ms
5.483 ms/sec
43.929 ms/call
1.32%		 234
0.12/sec
1.00/call
0.00%		 6,457,995 blks
3.45K blks/sec
27.60K blks/call
2.18%		 84 blks
0.04 blks/sec
0.36 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 2.31 ms
0.001 ms/sec
0.010 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.104)

Start: 2020-02-18T01:55:03.870674+00:00
End: 2020-02-18T02:26:46.339032+00:00
Period seconds: 1902.46836
Period age: 00:31:42.468358

Top 50 rows

#
(query id)		 Query Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1
(308654979)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		401
0.21/sec
1.00/call
0.00%		 121,669.80 ms
63.954 ms/sec
303.416 ms/call
14.75%		 2,281
1.20/sec
5.69/call
0.01%		 82,885,973 blks
43.57K blks/sec
206.70K blks/call
27.02%		 103 blks
0.05 blks/sec
0.26 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 4.06 ms
0.002 ms/sec
0.010 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2
(1272236258)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		370
0.19/sec
1.00/call
0.00%		 109,309.58 ms
57.457 ms/sec
295.431 ms/call
13.25%		 2,083
1.09/sec
5.63/call
0.01%		 76,699,310 blks
40.32K blks/sec
207.30K blks/call
25.00%		 137 blks
0.07 blks/sec
0.37 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 7.10 ms
0.004 ms/sec
0.019 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3
(2146878610)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_builds" WHERE "ci_builds"."type" 
IN (?) AND "ci_builds"."project_id" 
= ? LIMIT ?) subquery_for_count
Full query 		2,025
1.06/sec
1.00/call
0.02%		 52,382.13 ms
27.534 ms/sec
25.868 ms/call
6.35%		 2,025
1.06/sec
1.00/call
0.01%		 6,831,355 blks
3.60K blks/sec
3.38K blks/call
2.23%		 73,740 blks
38.76 blks/sec
36.41 blks/call
8.96%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 26,680.68 ms
14.024 ms/sec
13.176 ms/call
31.51%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
4
(1682658247)		 SELECT "environments".* FROM "environments" 
WHERE "environments"."project_id" 
= ? AND ("environments"."state" 
IN (?)) AND "environments"."id" 
IN (SELECT "deployments"."environment_id" 
FROM "deployments" WHERE "deployments"."project_id" 
= ? AND "deployments"."sha" = ? 
GROUP BY "deployments"."environment_id") 
ORDER BY (SELECT MAX("deployments"."id") 
FROM "deployments" WHERE "deployments"."environment_id" 
= "environments"."id") DESC NULLS 
LAST
Full query 		3,755
1.97/sec
1.00/call
0.05%		 35,511.96 ms
18.666 ms/sec
9.457 ms/call
4.30%		 574
0.30/sec
0.15/call
0.00%		 13,309,836 blks
7.00K blks/sec
3.55K blks/call
4.34%		 32,054 blks
16.85 blks/sec
8.54 blks/call
3.89%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1,282.35 ms
0.674 ms/sec
0.342 ms/call
1.51%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
5
(3357552630)		 SELECT  "projects"."id" AS t0_r0,
 "projects"."name" AS t0_r1, "projects"."path" 
AS t0_r2, "projects"."description" 
AS t0_r3, "projects"."created_at" 
AS t0_r4, "projects"."updated_at" 
AS t0_r5, "projects"."creator_id" 
AS t0_r6, "projects"."namespace_id" 
AS t0_r7, "projects"."last_activity_at" 
AS t0_r8, "projects"."import_url" 
AS t0_r9, "projects"."visibility_level" 
AS t0_r10, "projects"."archived" 
AS t0_r11, "projects"."merge_requests_template" 
AS t0_r12, "projects"."star_count" 
AS t0_r13, "projects"."merge_requests_rebase_enabled" 
AS t0_r14, "projects"."import_type" 
AS t0_r15, "projects"."import_source" 
AS t0_r16, "projects"."avatar" 
AS t0_r17, "projects"."approvals_before_merge" 
AS t0_r18, "projects"."reset_approvals_on_push" 
AS t0_r19, "projects"."merge_requests_ff_only_enabled" 
AS t0_r20, "projects"."issues_template" 
AS t0_r21, "projects"."mirror" 
AS t0_r22, "projects"."mirror_user_id" 
AS t0_r23, "projects"."shared_runners_enabled" 
AS t0_r24, "projects"."runners_token" 
AS t0_r25, "...
Full query 		372,730
195.92/sec
1.00/call
4.49%		 27,010.41 ms
14.198 ms/sec
0.072 ms/call
3.27%		 362,654
190.62/sec
0.97/call
1.17%		 3,309,266 blks
1.74K blks/sec
8.88 blks/call
1.08%		 10,895 blks
5.73 blks/sec
0.03 blks/call
1.32%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 643.57 ms
0.338 ms/sec
0.002 ms/call
0.76%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
6
(2576098393)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW()
;
Full query 		127
0.07/sec
1.00/call
0.00%		 23,344.32 ms
12.271 ms/sec
183.814 ms/call
2.83%		 127
0.07/sec
1.00/call
0.00%		 15,260,414 blks
8.03K blks/sec
120.17K blks/call
4.97%		 1 blks
0.00 blks/sec
0.01 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.02 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
7
(746170934)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW() - ?::interval
;
Full query 		127
0.07/sec
1.00/call
0.00%		 21,570.78 ms
11.338 ms/sec
169.849 ms/call
2.61%		 127
0.07/sec
1.00/call
0.00%		 14,662,736 blks
7.71K blks/sec
115.46K blks/call
4.78%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
8
(2329378283)		 SELECT  "users".* FROM "users" WHERE 
"users"."id" = ? LIMIT ?
Full query 		389,058
204.50/sec
1.00/call
4.69%		 16,810.60 ms
8.836 ms/sec
0.043 ms/call
2.04%		 389,000
204.47/sec
1.00/call
1.26%		 1,556,225 blks
818.00 blks/sec
4.00 blks/call
0.51%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
9
(2038040293)		 SELECT  "events"."id" AS t0_r0, 
"events"."project_id" AS t0_r1,
 "events"."author_id" AS t0_r2,
 "events"."target_id" AS t0_r3,
 "events"."created_at" AS t0_r4,
 "events"."updated_at" AS t0_r5,
 "events"."action" AS t0_r6, "events"."target_type" 
AS t0_r7, "events"."group_id" AS 
t0_r8, "users"."id" AS t1_r0, "users"."email" 
AS t1_r1, "users"."encrypted_password" 
AS t1_r2, "users"."reset_password_token" 
AS t1_r3, "users"."reset_password_sent_at" 
AS t1_r4, "users"."remember_created_at" 
AS t1_r5, "users"."sign_in_count" 
AS t1_r6, "users"."current_sign_in_at" 
AS t1_r7, "users"."last_sign_in_at" 
AS t1_r8, "users"."current_sign_in_ip" 
AS t1_r9, "users"."last_sign_in_ip" 
AS t1_r10, "users"."created_at" 
AS t1_r11, "users"."updated_at" 
AS t1_r12, "users"."name" AS t1_r13,
 "users"."admin" AS t1_r14, "users"."projects_limit" 
AS t1_r15, "users"."skype" AS t1_r16,
 "users"."linkedin" AS t1_r17, 
"users"."twitter" AS t1_r18, "users"."bio" 
AS t1_r19, "users"."failed_attempts" 
AS t1_r20, "users"."locked_at" 
...
Full query 		210
0.11/sec
1.00/call
0.00%		 13,300.80 ms
6.991 ms/sec
63.337 ms/call
1.61%		 3,150
1.66/sec
15.00/call
0.01%		 8,441,270 blks
4.44K blks/sec
40.20K blks/call
2.75%		 75,945 blks
39.92 blks/sec
361.64 blks/call
9.23%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 5,384.36 ms
2.830 ms/sec
25.640 ms/call
6.36%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
10
(1850364306)		 SELECT  "routes".* FROM "routes" 
WHERE "routes"."source_id" = ? 
AND "routes"."source_type" = ? 
LIMIT ?
Full query 		410,672
215.86/sec
1.00/call
4.95%		 13,142.51 ms
6.908 ms/sec
0.032 ms/call
1.59%		 410,672
215.86/sec
1.00/call
1.33%		 2,049,763 blks
1.08K blks/sec
4.99 blks/call
0.67%		 5,370 blks
2.82 blks/sec
0.01 blks/call
0.65%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 259.59 ms
0.136 ms/sec
0.001 ms/call
0.31%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
11
(2747454572)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND (project_mirror_data.next_execution_timestamp 
- project_mirror_data.last_update_at) 
<= ?::interval
AND project_mirror_data.last_update_at 
< NOW() - ?::interval
;
Full query 		127
0.07/sec
1.00/call
0.00%		 12,157.04 ms
6.390 ms/sec
95.725 ms/call
1.47%		 127
0.07/sec
1.00/call
0.00%		 6,919,765 blks
3.64K blks/sec
54.49K blks/call
2.26%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
12
(2555545475)		 SELECT  "projects".* FROM "projects" 
WHERE "projects"."id" = ? LIMIT 
?
Full query 		260,180
136.76/sec
1.00/call
3.13%		 12,124.26 ms
6.373 ms/sec
0.047 ms/call
1.47%		 260,177
136.76/sec
1.00/call
0.84%		 1,131,253 blks
594.62 blks/sec
4.35 blks/call
0.37%		 10 blks
0.01 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.21 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
13
(3938502189)		 SELECT COUNT(DISTINCT "events"."id") 
FROM "events" INNER JOIN "projects" 
ON "projects"."id" = "events"."project_id" 
LEFT OUTER JOIN "project_features" 
ON "project_features"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"project_import_data" ON "project_import_data"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"namespaces" ON "namespaces"."id" 
= "projects"."namespace_id" LEFT 
OUTER JOIN "users" ON "users"."id" 
= "events"."author_id" WHERE "events"."project_id" 
= ? AND (EXISTS (SELECT ? FROM 
"project_authorizations" WHERE 
"project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?))
Full query 		1,373
0.72/sec
1.00/call
0.02%		 11,624.47 ms
6.110 ms/sec
8.466 ms/call
1.41%		 1,373
0.72/sec
1.00/call
0.00%		 2,967,227 blks
1.56K blks/sec
2.17K blks/call
0.97%		 11,117 blks
5.84 blks/sec
8.10 blks/call
1.35%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 536.41 ms
0.282 ms/sec
0.391 ms/call
0.63%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
14
(1180769399)		 SELECT MAX("project_authorizations"."access_level") 
AS maximum_access_level, "project_authorizations"."user_id" 
AS project_authorizations_user_id 
FROM "project_authorizations" WHERE 
"project_authorizations"."project_id" 
= ? AND "project_authorizations"."user_id" 
= ? GROUP BY "project_authorizations"."user_id"
Full query 		334,097
175.61/sec
1.00/call
4.02%		 11,318.18 ms
5.949 ms/sec
0.034 ms/call
1.37%		 329,940
173.43/sec
0.99/call
1.07%		 1,778,573 blks
934.88 blks/sec
5.32 blks/call
0.58%		 9,366 blks
4.92 blks/sec
0.03 blks/call
1.14%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 969.79 ms
0.510 ms/sec
0.003 ms/call
1.15%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
15
(1189808325)		 SELECT  "users".* FROM "users" WHERE 
("users"."state" IN (?)) AND (ghost 
IS NOT TRUE) AND "users"."bot_type" 
IS NULL AND (("users"."name" ILIKE 
? OR "users"."username" ILIKE ?) 
OR "users"."email" = ?) ORDER BY 
CASE
  WHEN users.name = ? THEN 
?
  WHEN users.username = ? THEN 
?
  WHEN users.email = ? THEN ?
 ELSE ?
END
, "users"."name" ASC 
LIMIT ?
Full query 		183
0.10/sec
1.00/call
0.00%		 11,159.62 ms
5.866 ms/sec
60.982 ms/call
1.35%		 1,817
0.96/sec
9.93/call
0.01%		 960,064 blks
504.64 blks/sec
5.25K blks/call
0.31%		 83 blks
0.04 blks/sec
0.45 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1.35 ms
0.001 ms/sec
0.007 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
16
(2856151481)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."type" IN (?) 
AND "namespaces"."id" = ? AND "namespaces"."type" 
= ? LIMIT ?
Full query 		344,882
181.28/sec
1.00/call
4.15%		 11,104.10 ms
5.837 ms/sec
0.032 ms/call
1.35%		 283,631
149.09/sec
0.82/call
0.92%		 1,380,106 blks
725.43 blks/sec
4.00 blks/call
0.45%		 61 blks
0.03 blks/sec
0.00 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 9.55 ms
0.005 ms/sec
0.000 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
17
(2418469088)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."id" = ? LIMIT 
?
Full query 		366,029
192.40/sec
1.00/call
4.41%		 10,823.26 ms
5.689 ms/sec
0.030 ms/call
1.31%		 366,029
192.40/sec
1.00/call
1.18%		 1,464,825 blks
769.96 blks/sec
4.00 blks/call
0.48%		 20 blks
0.01 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 2.63 ms
0.001 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
18
(1263248578)		 SELECT "notes".* FROM "notes" WHERE 
"notes"."type" IN (?, ?) AND "notes"."noteable_type" 
IN (?, ?) AND "notes"."system" 
= ? AND "notes"."resolved_at" IS 
NULL AND "notes"."noteable_id" 
IN (?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
 ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
 ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
 ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
 ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?)
Full query 		314
0.17/sec
1.00/call
0.00%		 10,653.73 ms
5.600 ms/sec
33.929 ms/call
1.29%		 13,304
6.99/sec
42.37/call
0.04%		 374,783 blks
197.00 blks/sec
1.20K blks/call
0.12%		 66,785 blks
35.10 blks/sec
212.69 blks/call
8.11%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 9,173.83 ms
4.822 ms/sec
29.216 ms/call
10.83%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
19
(3842224781)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_pipelines" WHERE 
"ci_pipelines"."project_id" = ? 
AND "ci_pipelines"."source" != 
? AND "ci_pipelines"."ref" = ? 
LIMIT ?) subquery_for_count
Full query 		15,691
8.25/sec
1.00/call
0.19%		 10,554.94 ms
5.548 ms/sec
0.673 ms/call
1.28%		 15,691
8.25/sec
1.00/call
0.05%		 1,791,936 blks
941.90 blks/sec
114.20 blks/call
0.58%		 45,872 blks
24.11 blks/sec
2.92 blks/call
5.57%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1,489.97 ms
0.783 ms/sec
0.095 ms/call
1.76%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
20
(282616091)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "users" WHERE (("users"."name" 
ILIKE ? OR "users"."username" ILIKE 
?) OR "users"."email" = ?) AND 
"users"."external" != ? LIMIT ?) 
subquery_for_count
Full query 		311
0.16/sec
1.00/call
0.00%		 10,488.75 ms
5.513 ms/sec
33.726 ms/call
1.27%		 311
0.16/sec
1.00/call
0.00%		 583,001 blks
306.44 blks/sec
1.88K blks/call
0.19%		 166 blks
0.09 blks/sec
0.53 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 5.50 ms
0.003 ms/sec
0.018 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.105)

Start: 2020-02-18T01:55:05.051858+00:00
End: 2020-02-18T02:27:16.207053+00:00
Period seconds: 1931.15519
Period age: 00:32:11.155195

Top 50 rows

#
(query id)		 Query Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1
(308654979)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		438
0.23/sec
1.00/call
0.00%		 126,687.52 ms
65.602 ms/sec
289.241 ms/call
14.99%		 3,033
1.57/sec
6.92/call
0.01%		 90,629,196 blks
46.94K blks/sec
206.92K blks/call
28.79%		 134 blks
0.07 blks/sec
0.31 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 8.35 ms
0.004 ms/sec
0.019 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2
(1272236258)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		394
0.20/sec
1.00/call
0.00%		 119,271.71 ms
61.762 ms/sec
302.720 ms/call
14.11%		 2,471
1.28/sec
6.27/call
0.01%		 81,900,103 blks
42.41K blks/sec
207.87K blks/call
26.02%		 94 blks
0.05 blks/sec
0.24 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 4.95 ms
0.003 ms/sec
0.013 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3
(2146878610)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_builds" WHERE "ci_builds"."type" 
IN (?) AND "ci_builds"."project_id" 
= ? LIMIT ?) subquery_for_count
Full query 		2,184
1.13/sec
1.00/call
0.02%		 57,355.34 ms
29.700 ms/sec
26.262 ms/call
6.78%		 2,184
1.13/sec
1.00/call
0.01%		 7,633,168 blks
3.96K blks/sec
3.50K blks/call
2.42%		 69,391 blks
35.93 blks/sec
31.77 blks/call
9.16%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 28,589.51 ms
14.804 ms/sec
13.090 ms/call
31.43%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
4
(1682658247)		 SELECT "environments".* FROM "environments" 
WHERE "environments"."project_id" 
= ? AND ("environments"."state" 
IN (?)) AND "environments"."id" 
IN (SELECT "deployments"."environment_id" 
FROM "deployments" WHERE "deployments"."project_id" 
= ? AND "deployments"."sha" = ? 
GROUP BY "deployments"."environment_id") 
ORDER BY (SELECT MAX("deployments"."id") 
FROM "deployments" WHERE "deployments"."environment_id" 
= "environments"."id") DESC NULLS 
LAST
Full query 		3,653
1.89/sec
1.00/call
0.04%		 27,346.44 ms
14.161 ms/sec
7.486 ms/call
3.23%		 637
0.33/sec
0.17/call
0.00%		 10,884,665 blks
5.64K blks/sec
2.98K blks/call
3.46%		 10,325 blks
5.35 blks/sec
2.83 blks/call
1.36%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 741.92 ms
0.384 ms/sec
0.203 ms/call
0.82%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
5
(3357552630)		 SELECT  "projects"."id" AS t0_r0,
 "projects"."name" AS t0_r1, "projects"."path" 
AS t0_r2, "projects"."description" 
AS t0_r3, "projects"."created_at" 
AS t0_r4, "projects"."updated_at" 
AS t0_r5, "projects"."creator_id" 
AS t0_r6, "projects"."namespace_id" 
AS t0_r7, "projects"."last_activity_at" 
AS t0_r8, "projects"."import_url" 
AS t0_r9, "projects"."visibility_level" 
AS t0_r10, "projects"."archived" 
AS t0_r11, "projects"."merge_requests_template" 
AS t0_r12, "projects"."star_count" 
AS t0_r13, "projects"."merge_requests_rebase_enabled" 
AS t0_r14, "projects"."import_type" 
AS t0_r15, "projects"."import_source" 
AS t0_r16, "projects"."avatar" 
AS t0_r17, "projects"."approvals_before_merge" 
AS t0_r18, "projects"."reset_approvals_on_push" 
AS t0_r19, "projects"."merge_requests_ff_only_enabled" 
AS t0_r20, "projects"."issues_template" 
AS t0_r21, "projects"."mirror" 
AS t0_r22, "projects"."mirror_user_id" 
AS t0_r23, "projects"."shared_runners_enabled" 
AS t0_r24, "projects"."runners_token" 
AS t0_r25, "...
Full query 		378,510
196.00/sec
1.00/call
4.08%		 27,056.31 ms
14.010 ms/sec
0.071 ms/call
3.20%		 368,521
190.83/sec
0.97/call
1.19%		 3,363,766 blks
1.75K blks/sec
8.89 blks/call
1.07%		 9,316 blks
4.82 blks/sec
0.02 blks/call
1.23%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 795.40 ms
0.412 ms/sec
0.002 ms/call
0.87%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
6
(1189808325)		 SELECT  "users".* FROM "users" WHERE 
("users"."state" IN (?)) AND (ghost 
IS NOT TRUE) AND "users"."bot_type" 
IS NULL AND (("users"."name" ILIKE 
? OR "users"."username" ILIKE ?) 
OR "users"."email" = ?) ORDER BY 
CASE
  WHEN users.name = ? THEN 
?
  WHEN users.username = ? THEN 
?
  WHEN users.email = ? THEN ?
 ELSE ?
END
, "users"."name" ASC 
LIMIT ?
Full query 		168
0.09/sec
1.00/call
0.00%		 25,772.96 ms
13.346 ms/sec
153.411 ms/call
3.05%		 1,452
0.75/sec
8.64/call
0.00%		 2,488,411 blks
1.29K blks/sec
14.82K blks/call
0.79%		 76,128 blks
39.42 blks/sec
453.14 blks/call
10.05%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 569.99 ms
0.295 ms/sec
3.393 ms/call
0.63%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
7
(2576098393)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW()
;
Full query 		128
0.07/sec
1.00/call
0.00%		 23,383.66 ms
12.109 ms/sec
182.685 ms/call
2.77%		 128
0.07/sec
1.00/call
0.00%		 15,351,124 blks
7.95K blks/sec
119.94K blks/call
4.88%		 3 blks
0.00 blks/sec
0.02 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.06 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
8
(746170934)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW() - ?::interval
;
Full query 		128
0.07/sec
1.00/call
0.00%		 21,235.62 ms
10.996 ms/sec
165.903 ms/call
2.51%		 128
0.07/sec
1.00/call
0.00%		 14,761,102 blks
7.65K blks/sec
115.33K blks/call
4.69%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
9
(2329378283)		 SELECT  "users".* FROM "users" WHERE 
"users"."id" = ? LIMIT ?
Full query 		398,209
206.20/sec
1.00/call
4.30%		 16,974.84 ms
8.790 ms/sec
0.043 ms/call
2.01%		 398,152
206.17/sec
1.00/call
1.28%		 1,592,847 blks
824.82 blks/sec
4.00 blks/call
0.51%		 4 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.07 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
10
(3938502189)		 SELECT COUNT(DISTINCT "events"."id") 
FROM "events" INNER JOIN "projects" 
ON "projects"."id" = "events"."project_id" 
LEFT OUTER JOIN "project_features" 
ON "project_features"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"project_import_data" ON "project_import_data"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"namespaces" ON "namespaces"."id" 
= "projects"."namespace_id" LEFT 
OUTER JOIN "users" ON "users"."id" 
= "events"."author_id" WHERE "events"."project_id" 
= ? AND (EXISTS (SELECT ? FROM 
"project_authorizations" WHERE 
"project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?))
Full query 		1,444
0.75/sec
1.00/call
0.02%		 14,184.80 ms
7.345 ms/sec
9.823 ms/call
1.68%		 1,444
0.75/sec
1.00/call
0.00%		 2,775,522 blks
1.44K blks/sec
1.93K blks/call
0.88%		 38,976 blks
20.18 blks/sec
26.99 blks/call
5.15%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 4,257.70 ms
2.205 ms/sec
2.949 ms/call
4.68%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
11
(1850364306)		 SELECT  "routes".* FROM "routes" 
WHERE "routes"."source_id" = 3503181 
AND "routes"."source_type" = 'Project' 
LIMIT 1
Full query 		433,161
224.30/sec
1.00/call
4.67%		 13,534.33 ms
7.008 ms/sec
0.031 ms/call
1.60%		 433,161
224.30/sec
1.00/call
1.40%		 2,163,042 blks
1.13K blks/sec
4.99 blks/call
0.69%		 4,562 blks
2.36 blks/sec
0.01 blks/call
0.60%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 297.50 ms
0.154 ms/sec
0.001 ms/call
0.33%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
12
(2555545475)		 SELECT  "projects".* FROM "projects" 
WHERE "projects"."id" = ? LIMIT 
?
Full query 		271,437
140.56/sec
1.00/call
2.93%		 12,402.82 ms
6.422 ms/sec
0.046 ms/call
1.47%		 271,434
140.56/sec
1.00/call
0.87%		 1,176,578 blks
609.26 blks/sec
4.33 blks/call
0.37%		 7 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.16 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
13
(3842224781)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_pipelines" WHERE 
"ci_pipelines"."project_id" = ? 
AND "ci_pipelines"."source" != 
? AND "ci_pipelines"."ref" = ? 
LIMIT ?) subquery_for_count
Full query 		15,950
8.26/sec
1.00/call
0.17%		 12,062.70 ms
6.246 ms/sec
0.756 ms/call
1.43%		 15,950
8.26/sec
1.00/call
0.05%		 1,971,655 blks
1.03K blks/sec
123.61 blks/call
0.63%		 39,753 blks
20.59 blks/sec
2.49 blks/call
5.25%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1,916.95 ms
0.993 ms/sec
0.120 ms/call
2.11%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
14
(2747454572)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND (project_mirror_data.next_execution_timestamp 
- project_mirror_data.last_update_at) 
<= ?::interval
AND project_mirror_data.last_update_at 
< NOW() - ?::interval
;
Full query 		128
0.07/sec
1.00/call
0.00%		 11,950.44 ms
6.188 ms/sec
93.363 ms/call
1.41%		 128
0.07/sec
1.00/call
0.00%		 6,961,293 blks
3.61K blks/sec
54.39K blks/call
2.21%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
15
(1263248578)		 SELECT "notes".* FROM "notes" WHERE 
"notes"."type" IN (?, ?) AND "notes"."noteable_type" 
IN (?, ?) AND "notes"."system" 
= ? AND "notes"."resolved_at" IS 
NULL AND "notes"."noteable_id" 
IN (?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
 ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
 ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
 ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
 ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, 
?, ?, ?, ?, ?, ?, ?)
Full query 		321
0.17/sec
1.00/call
0.00%		 11,606.41 ms
6.010 ms/sec
36.157 ms/call
1.37%		 12,745
6.60/sec
39.70/call
0.04%		 387,849 blks
200.84 blks/sec
1.21K blks/call
0.12%		 63,936 blks
33.11 blks/sec
199.18 blks/call
8.44%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 10,101.77 ms
5.231 ms/sec
31.470 ms/call
11.11%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
16
(1180769399)		 SELECT MAX("project_authorizations"."access_level") 
AS maximum_access_level, "project_authorizations"."user_id" 
AS project_authorizations_user_id 
FROM "project_authorizations" WHERE 
"project_authorizations"."project_id" 
= ? AND "project_authorizations"."user_id" 
= ? GROUP BY "project_authorizations"."user_id"
Full query 		340,152
176.14/sec
1.00/call
3.67%		 11,455.71 ms
5.932 ms/sec
0.034 ms/call
1.36%		 336,109
174.05/sec
0.99/call
1.08%		 1,811,400 blks
937.99 blks/sec
5.33 blks/call
0.58%		 8,914 blks
4.62 blks/sec
0.03 blks/call
1.18%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1,149.57 ms
0.595 ms/sec
0.003 ms/call
1.26%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
17
(2038040293)		 SELECT  "events"."id" AS t0_r0, 
"events"."project_id" AS t0_r1,
 "events"."author_id" AS t0_r2,
 "events"."target_id" AS t0_r3,
 "events"."created_at" AS t0_r4,
 "events"."updated_at" AS t0_r5,
 "events"."action" AS t0_r6, "events"."target_type" 
AS t0_r7, "events"."group_id" AS 
t0_r8, "users"."id" AS t1_r0, "users"."email" 
AS t1_r1, "users"."encrypted_password" 
AS t1_r2, "users"."reset_password_token" 
AS t1_r3, "users"."reset_password_sent_at" 
AS t1_r4, "users"."remember_created_at" 
AS t1_r5, "users"."sign_in_count" 
AS t1_r6, "users"."current_sign_in_at" 
AS t1_r7, "users"."last_sign_in_at" 
AS t1_r8, "users"."current_sign_in_ip" 
AS t1_r9, "users"."last_sign_in_ip" 
AS t1_r10, "users"."created_at" 
AS t1_r11, "users"."updated_at" 
AS t1_r12, "users"."name" AS t1_r13,
 "users"."admin" AS t1_r14, "users"."projects_limit" 
AS t1_r15, "users"."skype" AS t1_r16,
 "users"."linkedin" AS t1_r17, 
"users"."twitter" AS t1_r18, "users"."bio" 
AS t1_r19, "users"."failed_attempts" 
AS t1_r20, "users"."locked_at" 
...
Full query 		242
0.13/sec
1.00/call
0.00%		 11,279.70 ms
5.841 ms/sec
46.610 ms/call
1.33%		 3,459
1.79/sec
14.29/call
0.01%		 6,999,932 blks
3.63K blks/sec
28.93K blks/call
2.22%		 46,085 blks
23.86 blks/sec
190.43 blks/call
6.09%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 4,757.16 ms
2.463 ms/sec
19.658 ms/call
5.23%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
18
(282616091)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "users" WHERE (("users"."name" 
ILIKE ? OR "users"."username" ILIKE 
?) OR "users"."email" = ?) AND 
"users"."external" != ? LIMIT ?) 
subquery_for_count
Full query 		320
0.17/sec
1.00/call
0.00%		 11,212.81 ms
5.806 ms/sec
35.040 ms/call
1.33%		 320
0.17/sec
1.00/call
0.00%		 610,594 blks
316.18 blks/sec
1.91K blks/call
0.19%		 151 blks
0.08 blks/sec
0.47 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 12.05 ms
0.006 ms/sec
0.038 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
19
(2856151481)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."type" IN (?) 
AND "namespaces"."id" = ? AND "namespaces"."type" 
= ? LIMIT ?
Full query 		348,430
180.43/sec
1.00/call
3.76%		 11,045.58 ms
5.720 ms/sec
0.032 ms/call
1.31%		 286,549
148.38/sec
0.82/call
0.92%		 1,394,290 blks
722.00 blks/sec
4.00 blks/call
0.44%		 68 blks
0.04 blks/sec
0.00 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 13.85 ms
0.007 ms/sec
0.000 ms/call
0.02%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
20
(2418469088)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."id" = ? LIMIT 
?
Full query 		379,119
196.32/sec
1.00/call
4.09%		 11,002.86 ms
5.698 ms/sec
0.029 ms/call
1.30%		 379,118
196.32/sec
1.00/call
1.22%		 1,517,022 blks
785.55 blks/sec
4.00 blks/call
0.48%		 13 blks
0.01 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 2.64 ms
0.001 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.107)

Start: 2020-02-18T01:55:07.473459+00:00
End: 2020-02-18T02:28:33.945751+00:00
Period seconds: 2006.47229
Period age: 00:33:26.472292

Top 50 rows

#
(query id)		 Query Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1
(1272236258)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		439
0.22/sec
1.00/call
0.01%		 121,658.70 ms
60.633 ms/sec
277.127 ms/call
13.83%		 2,011
1.00/sec
4.58/call
0.01%		 90,893,318 blks
45.31K blks/sec
207.05K blks/call
27.39%		 131 blks
0.07 blks/sec
0.30 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 8.43 ms
0.004 ms/sec
0.019 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2
(308654979)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= 'Ci::Build' AND ("ci_builds"."status" 
IN ('running')) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= 1) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = 'Ci::Build' 
AND ("ci_builds"."status" IN ('pending')) 
AND "ci_builds"."runner_id" IS 
NULL AND "projects"."shared_runners_enabled" 
= TRUE AND "projects"."pending_delete" 
= FALSE AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> 0) AND (projects.visibility_level=20 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (na...
Full query 		419
0.21/sec
1.00/call
0.01%		 114,551.00 ms
57.091 ms/sec
273.391 ms/call
13.02%		 2,025
1.01/sec
4.83/call
0.01%		 86,792,979 blks
43.26K blks/sec
207.15K blks/call
26.16%		 117 blks
0.06 blks/sec
0.28 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1.88 ms
0.001 ms/sec
0.004 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3
(2146878610)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_builds" WHERE "ci_builds"."type" 
IN (?) AND "ci_builds"."project_id" 
= ? LIMIT ?) subquery_for_count
Full query 		2,268
1.13/sec
1.00/call
0.03%		 63,802.45 ms
31.798 ms/sec
28.132 ms/call
7.25%		 2,268
1.13/sec
1.00/call
0.01%		 7,994,730 blks
3.99K blks/sec
3.53K blks/call
2.41%		 84,078 blks
41.90 blks/sec
37.07 blks/call
10.86%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 32,783.50 ms
16.339 ms/sec
14.455 ms/call
43.63%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
4
(1682658247)		 SELECT "environments".* FROM "environments" 
WHERE "environments"."project_id" 
= ? AND ("environments"."state" 
IN (?)) AND "environments"."id" 
IN (SELECT "deployments"."environment_id" 
FROM "deployments" WHERE "deployments"."project_id" 
= ? AND "deployments"."sha" = ? 
GROUP BY "deployments"."environment_id") 
ORDER BY (SELECT MAX("deployments"."id") 
FROM "deployments" WHERE "deployments"."environment_id" 
= "environments"."id") DESC NULLS 
LAST
Full query 		3,855
1.92/sec
1.00/call
0.05%		 31,774.76 ms
15.836 ms/sec
8.242 ms/call
3.61%		 592
0.30/sec
0.15/call
0.00%		 11,697,926 blks
5.84K blks/sec
3.04K blks/call
3.53%		 20,614 blks
10.27 blks/sec
5.35 blks/call
2.66%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 491.49 ms
0.245 ms/sec
0.127 ms/call
0.65%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
5
(3357552630)		 SELECT  "projects"."id" AS t0_r0,
 "projects"."name" AS t0_r1, "projects"."path" 
AS t0_r2, "projects"."description" 
AS t0_r3, "projects"."created_at" 
AS t0_r4, "projects"."updated_at" 
AS t0_r5, "projects"."creator_id" 
AS t0_r6, "projects"."namespace_id" 
AS t0_r7, "projects"."last_activity_at" 
AS t0_r8, "projects"."import_url" 
AS t0_r9, "projects"."visibility_level" 
AS t0_r10, "projects"."archived" 
AS t0_r11, "projects"."merge_requests_template" 
AS t0_r12, "projects"."star_count" 
AS t0_r13, "projects"."merge_requests_rebase_enabled" 
AS t0_r14, "projects"."import_type" 
AS t0_r15, "projects"."import_source" 
AS t0_r16, "projects"."avatar" 
AS t0_r17, "projects"."approvals_before_merge" 
AS t0_r18, "projects"."reset_approvals_on_push" 
AS t0_r19, "projects"."merge_requests_ff_only_enabled" 
AS t0_r20, "projects"."issues_template" 
AS t0_r21, "projects"."mirror" 
AS t0_r22, "projects"."mirror_user_id" 
AS t0_r23, "projects"."shared_runners_enabled" 
AS t0_r24, "projects"."runners_token" 
AS t0_r25, "...
Full query 		392,438
195.59/sec
1.00/call
5.53%		 26,281.54 ms
13.098 ms/sec
0.067 ms/call
2.99%		 382,172
190.47/sec
0.97/call
1.14%		 3,489,154 blks
1.74K blks/sec
8.89 blks/call
1.05%		 8,194 blks
4.08 blks/sec
0.02 blks/call
1.06%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 405.95 ms
0.202 ms/sec
0.001 ms/call
0.54%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
6
(3182947923)		 SELECT COUNT(*) FROM (SELECT ? AS 
one FROM "projects" WHERE (EXISTS 
(SELECT ? FROM "project_authorizations" 
WHERE "project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?)) AND "projects"."archived" 
= ? AND (("projects"."path" ILIKE 
? OR "projects"."name" ILIKE ?) 
OR "projects"."description" ILIKE 
?) LIMIT ?) subquery_for_count
Full query 		180
0.09/sec
1.00/call
0.00%		 24,847.29 ms
12.384 ms/sec
138.041 ms/call
2.82%		 180
0.09/sec
1.00/call
0.00%		 1,329,531 blks
662.62 blks/sec
7.39K blks/call
0.40%		 5,575 blks
2.78 blks/sec
30.97 blks/call
0.72%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 297.72 ms
0.148 ms/sec
1.654 ms/call
0.40%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
7
(1187489245)		 SELECT  "projects".* FROM "projects" 
WHERE (EXISTS (SELECT ? FROM "project_authorizations" 
WHERE "project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?)) AND "projects"."archived" 
= ? AND (("projects"."path" ILIKE 
? OR "projects"."name" ILIKE ?) 
OR "projects"."description" ILIKE 
?) ORDER BY "projects"."id" DESC 
LIMIT ? OFFSET ?
Full query 		179
0.09/sec
1.00/call
0.00%		 23,923.79 ms
11.923 ms/sec
133.652 ms/call
2.72%		 10
0.00/sec
0.06/call
0.00%		 1,332,480 blks
664.09 blks/sec
7.45K blks/call
0.40%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
8
(2576098393)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= true
AND project_mirror_data.retry_count 
<= 14
AND (projects.visibility_level 
= 20 OR plans.name IN ('early_adopter',
 'bronze', 'silver', 'gold'))
AND 
project_mirror_data.status NOT 
IN ('scheduled', 'started')
AND 
project_mirror_data.next_execution_timestamp 
<= NOW()
;
Full query 		134
0.07/sec
1.00/call
0.00%		 23,435.57 ms
11.680 ms/sec
174.892 ms/call
2.66%		 134
0.07/sec
1.00/call
0.00%		 16,007,309 blks
7.98K blks/sec
119.46K blks/call
4.82%		 1 blks
0.00 blks/sec
0.01 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.02 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
9
(746170934)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW() - ?::interval
;
Full query 		134
0.07/sec
1.00/call
0.00%		 21,458.49 ms
10.695 ms/sec
160.138 ms/call
2.44%		 134
0.07/sec
1.00/call
0.00%		 15,387,811 blks
7.67K blks/sec
114.84K blks/call
4.64%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
10
(3938502189)		 SELECT COUNT(DISTINCT "events"."id") 
FROM "events" INNER JOIN "projects" 
ON "projects"."id" = "events"."project_id" 
LEFT OUTER JOIN "project_features" 
ON "project_features"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"project_import_data" ON "project_import_data"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"namespaces" ON "namespaces"."id" 
= "projects"."namespace_id" LEFT 
OUTER JOIN "users" ON "users"."id" 
= "events"."author_id" WHERE "events"."project_id" 
= ? AND (EXISTS (SELECT ? FROM 
"project_authorizations" WHERE 
"project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?))
Full query 		1,449
0.72/sec
1.00/call
0.02%		 17,543.19 ms
8.743 ms/sec
12.107 ms/call
1.99%		 1,449
0.72/sec
1.00/call
0.00%		 4,482,994 blks
2.24K blks/sec
3.10K blks/call
1.35%		 21,484 blks
10.71 blks/sec
14.83 blks/call
2.78%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 513.25 ms
0.256 ms/sec
0.354 ms/call
0.68%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
11
(2329378283)		 SELECT  "users".* FROM "users" WHERE 
"users"."id" = ? LIMIT ?
Full query 		410,890
204.78/sec
1.00/call
5.79%		 16,664.24 ms
8.305 ms/sec
0.041 ms/call
1.89%		 410,822
204.75/sec
1.00/call
1.23%		 1,643,559 blks
819.13 blks/sec
4.00 blks/call
0.50%		 9 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.16 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
12
(1850364306)		 SELECT  "routes".* FROM "routes" 
WHERE "routes"."source_id" = ? 
AND "routes"."source_type" = ? 
LIMIT ?
Full query 		443,559
221.06/sec
1.00/call
6.25%		 12,727.36 ms
6.343 ms/sec
0.029 ms/call
1.45%		 443,559
221.06/sec
1.00/call
1.32%		 2,215,487 blks
1.11K blks/sec
4.99 blks/call
0.67%		 4,101 blks
2.04 blks/sec
0.01 blks/call
0.53%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 101.30 ms
0.050 ms/sec
0.000 ms/call
0.13%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
13
(2555545475)		 SELECT  "projects".* FROM "projects" 
WHERE "projects"."id" = ? LIMIT 
?
Full query 		279,848
139.47/sec
1.00/call
3.94%		 12,094.87 ms
6.028 ms/sec
0.043 ms/call
1.37%		 279,844
139.47/sec
1.00/call
0.83%		 1,215,047 blks
605.56 blks/sec
4.34 blks/call
0.37%		 5 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.09 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
14
(2364908498)		 SELECT relnamespace::regnamespace 
as schemaname,
       relname as 
relname,
       pg_total_relation_size(
oid) bytes
  FROM pg_class
 WHERE 
relkind = ?;

Full query 		268
0.13/sec
1.00/call
0.00%		 11,705.28 ms
5.834 ms/sec
43.676 ms/call
1.33%		 102,376
51.02/sec
382.00/call
0.31%		 25,798 blks
12.86 blks/sec
96.26 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
15
(2747454572)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= true
AND project_mirror_data.retry_count 
<= 14
AND (projects.visibility_level 
= 20 OR plans.name IN ('early_adopter',
 'bronze', 'silver', 'gold'))
AND 
project_mirror_data.status NOT 
IN ('scheduled', 'started')
AND 
(project_mirror_data.next_execution_timestamp 
- project_mirror_data.last_update_at) 
<= '30 minutes'::interval
AND project_mirror_data.last_update_at 
< NOW() - '30 minutes'::interval
;
Full query 		134
0.07/sec
1.00/call
0.00%		 11,616.79 ms
5.790 ms/sec
86.692 ms/call
1.32%		 134
0.07/sec
1.00/call
0.00%		 7,307,397 blks
3.65K blks/sec
54.54K blks/call
2.20%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
16
(1189808325)		 SELECT  "users".* FROM "users" WHERE 
("users"."state" IN (?)) AND (ghost 
IS NOT TRUE) AND "users"."bot_type" 
IS NULL AND (("users"."name" ILIKE 
? OR "users"."username" ILIKE ?) 
OR "users"."email" = ?) ORDER BY 
CASE
  WHEN users.name = ? THEN 
?
  WHEN users.username = ? THEN 
?
  WHEN users.email = ? THEN ?
 ELSE ?
END
, "users"."name" ASC 
LIMIT ?
Full query 		167
0.08/sec
1.00/call
0.00%		 10,656.69 ms
5.311 ms/sec
63.813 ms/call
1.21%		 1,437
0.72/sec
8.60/call
0.00%		 884,653 blks
440.90 blks/sec
5.30K blks/call
0.27%		 404 blks
0.20 blks/sec
2.42 blks/call
0.05%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 13.73 ms
0.007 ms/sec
0.082 ms/call
0.02%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
17
(2856151481)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."type" IN (?) 
AND "namespaces"."id" = ? AND "namespaces"."type" 
= ? LIMIT ?
Full query 		360,690
179.76/sec
1.00/call
5.08%		 10,594.74 ms
5.280 ms/sec
0.029 ms/call
1.20%		 296,629
147.84/sec
0.82/call
0.88%		 1,443,310 blks
719.33 blks/sec
4.00 blks/call
0.43%		 84 blks
0.04 blks/sec
0.00 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 8.58 ms
0.004 ms/sec
0.000 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
18
(2418469088)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."id" = ? LIMIT 
?
Full query 		393,664
196.20/sec
1.00/call
5.55%		 10,516.67 ms
5.241 ms/sec
0.027 ms/call
1.20%		 393,664
196.20/sec
1.00/call
1.17%		 1,575,101 blks
785.01 blks/sec
4.00 blks/call
0.47%		 20 blks
0.01 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1.16 ms
0.001 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
19
(282616091)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "users" WHERE (("users"."name" 
ILIKE ? OR "users"."username" ILIKE 
?) OR "users"."email" = ?) AND 
"users"."external" != ? LIMIT ?) 
subquery_for_count
Full query 		337
0.17/sec
1.00/call
0.00%		 10,458.03 ms
5.212 ms/sec
31.033 ms/call
1.19%		 337
0.17/sec
1.00/call
0.00%		 617,834 blks
307.92 blks/sec
1.84K blks/call
0.19%		 208 blks
0.10 blks/sec
0.62 blks/call
0.03%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 4.62 ms
0.002 ms/sec
0.014 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
20
(1180769399)		 SELECT MAX("project_authorizations"."access_level") 
AS maximum_access_level, "project_authorizations"."user_id" 
AS project_authorizations_user_id 
FROM "project_authorizations" WHERE 
"project_authorizations"."project_id" 
= ? AND "project_authorizations"."user_id" 
= ? GROUP BY "project_authorizations"."user_id"
Full query 		348,567
173.72/sec
1.00/call
4.91%		 10,375.49 ms
5.171 ms/sec
0.030 ms/call
1.18%		 344,459
171.67/sec
0.99/call
1.03%		 1,856,351 blks
925.18 blks/sec
5.33 blks/call
0.56%		 9,694 blks
4.83 blks/sec
0.03 blks/call
1.25%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 609.83 ms
0.304 ms/sec
0.002 ms/call
0.81%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.108)

Start: 2020-02-18T01:55:08.619906+00:00
End: 2020-02-18T02:29:03.937883+00:00
Period seconds: 2035.31797
Period age: 00:33:55.317977

Top 50 rows

#
(query id)		 Query Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1
(308654979)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		449
0.22/sec
1.00/call
0.00%		 124,420.72 ms
61.131 ms/sec
277.106 ms/call
14.65%		 2,936
1.44/sec
6.54/call
0.01%		 93,000,901 blks
45.70K blks/sec
207.13K blks/call
28.45%		 120 blks
0.06 blks/sec
0.27 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1.86 ms
0.001 ms/sec
0.004 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2
(1272236258)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		371
0.18/sec
1.00/call
0.00%		 107,288.49 ms
52.713 ms/sec
289.187 ms/call
12.63%		 1,762
0.87/sec
4.75/call
0.01%		 76,925,896 blks
37.80K blks/sec
207.35K blks/call
23.54%		 120 blks
0.06 blks/sec
0.32 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 4.05 ms
0.002 ms/sec
0.011 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3
(2146878610)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_builds" WHERE "ci_builds"."type" 
IN (?) AND "ci_builds"."project_id" 
= ? LIMIT ?) subquery_for_count
Full query 		2,119
1.04/sec
1.00/call
0.02%		 40,294.94 ms
19.798 ms/sec
19.016 ms/call
4.74%		 2,119
1.04/sec
1.00/call
0.01%		 7,144,086 blks
3.52K blks/sec
3.38K blks/call
2.19%		 67,288 blks
33.06 blks/sec
31.75 blks/call
7.85%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 15,105.85 ms
7.422 ms/sec
7.129 ms/call
24.44%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
4
(3938502189)		 SELECT COUNT(DISTINCT "events"."id") 
FROM "events" INNER JOIN "projects" 
ON "projects"."id" = "events"."project_id" 
LEFT OUTER JOIN "project_features" 
ON "project_features"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"project_import_data" ON "project_import_data"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"namespaces" ON "namespaces"."id" 
= "projects"."namespace_id" LEFT 
OUTER JOIN "users" ON "users"."id" 
= "events"."author_id" WHERE "events"."project_id" 
= ? AND (EXISTS (SELECT ? FROM 
"project_authorizations" WHERE 
"project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?))
Full query 		1,492
0.73/sec
1.00/call
0.02%		 37,533.58 ms
18.441 ms/sec
25.157 ms/call
4.42%		 1,492
0.73/sec
1.00/call
0.00%		 8,961,734 blks
4.41K blks/sec
6.01K blks/call
2.74%		 11,480 blks
5.64 blks/sec
7.69 blks/call
1.34%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 360.66 ms
0.177 ms/sec
0.242 ms/call
0.58%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
5
(1682658247)		 SELECT "environments".* FROM "environments" 
WHERE "environments"."project_id" 
= ? AND ("environments"."state" 
IN (?)) AND "environments"."id" 
IN (SELECT "deployments"."environment_id" 
FROM "deployments" WHERE "deployments"."project_id" 
= ? AND "deployments"."sha" = ? 
GROUP BY "deployments"."environment_id") 
ORDER BY (SELECT MAX("deployments"."id") 
FROM "deployments" WHERE "deployments"."environment_id" 
= "environments"."id") DESC NULLS 
LAST
Full query 		3,858
1.90/sec
1.00/call
0.04%		 31,768.93 ms
15.609 ms/sec
8.235 ms/call
3.74%		 591
0.29/sec
0.15/call
0.00%		 12,156,216 blks
5.98K blks/sec
3.16K blks/call
3.72%		 8,333 blks
4.09 blks/sec
2.16 blks/call
0.97%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 237.39 ms
0.117 ms/sec
0.062 ms/call
0.38%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
6
(3357552630)		 SELECT  "projects"."id" AS t0_r0,
 "projects"."name" AS t0_r1, "projects"."path" 
AS t0_r2, "projects"."description" 
AS t0_r3, "projects"."created_at" 
AS t0_r4, "projects"."updated_at" 
AS t0_r5, "projects"."creator_id" 
AS t0_r6, "projects"."namespace_id" 
AS t0_r7, "projects"."last_activity_at" 
AS t0_r8, "projects"."import_url" 
AS t0_r9, "projects"."visibility_level" 
AS t0_r10, "projects"."archived" 
AS t0_r11, "projects"."merge_requests_template" 
AS t0_r12, "projects"."star_count" 
AS t0_r13, "projects"."merge_requests_rebase_enabled" 
AS t0_r14, "projects"."import_type" 
AS t0_r15, "projects"."import_source" 
AS t0_r16, "projects"."avatar" 
AS t0_r17, "projects"."approvals_before_merge" 
AS t0_r18, "projects"."reset_approvals_on_push" 
AS t0_r19, "projects"."merge_requests_ff_only_enabled" 
AS t0_r20, "projects"."issues_template" 
AS t0_r21, "projects"."mirror" 
AS t0_r22, "projects"."mirror_user_id" 
AS t0_r23, "projects"."shared_runners_enabled" 
AS t0_r24, "projects"."runners_token" 
AS t0_r25, "...
Full query 		397,728
195.41/sec
1.00/call
4.37%		 27,027.96 ms
13.279 ms/sec
0.068 ms/call
3.18%		 387,294
190.29/sec
0.97/call
1.16%		 3,535,487 blks
1.74K blks/sec
8.89 blks/call
1.08%		 8,913 blks
4.38 blks/sec
0.02 blks/call
1.04%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 490.29 ms
0.241 ms/sec
0.001 ms/call
0.79%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
7
(1189808325)		 SELECT  "users".* FROM "users" WHERE 
("users"."state" IN (?)) AND (ghost 
IS NOT TRUE) AND "users"."bot_type" 
IS NULL AND (("users"."name" ILIKE 
? OR "users"."username" ILIKE ?) 
OR "users"."email" = ?) ORDER BY 
CASE
  WHEN users.name = ? THEN 
?
  WHEN users.username = ? THEN 
?
  WHEN users.email = ? THEN ?
 ELSE ?
END
, "users"."name" ASC 
LIMIT ?
Full query 		167
0.08/sec
1.00/call
0.00%		 25,093.71 ms
12.329 ms/sec
150.262 ms/call
2.95%		 1,406
0.69/sec
8.42/call
0.00%		 2,361,414 blks
1.17K blks/sec
14.15K blks/call
0.72%		 79,091 blks
38.86 blks/sec
473.60 blks/call
9.23%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 762.60 ms
0.375 ms/sec
4.566 ms/call
1.23%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
8
(2576098393)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW()
;
Full query 		135
0.07/sec
1.00/call
0.00%		 23,903.75 ms
11.744 ms/sec
177.065 ms/call
2.81%		 135
0.07/sec
1.00/call
0.00%		 16,089,750 blks
7.91K blks/sec
119.19K blks/call
4.92%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
9
(746170934)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW() - ?::interval
;
Full query 		135
0.07/sec
1.00/call
0.00%		 21,222.94 ms
10.427 ms/sec
157.207 ms/call
2.50%		 135
0.07/sec
1.00/call
0.00%		 15,483,865 blks
7.61K blks/sec
114.70K blks/call
4.74%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
10
(2329378283)		 SELECT  "users".* FROM "users" WHERE 
"users"."id" = ? LIMIT ?
Full query 		415,438
204.11/sec
1.00/call
4.57%		 16,963.05 ms
8.334 ms/sec
0.041 ms/call
2.00%		 415,378
204.09/sec
1.00/call
1.24%		 1,661,751 blks
816.46 blks/sec
4.00 blks/call
0.51%		 23 blks
0.01 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1.23 ms
0.001 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
11
(1850364306)		 SELECT  "routes".* FROM "routes" 
WHERE "routes"."source_id" = ? 
AND "routes"."source_type" = ? 
LIMIT ?
Full query 		448,751
220.48/sec
1.00/call
4.93%		 13,087.14 ms
6.430 ms/sec
0.029 ms/call
1.54%		 448,751
220.48/sec
1.00/call
1.34%		 2,241,180 blks
1.11K blks/sec
4.99 blks/call
0.69%		 4,408 blks
2.17 blks/sec
0.01 blks/call
0.51%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 121.04 ms
0.059 ms/sec
0.000 ms/call
0.20%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
12
(2038040293)		 SELECT  "events"."id" AS t0_r0, 
"events"."project_id" AS t0_r1,
 "events"."author_id" AS t0_r2,
 "events"."target_id" AS t0_r3,
 "events"."created_at" AS t0_r4,
 "events"."updated_at" AS t0_r5,
 "events"."action" AS t0_r6, "events"."target_type" 
AS t0_r7, "events"."group_id" AS 
t0_r8, "users"."id" AS t1_r0, "users"."email" 
AS t1_r1, "users"."encrypted_password" 
AS t1_r2, "users"."reset_password_token" 
AS t1_r3, "users"."reset_password_sent_at" 
AS t1_r4, "users"."remember_created_at" 
AS t1_r5, "users"."sign_in_count" 
AS t1_r6, "users"."current_sign_in_at" 
AS t1_r7, "users"."last_sign_in_at" 
AS t1_r8, "users"."current_sign_in_ip" 
AS t1_r9, "users"."last_sign_in_ip" 
AS t1_r10, "users"."created_at" 
AS t1_r11, "users"."updated_at" 
AS t1_r12, "users"."name" AS t1_r13,
 "users"."admin" AS t1_r14, "users"."projects_limit" 
AS t1_r15, "users"."skype" AS t1_r16,
 "users"."linkedin" AS t1_r17, 
"users"."twitter" AS t1_r18, "users"."bio" 
AS t1_r19, "users"."failed_attempts" 
AS t1_r20, "users"."locked_at" 
...
Full query 		245
0.12/sec
1.00/call
0.00%		 13,011.27 ms
6.393 ms/sec
53.107 ms/call
1.53%		 3,390
1.67/sec
13.84/call
0.01%		 5,482,149 blks
2.70K blks/sec
22.38K blks/call
1.68%		 108,735 blks
53.42 blks/sec
443.82 blks/call
12.69%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 7,060.48 ms
3.469 ms/sec
28.818 ms/call
11.42%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
13
(2555545475)		 SELECT  "projects".* FROM "projects" 
WHERE "projects"."id" = ? LIMIT 
?
Full query 		283,447
139.26/sec
1.00/call
3.12%		 12,281.00 ms
6.034 ms/sec
0.043 ms/call
1.45%		 283,444
139.26/sec
1.00/call
0.85%		 1,231,832 blks
605.23 blks/sec
4.35 blks/call
0.38%		 4 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.09 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
14
(2747454572)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND (project_mirror_data.next_execution_timestamp 
- project_mirror_data.last_update_at) 
<= ?::interval
AND project_mirror_data.last_update_at 
< NOW() - ?::interval
;
Full query 		135
0.07/sec
1.00/call
0.00%		 12,129.83 ms
5.960 ms/sec
89.851 ms/call
1.43%		 135
0.07/sec
1.00/call
0.00%		 7,382,153 blks
3.63K blks/sec
54.69K blks/call
2.26%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
15
(2364908498)		 SELECT relnamespace::regnamespace 
as schemaname,
       relname as 
relname,
       pg_total_relation_size(
oid) bytes
  FROM pg_class
 WHERE 
relkind = ?;

Full query 		271
0.13/sec
1.00/call
0.00%		 11,649.13 ms
5.723 ms/sec
42.986 ms/call
1.37%		 103,522
50.86/sec
382.00/call
0.31%		 26,420 blks
12.98 blks/sec
97.49 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
16
(2856151481)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."type" IN (?) 
AND "namespaces"."id" = ? AND "namespaces"."type" 
= ? LIMIT ?
Full query 		367,463
180.54/sec
1.00/call
4.04%		 11,011.13 ms
5.410 ms/sec
0.030 ms/call
1.30%		 302,521
148.64/sec
0.82/call
0.91%		 1,470,406 blks
722.45 blks/sec
4.00 blks/call
0.45%		 66 blks
0.03 blks/sec
0.00 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 3.99 ms
0.002 ms/sec
0.000 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
17
(1180769399)		 SELECT MAX("project_authorizations"."access_level") 
AS maximum_access_level, "project_authorizations"."user_id" 
AS project_authorizations_user_id 
FROM "project_authorizations" WHERE 
"project_authorizations"."project_id" 
= ? AND "project_authorizations"."user_id" 
= ? GROUP BY "project_authorizations"."user_id"
Full query 		357,015
175.41/sec
1.00/call
3.92%		 10,821.34 ms
5.317 ms/sec
0.030 ms/call
1.27%		 352,687
173.28/sec
0.99/call
1.06%		 1,900,640 blks
933.83 blks/sec
5.32 blks/call
0.58%		 9,804 blks
4.82 blks/sec
0.03 blks/call
1.14%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 595.36 ms
0.293 ms/sec
0.002 ms/call
0.96%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
18
(2418469088)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."id" = ? LIMIT 
?
Full query 		398,407
195.75/sec
1.00/call
4.38%		 10,790.56 ms
5.302 ms/sec
0.027 ms/call
1.27%		 398,407
195.75/sec
1.00/call
1.19%		 1,594,181 blks
783.26 blks/sec
4.00 blks/call
0.49%		 18 blks
0.01 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 1.56 ms
0.001 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
19
(282616091)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "users" WHERE (("users"."name" 
ILIKE ? OR "users"."username" ILIKE 
?) OR "users"."email" = ?) AND 
"users"."external" != ? LIMIT ?) 
subquery_for_count
Full query 		326
0.16/sec
1.00/call
0.00%		 10,675.67 ms
5.245 ms/sec
32.747 ms/call
1.26%		 326
0.16/sec
1.00/call
0.00%		 629,389 blks
309.23 blks/sec
1.94K blks/call
0.19%		 187 blks
0.09 blks/sec
0.57 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 3.40 ms
0.002 ms/sec
0.010 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
20
(3842224781)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_pipelines" WHERE 
"ci_pipelines"."project_id" = ? 
AND "ci_pipelines"."source" != 
? AND "ci_pipelines"."ref" = ? 
LIMIT ?) subquery_for_count
Full query 		16,965
8.34/sec
1.00/call
0.19%		 10,578.71 ms
5.198 ms/sec
0.624 ms/call
1.25%		 16,965
8.34/sec
1.00/call
0.05%		 1,948,580 blks
957.38 blks/sec
114.86 blks/call
0.60%		 65,430 blks
32.15 blks/sec
3.86 blks/call
7.63%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 793.07 ms
0.390 ms/sec
0.047 ms/call
1.28%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Replica (10.220.16.109)

Start: 2020-02-18T01:55:09.746181+00:00
End: 2020-02-18T02:29:35.563156+00:00
Period seconds: 2065.81698
Period age: 00:34:25.816975

Top 50 rows

#
(query id)		 Query Calls ▼ Total time Rows shared_blks_hit shared_blks_read shared_blks_dirtied shared_blks_written blk_read_time blk_write_time kcache_reads kcache_writes kcache_user_time_ms kcache_system_time
1
(1272236258)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		444
0.21/sec
1.00/call
0.00%		 139,674.51 ms
67.612 ms/sec
314.582 ms/call
15.52%		 3,019
1.46/sec
6.80/call
0.01%		 91,935,666 blks
44.51K blks/sec
207.07K blks/call
28.30%		 146 blks
0.07 blks/sec
0.33 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 2.22 ms
0.001 ms/sec
0.005 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
2
(308654979)		 SELECT "ci_builds".* FROM "ci_builds" 
INNER JOIN "projects" ON "projects"."id" 
= "ci_builds"."project_id" LEFT 
JOIN project_features ON ci_builds.project_id 
= project_features.project_id LEFT 
JOIN (SELECT "ci_builds"."project_id",
 count(*) AS running_builds FROM 
"ci_builds" WHERE "ci_builds"."type" 
= ? AND ("ci_builds"."status" IN 
(?)) AND "ci_builds"."runner_id" 
IN (SELECT "ci_runners"."id" FROM 
"ci_runners" WHERE "ci_runners"."runner_type" 
= ?) GROUP BY "ci_builds"."project_id") 
AS project_builds ON ci_builds.project_id=project_builds.project_id 
WHERE "ci_builds"."type" = ? AND 
("ci_builds"."status" IN (?)) AND 
"ci_builds"."runner_id" IS NULL 
AND "projects"."shared_runners_enabled" 
= ? AND "projects"."pending_delete" 
= ? AND (project_features.builds_access_level 
IS NULL or project_features.builds_access_level 
> ?) AND (projects.visibility_level=? 
OR (WITH RECURSIVE "base_and_ancestors" 
AS ((SELECT "namespaces".* FROM 
"namespaces" WHERE (namespaces.id 
= projects.namespace_id))
UNION
...
Full query 		386
0.19/sec
1.00/call
0.00%		 117,998.77 ms
57.120 ms/sec
305.696 ms/call
13.11%		 2,025
0.98/sec
5.25/call
0.01%		 79,982,463 blks
38.72K blks/sec
207.21K blks/call
24.62%		 101 blks
0.05 blks/sec
0.26 blks/call
0.02%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 3.62 ms
0.002 ms/sec
0.009 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
3
(2146878610)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_builds" WHERE "ci_builds"."type" 
IN (?) AND "ci_builds"."project_id" 
= ? LIMIT ?) subquery_for_count
Full query 		2,218
1.07/sec
1.00/call
0.02%		 62,990.31 ms
30.492 ms/sec
28.400 ms/call
7.00%		 2,218
1.07/sec
1.00/call
0.01%		 7,618,430 blks
3.69K blks/sec
3.44K blks/call
2.35%		 72,064 blks
34.88 blks/sec
32.49 blks/call
11.33%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 31,066.19 ms
15.038 ms/sec
14.006 ms/call
51.27%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
4
(1682658247)		 SELECT "environments".* FROM "environments" 
WHERE "environments"."project_id" 
= ? AND ("environments"."state" 
IN (?)) AND "environments"."id" 
IN (SELECT "deployments"."environment_id" 
FROM "deployments" WHERE "deployments"."project_id" 
= ? AND "deployments"."sha" = ? 
GROUP BY "deployments"."environment_id") 
ORDER BY (SELECT MAX("deployments"."id") 
FROM "deployments" WHERE "deployments"."environment_id" 
= "environments"."id") DESC NULLS 
LAST
Full query 		4,047
1.96/sec
1.00/call
0.04%		 39,361.72 ms
19.054 ms/sec
9.726 ms/call
4.37%		 666
0.32/sec
0.16/call
0.00%		 13,595,113 blks
6.59K blks/sec
3.36K blks/call
4.19%		 11,813 blks
5.72 blks/sec
2.92 blks/call
1.86%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 291.05 ms
0.141 ms/sec
0.072 ms/call
0.48%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
5
(3357552630)		 SELECT  "projects"."id" AS t0_r0,
 "projects"."name" AS t0_r1, "projects"."path" 
AS t0_r2, "projects"."description" 
AS t0_r3, "projects"."created_at" 
AS t0_r4, "projects"."updated_at" 
AS t0_r5, "projects"."creator_id" 
AS t0_r6, "projects"."namespace_id" 
AS t0_r7, "projects"."last_activity_at" 
AS t0_r8, "projects"."import_url" 
AS t0_r9, "projects"."visibility_level" 
AS t0_r10, "projects"."archived" 
AS t0_r11, "projects"."merge_requests_template" 
AS t0_r12, "projects"."star_count" 
AS t0_r13, "projects"."merge_requests_rebase_enabled" 
AS t0_r14, "projects"."import_type" 
AS t0_r15, "projects"."import_source" 
AS t0_r16, "projects"."avatar" 
AS t0_r17, "projects"."approvals_before_merge" 
AS t0_r18, "projects"."reset_approvals_on_push" 
AS t0_r19, "projects"."merge_requests_ff_only_enabled" 
AS t0_r20, "projects"."issues_template" 
AS t0_r21, "projects"."mirror" 
AS t0_r22, "projects"."mirror_user_id" 
AS t0_r23, "projects"."shared_runners_enabled" 
AS t0_r24, "projects"."runners_token" 
AS t0_r25, "...
Full query 		403,242
195.20/sec
1.00/call
3.79%		 29,951.69 ms
14.499 ms/sec
0.074 ms/call
3.33%		 392,316
189.91/sec
0.97/call
1.20%		 3,579,682 blks
1.74K blks/sec
8.88 blks/call
1.10%		 12,194 blks
5.90 blks/sec
0.03 blks/call
1.92%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 522.96 ms
0.253 ms/sec
0.001 ms/call
0.86%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
6
(1189808325)		 SELECT  "users".* FROM "users" WHERE 
("users"."state" IN (?)) AND (ghost 
IS NOT TRUE) AND "users"."bot_type" 
IS NULL AND (("users"."name" ILIKE 
? OR "users"."username" ILIKE ?) 
OR "users"."email" = ?) ORDER BY 
CASE
  WHEN users.name = ? THEN 
?
  WHEN users.username = ? THEN 
?
  WHEN users.email = ? THEN ?
 ELSE ?
END
, "users"."name" ASC 
LIMIT ?
Full query 		206
0.10/sec
1.00/call
0.00%		 28,670.79 ms
13.879 ms/sec
139.179 ms/call
3.19%		 1,762
0.85/sec
8.55/call
0.01%		 2,599,682 blks
1.26K blks/sec
12.62K blks/call
0.80%		 71,622 blks
34.67 blks/sec
347.68 blks/call
11.26%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 603.17 ms
0.292 ms/sec
2.928 ms/call
1.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
7
(2576098393)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW()
;
Full query 		138
0.07/sec
1.00/call
0.00%		 27,099.49 ms
13.118 ms/sec
196.373 ms/call
3.01%		 138
0.07/sec
1.00/call
0.00%		 16,468,520 blks
7.98K blks/sec
119.34K blks/call
5.07%		 1 blks
0.00 blks/sec
0.01 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.04 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
8
(746170934)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND project_mirror_data.next_execution_timestamp 
<= NOW() - ?::interval
;
Full query 		138
0.07/sec
1.00/call
0.00%		 24,205.33 ms
11.717 ms/sec
175.401 ms/call
2.69%		 138
0.07/sec
1.00/call
0.00%		 15,839,404 blks
7.67K blks/sec
114.78K blks/call
4.88%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
9
(2329378283)		 SELECT  "users".* FROM "users" WHERE 
"users"."id" = ? LIMIT ?
Full query 		423,002
204.76/sec
1.00/call
3.98%		 18,378.32 ms
8.896 ms/sec
0.043 ms/call
2.04%		 422,939
204.73/sec
1.00/call
1.30%		 1,692,005 blks
819.05 blks/sec
4.00 blks/call
0.52%		 3 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.07 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
10
(1850364306)		 SELECT  "routes".* FROM "routes" 
WHERE "routes"."source_id" = ? 
AND "routes"."source_type" = ? 
LIMIT ?
Full query 		454,488
220.00/sec
1.00/call
4.27%		 14,838.79 ms
7.183 ms/sec
0.033 ms/call
1.65%		 454,488
220.00/sec
1.00/call
1.39%		 2,268,220 blks
1.10K blks/sec
4.99 blks/call
0.70%		 6,133 blks
2.97 blks/sec
0.01 blks/call
0.96%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 146.50 ms
0.071 ms/sec
0.000 ms/call
0.24%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
11
(3938502189)		 SELECT COUNT(DISTINCT "events"."id") 
FROM "events" INNER JOIN "projects" 
ON "projects"."id" = "events"."project_id" 
LEFT OUTER JOIN "project_features" 
ON "project_features"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"project_import_data" ON "project_import_data"."project_id" 
= "projects"."id" LEFT OUTER JOIN 
"namespaces" ON "namespaces"."id" 
= "projects"."namespace_id" LEFT 
OUTER JOIN "users" ON "users"."id" 
= "events"."author_id" WHERE "events"."project_id" 
= ? AND (EXISTS (SELECT ? FROM 
"project_authorizations" WHERE 
"project_authorizations"."user_id" 
= ? AND (project_authorizations.project_id 
= projects.id)) OR projects.visibility_level 
IN (?,?))
Full query 		1,459
0.71/sec
1.00/call
0.01%		 14,291.23 ms
6.918 ms/sec
9.795 ms/call
1.59%		 1,459
0.71/sec
1.00/call
0.00%		 3,355,824 blks
1.63K blks/sec
2.31K blks/call
1.03%		 13,144 blks
6.36 blks/sec
9.01 blks/call
2.07%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 337.73 ms
0.163 ms/sec
0.231 ms/call
0.56%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
12
(2747454572)		 SELECT COUNT(*) FROM projects INNER 
JOIN project_mirror_data ON project_mirror_data.project_id 
= projects.id
INNER JOIN namespaces 
ON projects.namespace_id = namespaces.id
LEFT 
JOIN plans ON namespaces.plan_id 
= plans.id
 WHERE projects.mirror 
= ?
AND project_mirror_data.retry_count 
<= ?
AND (projects.visibility_level 
= ? OR plans.name IN (?, ?, ?, 
?))
AND project_mirror_data.status 
NOT IN (?, ?)
AND (project_mirror_data.next_execution_timestamp 
- project_mirror_data.last_update_at) 
<= ?::interval
AND project_mirror_data.last_update_at 
< NOW() - ?::interval
;
Full query 		138
0.07/sec
1.00/call
0.00%		 13,708.04 ms
6.636 ms/sec
99.334 ms/call
1.52%		 138
0.07/sec
1.00/call
0.00%		 7,556,856 blks
3.66K blks/sec
54.76K blks/call
2.33%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
13
(2555545475)		 SELECT  "projects".* FROM "projects" 
WHERE "projects"."id" = ? LIMIT 
?
Full query 		288,102
139.46/sec
1.00/call
2.71%		 13,463.77 ms
6.517 ms/sec
0.047 ms/call
1.50%		 288,099
139.46/sec
1.00/call
0.88%		 1,251,536 blks
605.83 blks/sec
4.34 blks/call
0.39%		 6 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.14 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
14
(2364908498)		 SELECT relnamespace::regnamespace 
as schemaname,
       relname as 
relname,
       pg_total_relation_size(
oid) bytes
  FROM pg_class
 WHERE 
relkind = ?;

Full query 		275
0.13/sec
1.00/call
0.00%		 12,169.88 ms
5.891 ms/sec
44.254 ms/call
1.35%		 105,050
50.85/sec
382.00/call
0.32%		 27,028 blks
13.08 blks/sec
98.28 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
15
(1180769399)		 SELECT MAX("project_authorizations"."access_level") 
AS maximum_access_level, "project_authorizations"."user_id" 
AS project_authorizations_user_id 
FROM "project_authorizations" WHERE 
"project_authorizations"."project_id" 
= ? AND "project_authorizations"."user_id" 
= ? GROUP BY "project_authorizations"."user_id"
Full query 		360,253
174.39/sec
1.00/call
3.39%		 12,049.91 ms
5.833 ms/sec
0.033 ms/call
1.34%		 355,656
172.16/sec
0.99/call
1.09%		 1,917,910 blks
928.40 blks/sec
5.32 blks/call
0.59%		 9,488 blks
4.59 blks/sec
0.03 blks/call
1.49%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 594.80 ms
0.288 ms/sec
0.002 ms/call
0.98%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
16
(2856151481)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."type" IN (?) 
AND "namespaces"."id" = ? AND "namespaces"."type" 
= ? LIMIT ?
Full query 		371,447
179.81/sec
1.00/call
3.49%		 11,997.00 ms
5.807 ms/sec
0.032 ms/call
1.33%		 305,289
147.78/sec
0.82/call
0.93%		 1,486,360 blks
719.50 blks/sec
4.00 blks/call
0.46%		 79 blks
0.04 blks/sec
0.00 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 3.26 ms
0.002 ms/sec
0.000 ms/call
0.01%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
17
(2418469088)		 SELECT  "namespaces".* FROM "namespaces" 
WHERE "namespaces"."id" = ? LIMIT 
?
Full query 		401,796
194.50/sec
1.00/call
3.78%		 11,881.41 ms
5.751 ms/sec
0.030 ms/call
1.32%		 401,796
194.50/sec
1.00/call
1.23%		 1,608,096 blks
778.43 blks/sec
4.00 blks/call
0.50%		 14 blks
0.01 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.24 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
18
(3498832929)		 SELECT COUNT(*) FROM (WITH RECURSIVE 
"base_and_ancestors" AS ((SELECT 
"namespaces".* FROM ((SELECT "namespaces".* 
FROM "namespaces" INNER JOIN "members" 
ON "namespaces"."id" = "members"."source_id" 
WHERE "members"."type" = ? AND 
"members"."source_type" = ? AND 
"namespaces"."type" = ? AND "members"."user_id" 
= ? AND "members"."requested_at" 
IS NULL)
UNION
(SELECT namespaces.* 
FROM "projects" INNER JOIN "project_authorizations" 
ON "projects"."id" = "project_authorizations"."project_id" 
INNER JOIN "namespaces" ON "namespaces"."id" 
= "projects"."namespace_id" WHERE 
"project_authorizations"."user_id" 
= ?)) namespaces WHERE "namespaces"."type" 
= ?)
UNION
(SELECT "namespaces".* 
FROM "namespaces", "base_and_ancestors" 
WHERE "namespaces"."type" = ? AND 
"namespaces"."id" = "base_and_ancestors"."parent_id")),
 "base_and_descendants" AS ((SELECT 
"namespaces".* FROM "namespaces" 
INNER JOIN "members" ON "namespaces"."id" 
= "members"."source_id" WHERE "members"."type" 
= ? AND "members"."source_type" 
...
Full query 		249
0.12/sec
1.00/call
0.00%		 11,522.60 ms
5.578 ms/sec
46.275 ms/call
1.28%		 249
0.12/sec
1.00/call
0.00%		 6,791,142 blks
3.29K blks/sec
27.28K blks/call
2.09%		 39 blks
0.02 blks/sec
0.16 blks/call
0.01%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0.46 ms
0.000 ms/sec
0.002 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
19
(3842224781)		 SELECT COUNT(*) FROM (SELECT  ? 
AS one FROM "ci_pipelines" WHERE 
"ci_pipelines"."project_id" = ? 
AND "ci_pipelines"."source" != 
? AND "ci_pipelines"."ref" = ? 
LIMIT ?) subquery_for_count
Full query 		16,957
8.21/sec
1.00/call
0.16%		 11,032.05 ms
5.340 ms/sec
0.651 ms/call
1.23%		 16,957
8.21/sec
1.00/call
0.05%		 1,929,028 blks
933.78 blks/sec
113.76 blks/call
0.59%		 38,895 blks
18.83 blks/sec
2.29 blks/call
6.12%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 535.78 ms
0.259 ms/sec
0.032 ms/call
0.88%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%
20
(3912557115)		 SELECT  "project_features".* FROM 
"project_features" WHERE "project_features"."project_id" 
= ? LIMIT ?
Full query 		351,693
170.24/sec
1.00/call
3.31%		 10,740.70 ms
5.199 ms/sec
0.031 ms/call
1.19%		 351,693
170.24/sec
1.00/call
1.08%		 1,400,934 blks
678.15 blks/sec
3.98 blks/call
0.43%		 6,550 blks
3.17 blks/sec
0.02 blks/call
1.03%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 0 blks
0.00 blks/sec
0.00 blks/call
0.00%		 189.96 ms
0.092 ms/sec
0.001 ms/call
0.31%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 bytes
0.00 bytes/sec
0.00 bytes/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%		 0.00 ms
0.000 ms/sec
0.000 ms/call
0.00%

Conclusions

  • [P1] For some query groups, total_time > 30.00% of overall timing, observed on: node: 10.220.16.106. Such a high percentage means that those queries are "major contributors" to resource consumption on those nodes. In other words, if a query group has total_time which is 30.00% of overall timing, it means that during the observation period, 30.00% of time CPUs were working on that node processing queries from this group.

Recommendations

  • [P1] For some query groups, total_time > 30.00% of overall timing. To reduce total_time for particular query group consider the following tactics:
    • perform query micro-optimization (take particular query examples related to the group, use EXPLAIN and EXPLAIN (BUFFERS, ANALYZE) to optimize it; consider using Joe to boost the optimization process);
    • if the frequency of execution is high (check the calls / second metric), try to find a way to reduce the frequency, changing the application code and/or, if applicable, applying caching.

  Table of contents

L001 Table Sizes

Observations

Data collected: 2020-02-18 02:28:20 +0000 UTC
Current database: gitlabhq_production

Master (10.220.16.106)

The list is limited to 20 items. Total: 375.

# Table Rows ▼ Total size Table size Index(es) Size TOAST Size
  ===== TOTAL ===== ~11B 5.15 TiB 2.68 TiB 1.50 TiB 0.98 TiB
1 merge_request_diff_files ~2B 1.64 TiB (31.77%) 853.63 GiB (31.12%) 34.00 GiB (2.23%) 784.79 GiB (78.87%)
2 ci_builds ~417M 899.14 GiB (17.08%) 421.50 GiB (15.37%) 348.05 GiB (22.80%) 129.59 GiB (13.02%)
3 merge_request_diff_commits ~3B 785.45 GiB (14.92%) 601.13 GiB (21.91%) 169.27 GiB (11.09%) 15.06 GiB (1.51%)
4 notes ~249M 321.01 GiB (6.10%) 162.51 GiB (5.92%) 148.22 GiB (9.71%) 10.29 GiB (1.03%)
5 ci_build_trace_sections ~3B 303.81 GiB (5.77%) 146.33 GiB (5.33%) 157.49 GiB (10.32%)
6 events ~555M 149.77 GiB (2.84%) 37.40 GiB (1.36%) 112.37 GiB (7.36%) 8.00 KiB (0.00%)
7 web_hook_logs ~65M 121.53 GiB (2.31%) 78.26 GiB (2.85%) 5.43 GiB (0.36%) 37.85 GiB (3.80%)
8 ci_job_artifacts ~360M 107.14 GiB (2.04%) 53.90 GiB (1.96%) 53.25 GiB (3.49%) 8.00 KiB (0.00%)
9 ci_pipelines ~111M 84.26 GiB (1.60%) 22.97 GiB (0.84%) 61.27 GiB (4.01%) 33.58 MiB (0.00%)
10 audit_events ~242M 76.38 GiB (1.45%) 57.10 GiB (2.08%) 19.28 GiB (1.26%) 6.63 MiB (0.00%)
11 sent_notifications ~298M 69.26 GiB (1.32%) 40.23 GiB (1.47%) 29.04 GiB (1.90%) 8.00 KiB (0.00%)
12 merge_requests ~41M 66.58 GiB (1.26%) 18.28 GiB (0.67%) 46.63 GiB (3.05%) 1.67 GiB (0.17%)
13 issues ~24M 60.31 GiB (1.15%) 15.53 GiB (0.57%) 38.27 GiB (2.51%) 6.52 GiB (0.66%)
14 push_event_payloads ~420M 59.75 GiB (1.13%) 50.72 GiB (1.85%) 9.03 GiB (0.59%) 8.00 KiB (0.00%)
15 projects ~13M 53.55 GiB (1.02%) 3.34 GiB (0.12%) 49.94 GiB (3.27%) 277.99 MiB (0.03%)
16 ci_stages ~203M 45.33 GiB (0.86%) 16.77 GiB (0.61%) 28.56 GiB (1.87%) 8.00 KiB (0.00%)
17 ci_builds_metadata ~346M 45.03 GiB (0.86%) 17.92 GiB (0.65%) 27.11 GiB (1.78%) 8.00 KiB (0.00%)
18 taggings ~175M 43.96 GiB (0.83%) 11.14 GiB (0.41%) 32.82 GiB (2.15%) 8.00 KiB (0.00%)
19 deployments ~50M 31.17 GiB (0.59%) 7.94 GiB (0.29%) 23.23 GiB (1.52%) 8.00 KiB (0.00%)
20 merge_request_diffs ~67M 21.56 GiB (0.41%) 14.16 GiB (0.52%) 5.32 GiB (0.35%) 2.10 GiB (0.21%)

Conclusions

Recommendations

  Table of contents

L003 Integer (int2, int4) Out-of-range Risks in PKs

Observations

Data collected: 2020-02-18 02:28:21 +0000 UTC
Current database: gitlabhq_production

Master (10.220.16.106)

Table PK Type Current max value ▼ Capacity used, %
events id int4 653,298,706 30.42
ci_job_artifacts id int4 469,071,614 21.84
ci_builds id int4 440,618,871 20.52
ci_builds_metadata id int4 361,407,334 16.83
sent_notifications id int4 298,192,504 13.89
notes id int4 289,787,114 13.49
web_hook_logs id int4 280,508,881 13.06
audit_events id int4 241,897,167 11.26
ci_stages id int4 215,881,042 10.05

Conclusions

  • [P1] High risks of out-of-range errors for an integer column. The columns listed below, being part of a primary key, have high risks to reach 100% of the integer capacity (2^31-1, or 2147483647 for int4 columns, and 2^15-1, or 32767 for int2 columns; see the documentation. If it happens, INSERTs of new rows will not be possible (unless they use some non-incremental values, such as some negative values) and fixing it will require a long downtime. 9 such columns are found:
    • events: reached value 653298706, or 30.42% of int4 capacity
    • ci_job_artifacts: reached value 469071614, or 21.84% of int4 capacity
    • ci_builds: reached value 440618871, or 20.52% of int4 capacity
    • ci_builds_metadata: reached value 361407334, or 16.83% of int4 capacity
    • sent_notifications: reached value 298192504, or 13.89% of int4 capacity
    • etc.

Recommendations

  • [P1] High risks of out-of-range errors for an integer column. Consider using int8 in all PK columns, always. To convert existing columns to int8, consider the following approaches:
    1. Blocking ALTER TABLE .. ALTER COLUMN: a straightforward solution requiring significant downtime (a maintenance window).
    2. "New column": create a new column, update it in batches (running not longer than a few seconds, to avoid blocking issues), and then switch to using it, redefining all the constraints. Notice, that to redefine a primary key constraint, ALTER TABLE .. ALTER COLUMN .. SET NOT NULL will be needed. It is a blocking operation in all Postgres versions up to 12 (where it might be lightweight if a proper CHECK constraint is defined first; such constraint can be defined in a non-blocking way). Since Postgres 11, it is possible to use a trick: when adding a column, use DEFAULT with NOT NULL, it will be a non-blocking operation. For all Postgres versions prior to 11, a specific downtime (maintenance window) will be needed anyway.
    3. "New table": create a new table with the same schema as the existing one, capture all ongoing changes to an additional "log" table, copy existing data from the old table to the new one, and switch. This method, as the previous one, is non-trivial and requires careful development and testing under load (consider using Nancy for database experiments developing this solution). This approach is non-blocking regardless of Postgres version, but it requires significantly more efforts to implement.