RegenerateCiJobTokenSigningKey migration failing
Summary
When trying to upgrade to 17.7.1 (self-managed), the migration RegenerateCiJobTokenSigningKey fails in the function 20241017160505_regenerate_ci_job_token_signing_key.rb with an OpenSSL::Cipher::CipherError.
Steps to reproduce
Either try to upgrade to version 17.7.1 or run the migration RegenerateCiJobTokenSigningKey.
What is the current bug behavior?
The migration fails with an OpenSSL::Cipher::CipherError in 20241017160505_regenerate_ci_job_token_signing_key.rb.
What is the expected correct behavior?
The migration completes successfully.
Relevant logs and/or screenshots
The following error is output:
main: == 20241017160505 RegenerateCiJobTokenSigningKey: migrating ===================
main: == [advisory_lock_connection] object_id: 48320, pg_backend_pid: 1498
rake aborted!
StandardError: An error has occurred, this and all later migrations canceled:
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/encryptor-3.0.0/lib/encryptor.rb:98:in `final'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/encryptor-3.0.0/lib/encryptor.rb:98:in `crypt'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/encryptor-3.0.0/lib/encryptor.rb:49:in `decrypt'
/opt/gitlab/gitlab/vendor/gems/attr_encrypted/lib/attr_encrypted.rb:244:in `attr_decrypt'
/opt/gitlab/gitlab/vendor/gems/attr_encrypted/lib/attr_encrypted.rb:333:in `attr_decrypt'
/opt/gitlab/gitlab/vendor/gems/attr_encrypted/lib/attr_encrypted.rb:163:in `block (2 levels) in attr_encrypted'
/opt/gitlab/gitlab/db/migrate/20241017160505_regenerate_ci_job_token_signing_key.rb:23:in `block in up'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:71:in `each'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:71:in `block in find_each'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:138:in `block in find_in_batches'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:245:in `block in in_batches'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:229:in `loop'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:229:in `in_batches'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:137:in `find_in_batches'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:70:in `find_each'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/querying.rb:22:in `find_each'
/opt/gitlab/gitlab/db/migrate/20241017160505_regenerate_ci_job_token_signing_key.rb:22:in `up'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:908:in `public_send'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:908:in `exec_migration'
/opt/gitlab/gitlab/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration'
/opt/gitlab/gitlab/lib/gitlab/database/query_analyzer.rb:83:in `within'
/opt/gitlab/gitlab/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration'
/opt/gitlab/gitlab/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:889:in `block (2 levels) in migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:888:in `block in migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/connection_adapters/abstract/connection_pool.rb:215:in `with_connection'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:887:in `migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1095:in `migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1409:in `block in execute_migration_in_transaction'
/opt/gitlab/gitlab/lib/gitlab/database/with_lock_retries.rb:123:in `run_block'
/opt/gitlab/gitlab/lib/gitlab/database/with_lock_retries.rb:134:in `block in run_block_with_lock_timeout'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/connection_adapters/abstract/transaction.rb:319:in `block in within_new_transaction'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activesupport-7.0.8.6/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `handle_interrupt'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activesupport-7.0.8.6/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `block in synchronize'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activesupport-7.0.8.6/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `handle_interrupt'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activesupport-7.0.8.6/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `synchronize'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/connection_adapters/abstract/transaction.rb:317:in `within_new_transaction'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/connection_adapters/abstract/database_statements.rb:316:in `transaction'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/opt/gitlab/gitlab/lib/gitlab/database/with_lock_retries.rb:129:in `run_block_with_lock_timeout'
/opt/gitlab/gitlab/lib/gitlab/database/with_lock_retries.rb:97:in `run'
/opt/gitlab/gitlab/lib/gitlab/database/migrations/lock_retry_mixin.rb:52:in `ddl_transaction'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1408:in `execute_migration_in_transaction'
/opt/gitlab/gitlab/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1382:in `each'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1382:in `migrate_without_lock'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1331:in `block in migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1481:in `block in with_advisory_lock'
/opt/gitlab/gitlab/lib/gitlab/database/migrations/pg_backend_pid.rb:28:in `block in with_advisory_lock_connection'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/connection_adapters/abstract/connection_pool.rb:215:in `with_connection'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1496:in `with_advisory_lock_connection'
/opt/gitlab/gitlab/lib/gitlab/database/migrations/pg_backend_pid.rb:25:in `with_advisory_lock_connection'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1477:in `with_advisory_lock'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1331:in `migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1166:in `up'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1141:in `migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/tasks/database_tasks.rb:262:in `migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/railties/databases.rake:92:in `block (2 levels) in <top (required)>'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/rake-13.0.6/exe/rake:27:in `<top (required)>'
Caused by:
OpenSSL::Cipher::CipherError:
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/encryptor-3.0.0/lib/encryptor.rb:98:in `final'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/encryptor-3.0.0/lib/encryptor.rb:98:in `crypt'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/encryptor-3.0.0/lib/encryptor.rb:49:in `decrypt'
/opt/gitlab/gitlab/vendor/gems/attr_encrypted/lib/attr_encrypted.rb:244:in `attr_decrypt'
/opt/gitlab/gitlab/vendor/gems/attr_encrypted/lib/attr_encrypted.rb:333:in `attr_decrypt'
/opt/gitlab/gitlab/vendor/gems/attr_encrypted/lib/attr_encrypted.rb:163:in `block (2 levels) in attr_encrypted'
/opt/gitlab/gitlab/db/migrate/20241017160505_regenerate_ci_job_token_signing_key.rb:23:in `block in up'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:71:in `each'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:71:in `block in find_each'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:138:in `block in find_in_batches'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:245:in `block in in_batches'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:229:in `loop'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:229:in `in_batches'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:137:in `find_in_batches'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/relation/batches.rb:70:in `find_each'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/querying.rb:22:in `find_each'
/opt/gitlab/gitlab/db/migrate/20241017160505_regenerate_ci_job_token_signing_key.rb:22:in `up'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:908:in `public_send'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:908:in `exec_migration'
/opt/gitlab/gitlab/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration'
/opt/gitlab/gitlab/lib/gitlab/database/query_analyzer.rb:83:in `within'
/opt/gitlab/gitlab/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration'
/opt/gitlab/gitlab/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:889:in `block (2 levels) in migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:888:in `block in migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/connection_adapters/abstract/connection_pool.rb:215:in `with_connection'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:887:in `migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1095:in `migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1409:in `block in execute_migration_in_transaction'
/opt/gitlab/gitlab/lib/gitlab/database/with_lock_retries.rb:123:in `run_block'
/opt/gitlab/gitlab/lib/gitlab/database/with_lock_retries.rb:134:in `block in run_block_with_lock_timeout'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/connection_adapters/abstract/transaction.rb:319:in `block in within_new_transaction'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activesupport-7.0.8.6/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `handle_interrupt'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activesupport-7.0.8.6/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `block in synchronize'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activesupport-7.0.8.6/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `handle_interrupt'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activesupport-7.0.8.6/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `synchronize'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/connection_adapters/abstract/transaction.rb:317:in `within_new_transaction'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/connection_adapters/abstract/database_statements.rb:316:in `transaction'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/opt/gitlab/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/opt/gitlab/gitlab/lib/gitlab/database/with_lock_retries.rb:129:in `run_block_with_lock_timeout'
/opt/gitlab/gitlab/lib/gitlab/database/with_lock_retries.rb:97:in `run'
/opt/gitlab/gitlab/lib/gitlab/database/migrations/lock_retry_mixin.rb:52:in `ddl_transaction'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1408:in `execute_migration_in_transaction'
/opt/gitlab/gitlab/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1382:in `each'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1382:in `migrate_without_lock'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1331:in `block in migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1481:in `block in with_advisory_lock'
/opt/gitlab/gitlab/lib/gitlab/database/migrations/pg_backend_pid.rb:28:in `block in with_advisory_lock_connection'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/connection_adapters/abstract/connection_pool.rb:215:in `with_connection'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1496:in `with_advisory_lock_connection'
/opt/gitlab/gitlab/lib/gitlab/database/migrations/pg_backend_pid.rb:25:in `with_advisory_lock_connection'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1477:in `with_advisory_lock'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1331:in `migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1166:in `up'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/migration.rb:1141:in `migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/tasks/database_tasks.rb:262:in `migrate'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/activerecord-7.0.8.6/lib/active_record/railties/databases.rake:92:in `block (2 levels) in <top (required)>'
/opt/gitlab/gitlab/vendor/bundle/ruby/3.2.0/gems/rake-13.0.6/exe/rake:27:in `<top (required)>'The output of bundle exec rake gitlab:doctor:secrets RAILS_ENV=production VERBOSE=1 is:
I, [2025-01-15T03:06:54.909891 #16797] INFO -- : Checking encrypted values in the database
I, [2025-01-15T03:06:59.482565 #16797] INFO -- : - Gitlab::BackgroundMigration::BackfillIntegrationsEnableSslVerification::Integration failures: 2
D, [2025-01-15T03:06:59.482613 #16797] DEBUG -- : - Gitlab::BackgroundMigration::BackfillIntegrationsEnableSslVerification::Integration[2]: properties
D, [2025-01-15T03:06:59.482634 #16797] DEBUG -- : - Gitlab::BackgroundMigration::BackfillIntegrationsEnableSslVerification::Integration[82]: properties
I, [2025-01-15T03:06:59.490718 #16797] INFO -- : - VirtualRegistries::Packages::Maven::Upstream failures: 0
I, [2025-01-15T03:06:59.498321 #16797] INFO -- : - Packages::Debian::ProjectDistributionKey failures: 0
I, [2025-01-15T03:06:59.505576 #16797] INFO -- : - Packages::Debian::GroupDistributionKey failures: 0
I, [2025-01-15T03:06:59.515113 #16797] INFO -- : - Integrations::Instance::Integration failures: 0
I, [2025-01-15T03:06:59.522538 #16797] INFO -- : - Clusters::Providers::Gcp failures: 0
I, [2025-01-15T03:06:59.531089 #16797] INFO -- : - Clusters::Providers::Aws failures: 0
I, [2025-01-15T03:06:59.532042 #16797] INFO -- : - Clusters::Integrations::Prometheus failures: 0
I, [2025-01-15T03:06:59.539425 #16797] INFO -- : - ServiceDesk::CustomEmailVerification failures: 0
I, [2025-01-15T03:06:59.546635 #16797] INFO -- : - ServiceDesk::CustomEmailCredential failures: 0
I, [2025-01-15T03:06:59.554036 #16797] INFO -- : - Integrations::ZentaoTrackerData failures: 0
I, [2025-01-15T03:06:59.561817 #16797] INFO -- : - Integrations::JiraTrackerData failures: 0
I, [2025-01-15T03:06:59.570018 #16797] INFO -- : - Integrations::IssueTrackerData failures: 0
I, [2025-01-15T03:06:59.577630 #16797] INFO -- : - IncidentManagement::ProjectIncidentManagementSetting failures: 0
I, [2025-01-15T03:06:59.585032 #16797] INFO -- : - ErrorTracking::ProjectErrorTrackingSetting failures: 0
I, [2025-01-15T03:06:59.591639 #16797] INFO -- : - Clusters::KubernetesNamespace failures: 0
I, [2025-01-15T03:06:59.599054 #16797] INFO -- : - CloudConnector::ServiceAccessToken failures: 0
I, [2025-01-15T03:06:59.606515 #16797] INFO -- : - BulkImports::Configuration failures: 0
I, [2025-01-15T03:06:59.613861 #16797] INFO -- : - Atlassian::Identity failures: 0
I, [2025-01-15T03:06:59.621485 #16797] INFO -- : - Alerting::ProjectAlertingSetting failures: 0
I, [2025-01-15T03:06:59.628907 #16797] INFO -- : - SlackIntegration failures: 0
I, [2025-01-15T03:06:59.636154 #16797] INFO -- : - RemoteMirror failures: 0
I, [2025-01-15T03:06:59.650986 #16797] INFO -- : - ProjectSetting failures: 0
I, [2025-01-15T03:06:59.659328 #16797] INFO -- : - PagesDomainAcmeOrder failures: 0
I, [2025-01-15T03:06:59.676931 #16797] INFO -- : - PagesDomain failures: 0
I, [2025-01-15T03:06:59.686121 #16797] INFO -- : - JiraConnectInstallation failures: 0
I, [2025-01-15T03:06:59.695014 #16797] INFO -- : - GrafanaIntegration failures: 0
I, [2025-01-15T03:06:59.704196 #16797] INFO -- : - ChatName failures: 0
I, [2025-01-15T03:06:59.713342 #16797] INFO -- : - AlertManagement::HttpIntegration failures: 0
I, [2025-01-15T03:06:59.733511 #16797] INFO -- : - WebHook failures: 0
I, [2025-01-15T03:06:59.754129 #16797] INFO -- : - Integration failures: 2
D, [2025-01-15T03:06:59.754170 #16797] DEBUG -- : - Integration[2]: properties
D, [2025-01-15T03:06:59.754189 #16797] DEBUG -- : - Integration[82]: properties
I, [2025-01-15T03:06:59.763364 #16797] INFO -- : - ProjectImportData failures: 0
I, [2025-01-15T03:06:59.771769 #16797] INFO -- : - Clusters::Platforms::Kubernetes failures: 0
I, [2025-01-15T03:06:59.787969 #16797] INFO -- : - Snippet failures: 0
I, [2025-01-15T03:06:59.829812 #16797] INFO -- : - User failures: 5
D, [2025-01-15T03:06:59.829852 #16797] DEBUG -- : - User[1]: static_object_token
D, [2025-01-15T03:06:59.829872 #16797] DEBUG -- : - User[2]: static_object_token
D, [2025-01-15T03:06:59.829888 #16797] DEBUG -- : - User[4]: static_object_token
D, [2025-01-15T03:06:59.829903 #16797] DEBUG -- : - User[6]: static_object_token
D, [2025-01-15T03:06:59.829917 #16797] DEBUG -- : - User[7]: static_object_token
I, [2025-01-15T03:06:59.858675 #16797] INFO -- : - ApplicationSetting failures: 1
D, [2025-01-15T03:06:59.858715 #16797] DEBUG -- : - ApplicationSetting[1]: ci_job_token_signing_key, error_tracking_access_token
I, [2025-01-15T03:06:59.860584 #16797] INFO -- : - SystemHook failures: 0
I, [2025-01-15T03:06:59.862054 #16797] INFO -- : - ServiceHook failures: 0
I, [2025-01-15T03:06:59.863523 #16797] INFO -- : - ProjectHook failures: 0
I, [2025-01-15T03:06:59.864915 #16797] INFO -- : - Integrations::MockMonitoring failures: 0
I, [2025-01-15T03:06:59.866298 #16797] INFO -- : - Integrations::MockCi failures: 0
I, [2025-01-15T03:06:59.867653 #16797] INFO -- : - Integrations::BeyondIdentity failures: 0
I, [2025-01-15T03:06:59.868996 #16797] INFO -- : - Integrations::Zentao failures: 0
I, [2025-01-15T03:06:59.870336 #16797] INFO -- : - Integrations::Teamcity failures: 0
I, [2025-01-15T03:06:59.871679 #16797] INFO -- : - Integrations::Pushover failures: 0
I, [2025-01-15T03:06:59.873021 #16797] INFO -- : - Integrations::Pumble failures: 0
I, [2025-01-15T03:06:59.874359 #16797] INFO -- : - Integrations::Prometheus failures: 0
I, [2025-01-15T03:06:59.875711 #16797] INFO -- : - Integrations::PipelinesEmail failures: 0
I, [2025-01-15T03:06:59.877057 #16797] INFO -- : - Integrations::Jira failures: 0
I, [2025-01-15T03:06:59.878410 #16797] INFO -- : - Integrations::SquashTm failures: 0
I, [2025-01-15T03:06:59.879759 #16797] INFO -- : - Integrations::WebexTeams failures: 0
I, [2025-01-15T03:06:59.881107 #16797] INFO -- : - Integrations::UnifyCircuit failures: 0
I, [2025-01-15T03:06:59.882501 #16797] INFO -- : - Integrations::Telegram failures: 0
I, [2025-01-15T03:06:59.883887 #16797] INFO -- : - Integrations::Mattermost failures: 0
I, [2025-01-15T03:06:59.885238 #16797] INFO -- : - Integrations::MicrosoftTeams failures: 0
I, [2025-01-15T03:06:59.886161 #16797] INFO -- : - Integrations::Slack failures: 1
D, [2025-01-15T03:06:59.886190 #16797] DEBUG -- : - Integrations::Slack[82]: properties
I, [2025-01-15T03:06:59.887546 #16797] INFO -- : - Integrations::Clickup failures: 0
I, [2025-01-15T03:06:59.888896 #16797] INFO -- : - Integrations::Youtrack failures: 0
I, [2025-01-15T03:06:59.890250 #16797] INFO -- : - Integrations::Ewm failures: 0
I, [2025-01-15T03:06:59.891604 #16797] INFO -- : - Integrations::Redmine failures: 0
I, [2025-01-15T03:06:59.892966 #16797] INFO -- : - Integrations::Pivotaltracker failures: 0
I, [2025-01-15T03:06:59.894323 #16797] INFO -- : - Integrations::Phorge failures: 0
I, [2025-01-15T03:06:59.895685 #16797] INFO -- : - Integrations::Packagist failures: 0
I, [2025-01-15T03:06:59.897038 #16797] INFO -- : - Integrations::SlackSlashCommands failures: 0
I, [2025-01-15T03:06:59.898405 #16797] INFO -- : - Integrations::MattermostSlashCommands failures: 0
I, [2025-01-15T03:06:59.899809 #16797] INFO -- : - Integrations::Matrix failures: 0
I, [2025-01-15T03:06:59.901257 #16797] INFO -- : - Integrations::JiraCloudApp failures: 0
I, [2025-01-15T03:06:59.902619 #16797] INFO -- : - Integrations::Jenkins failures: 0
I, [2025-01-15T03:06:59.903992 #16797] INFO -- : - Integrations::Irker failures: 0
I, [2025-01-15T03:06:59.905354 #16797] INFO -- : - Integrations::Harbor failures: 0
I, [2025-01-15T03:06:59.906719 #16797] INFO -- : - Integrations::HangoutsChat failures: 0
I, [2025-01-15T03:06:59.908083 #16797] INFO -- : - Integrations::GooglePlay failures: 0
I, [2025-01-15T03:06:59.909468 #16797] INFO -- : - Integrations::GitlabSlackApplication failures: 0
I, [2025-01-15T03:06:59.910828 #16797] INFO -- : - Integrations::ExternalWiki failures: 0
I, [2025-01-15T03:06:59.912223 #16797] INFO -- : - Integrations::EmailsOnPush failures: 0
I, [2025-01-15T03:06:59.913576 #16797] INFO -- : - Integrations::DroneCi failures: 0
I, [2025-01-15T03:06:59.914888 #16797] INFO -- : - Integrations::Discord failures: 0
I, [2025-01-15T03:06:59.916273 #16797] INFO -- : - Integrations::DiffblueCover failures: 0
I, [2025-01-15T03:06:59.917614 #16797] INFO -- : - Integrations::Datadog failures: 0
I, [2025-01-15T03:06:59.918956 #16797] INFO -- : - Integrations::CustomIssueTracker failures: 0
I, [2025-01-15T03:06:59.920264 #16797] INFO -- : - Integrations::Confluence failures: 0
I, [2025-01-15T03:06:59.921199 #16797] INFO -- : - Integrations::Campfire failures: 1
D, [2025-01-15T03:06:59.921227 #16797] DEBUG -- : - Integrations::Campfire[2]: properties
I, [2025-01-15T03:06:59.922552 #16797] INFO -- : - Integrations::Buildkite failures: 0
I, [2025-01-15T03:06:59.923904 #16797] INFO -- : - Integrations::Bugzilla failures: 0
I, [2025-01-15T03:06:59.925245 #16797] INFO -- : - Integrations::Bamboo failures: 0
I, [2025-01-15T03:06:59.926592 #16797] INFO -- : - Integrations::Assembla failures: 0
I, [2025-01-15T03:06:59.927900 #16797] INFO -- : - Integrations::Asana failures: 0
I, [2025-01-15T03:06:59.929247 #16797] INFO -- : - Integrations::AppleAppStore failures: 0
I, [2025-01-15T03:06:59.930402 #16797] INFO -- : - ProjectSnippet failures: 0
I, [2025-01-15T03:06:59.931466 #16797] INFO -- : - PersonalSnippet failures: 0
I, [2025-01-15T03:06:59.944812 #16797] INFO -- : - Gitlab::BackgroundMigration::EncryptCiTriggerToken::CiTrigger failures: 0
I, [2025-01-15T03:06:59.953869 #16797] INFO -- : - Ci::JobVariable failures: 0
I, [2025-01-15T03:06:59.954975 #16797] INFO -- : - Ci::Trigger failures: 0
I, [2025-01-15T03:06:59.963584 #16797] INFO -- : - Ci::GroupVariable failures: 0
I, [2025-01-15T03:06:59.971944 #16797] INFO -- : - Ci::Variable failures: 0
I, [2025-01-15T03:06:59.980154 #16797] INFO -- : - Ci::PipelineScheduleVariable failures: 0
I, [2025-01-15T03:06:59.988422 #16797] INFO -- : - Ci::InstanceVariable failures: 0
I, [2025-01-15T03:06:59.990504 #16797] INFO -- : - Ci::PipelineVariable failures: 0
I, [2025-01-15T03:06:59.998747 #16797] INFO -- : - Operations::FeatureFlagsClient failures: 0
I, [2025-01-15T03:07:00.007039 #16797] INFO -- : - Clusters::AgentToken failures: 0
I, [2025-01-15T03:07:00.139114 #16797] INFO -- : - Project failures: 0
I, [2025-01-15T03:07:00.148468 #16797] INFO -- : - DeployToken failures: 0
I, [2025-01-15T03:07:00.161129 #16797] INFO -- : - Group failures: 0
I, [2025-01-15T03:07:00.180633 #16797] INFO -- : - Ci::Runner failures: 0
I, [2025-01-15T03:07:00.227726 #16797] INFO -- : - Ci::Build failures: 0
I, [2025-01-15T03:07:00.227765 #16797] INFO -- : Total: 12 row(s) affected
I, [2025-01-15T03:07:00.227776 #16797] INFO -- : Done!Output of checks
Results of GitLab environment info
Bundler Version:2.6.2
Rake Version: 13.0.6
Redis Version: 7.4.1
Sidekiq Version:7.2.4
Go Version: go1.23.4 linux/amd64
GitLab information
Version: 17.7.1
Revision: ea03507eff8
Directory: /opt/gitlab/gitlab
DB Adapter: PostgreSQL
DB Version: 14.15
URL: https://[redacted]
HTTP Clone URL: https://[redacted]/some-group/some-project.git
SSH Clone URL: git@[redacted]:some-group/some-project.git
Using LDAP: no
Using Omniauth: no
GitLab Shell
Version: 14.39.0
Repository storages:
- default: unix:/opt/gitlab/gitlab/tmp/sockets/gitaly.socket
GitLab Shell path: /opt/gitlab/gitlab-shell
Gitaly
- default Address: unix:/opt/gitlab/gitlab/tmp/sockets/gitaly.socket
- default Version: 17.7.1
- default Git Version: 2.47.1Results of GitLab application Check
The output of bundle exec rake gitlab:check RAILS_ENV=production:
Checking GitLab subtasks ...
Checking GitLab Shell ...
GitLab Shell: ... GitLab Shell version >= 14.39.0 ? ... OK (14.39.0)
Running /opt/gitlab/gitlab-shell/bin/gitlab-shell-check
Internal API available: OK
Redis available via internal API: OK
gitlab-shell self-check successful
Checking GitLab Shell ... Finished
Checking Gitaly ...
Gitaly: ... default ... OK
Checking Gitaly ... Finished
Checking Sidekiq ...
Sidekiq: ... Running? ... yes
Number of Sidekiq processes (cluster/worker) ... 1/5
Checking Sidekiq ... Finished
Checking Incoming Email ...
Incoming Email: ... Reply by email is disabled in config/gitlab.yml
Checking Incoming Email ... Finished
Checking LDAP ...
LDAP: ... LDAP is disabled in config/gitlab.yml
Checking LDAP ... Finished
Checking GitLab App ...
Database config exists? ... yes
Tables are truncated? ... skipped
All migrations up? ... no
Try fixing it:
sudo -u git -H bundle exec rake db:migrate RAILS_ENV=production
Please fix the error above and rerun the checks.
Database contains orphaned GroupMembers? ... no
GitLab config exists? ... yes
GitLab config up to date? ... yes
Cable config exists? ... yes
Resque config exists? ... yes
Log directory writable? ... yes
Tmp directory writable? ... yes
Uploads directory exists? ... yes
Uploads directory has correct permissions? ... yes
Uploads directory tmp has correct permissions? ... yes
Projects have namespace: ...
[redacted] ... yes
[...]
[redacted] ... yes
Redis version >= 6.2.14? ... yes
Ruby version >= 3.0.6 ? ... yes (3.2.5)
Git user has default SSH configuration? ... yes
Active users: ... 2
Is authorized keys file accessible? ... yes
GitLab configured to store new projects in hashed storage? ... yes
All projects are in hashed storage? ... yes
Checking GitLab App ... Finished
Checking GitLab subtasks ... FinishedEdited by Abulhair Saparov