### Summary I'm not able to do a `sudo gitlab-ctl reconfigure` ### Steps to reproduce Upgrade from 18.8.5-ee.0 to 18.9.1-ee.0 ### What is the current *bug* behavior? Unable to complete the `sudo gitlab-ctl reconfigure` ### What is the expected *correct* behavior? Complete the `sudo gitlab-ctl reconfigure` without any issues ### Relevant logs <details> <summary> Relevant logs </summary> <pre> sudo cat /opt/gitlab/embedded/cookbooks/cache/cinc-stacktrace.out Generated at 2026-03-02 17:41:13 +0100 Mixlib::ShellOut::ShellCommandFailed: rails_migration[gitlab-rails] (gitlab::database_migrations line 51) had an error: Mixlib::ShellOut::ShellCommandFailed: bash_hide_env[migrate gitlab-rails database] (gitlab::database_migrations line 20) had an error: Mixlib::ShellOut::ShellCommandFailed: Expected process to exit with [0], but received '1' ---- Begin output of "bash" ---- STDOUT: Skipping Topology Service health check due to the cell being disabled Running db:migrate rake task main: == [advisory_lock_connection] object_id: 74360, pg_backend_pid: 2708 main: == 20260126165415 ValidateDiffNotePositionsNamespaceIdNotNullConstraint: migrating main: -- execute("SET statement_timeout TO 0") main: -> 0.0005s main: -- execute("ALTER TABLE diff_note_positions VALIDATE CONSTRAINT check_4c86140f48;") main: -- execute("RESET statement_timeout") main: == [advisory_lock_connection] object_id: 74360, pg_backend_pid: 2708 rake aborted! StandardError: An error has occurred, this and all later migrations canceled: PG::InFailedSqlTransaction: ERROR: current transaction is aborted, commands ignored until end of transaction block /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:33:in `ensure in disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:33:in `disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:119:in `validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:235:in `validate_not_null_constraint' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20260126165415_validate_diff_note_positions_namespace_id_not_null_constraint.rb:9:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:94:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:71:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:123:in `run_block' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:134:in `block in run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:229:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:131:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:129:in `run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:97:in `run' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:44:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:226:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:182:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:114:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: ActiveRecord::StatementInvalid: PG::InFailedSqlTransaction: ERROR: current transaction is aborted, commands ignored until end of transaction block /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:33:in `ensure in disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:33:in `disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:119:in `validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:235:in `validate_not_null_constraint' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20260126165415_validate_diff_note_positions_namespace_id_not_null_constraint.rb:9:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:94:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:71:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:123:in `run_block' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:134:in `block in run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:229:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:131:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:129:in `run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:97:in `run' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:44:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:226:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:182:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:114:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: PG::InFailedSqlTransaction: ERROR: current transaction is aborted, commands ignored until end of transaction block /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:33:in `ensure in disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:33:in `disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:119:in `validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:235:in `validate_not_null_constraint' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20260126165415_validate_diff_note_positions_namespace_id_not_null_constraint.rb:9:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:94:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:71:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:123:in `run_block' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:134:in `block in run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:229:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:131:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:129:in `run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:97:in `run' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:44:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:226:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:182:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:114:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: ActiveRecord::StatementInvalid: PG::CheckViolation: ERROR: check constraint "check_4c86140f48" of relation "diff_note_positions" is violated by some row /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:122:in `block in validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:31:in `disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:119:in `validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:235:in `validate_not_null_constraint' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20260126165415_validate_diff_note_positions_namespace_id_not_null_constraint.rb:9:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:94:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:71:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:123:in `run_block' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:134:in `block in run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:229:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:131:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:129:in `run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:97:in `run' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:44:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:226:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:182:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:114:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: PG::CheckViolation: ERROR: check constraint "check_4c86140f48" of relation "diff_note_positions" is violated by some row /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:122:in `block in validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:31:in `disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:119:in `validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:235:in `validate_not_null_constraint' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20260126165415_validate_diff_note_positions_namespace_id_not_null_constraint.rb:9:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:94:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:71:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:123:in `run_block' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:134:in `block in run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:229:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:131:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:129:in `run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:97:in `run' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:44:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:226:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:182:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:114:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Tasks: TOP => db:migrate (See full trace by running task with --trace) STDERR: ---- End output of "bash" ---- Ran "bash" returned 1 /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/mixlib-shellout-3.3.9/lib/mixlib/shellout.rb:304:in `invalid!' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/mixlib-shellout-3.3.9/lib/mixlib/shellout.rb:291:in `error!' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/mixlib-shellout-3.3.9/lib/mixlib/shellout/helper.rb:130:in `shell_out_compacted!' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/mixlib-shellout-3.3.9/lib/mixlib/shellout/helper.rb:54:in `shell_out!' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider/execute.rb:52:in `block (2 levels) in <class:Execute>' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/mixin/why_run.rb:51:in `add_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:293:in `converge_by' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider/execute.rb:50:in `block in <class:Execute>' (eval at /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:67):2:in `block in action_run' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:304:in `instance_eval' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:304:in `compile_and_converge_action' (eval at /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:67):2:in `action_run' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:245:in `run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource.rb:601:in `block in run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource.rb:628:in `with_umask' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource.rb:600:in `run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:74:in `run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:108:in `block in run_all_actions' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:108:in `each' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:108:in `run_all_actions' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection.rb:64:in `insert' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/dsl/declare_resource.rb:267:in `declare_resource' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/dsl/resources.rb:36:in `bash_hide_env' /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/resources/rails_migration.rb:20:in `block in class_from_file' (eval at /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:67):2:in `block in action_run' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:304:in `instance_eval' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:304:in `compile_and_converge_action' (eval at /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:67):2:in `action_run' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:245:in `run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource.rb:601:in `block in run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource.rb:628:in `with_umask' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource.rb:600:in `run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:74:in `run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:108:in `block in run_all_actions' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:108:in `each' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:108:in `run_all_actions' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:132:in `block in converge' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection/resource_list.rb:96:in `block in execute_each_resource' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection/stepable_iterator.rb:114:in `call_iterator_block' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection/stepable_iterator.rb:85:in `step' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection/stepable_iterator.rb:103:in `iterate' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection/stepable_iterator.rb:54:in `each_with_index' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection/resource_list.rb:94:in `execute_each_resource' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/forwardable-1.3.3/lib/forwardable.rb:240:in `execute_each_resource' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:130:in `converge' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/client.rb:860:in `block in converge' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/client.rb:855:in `catch' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/client.rb:855:in `converge' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/client.rb:879:in `converge_and_save' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/client.rb:298:in `run' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/application.rb:305:in `run_with_graceful_exit_option' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/application.rb:281:in `block in run_chef_client' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/local_mode.rb:42:in `with_server_connectivity' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/application.rb:264:in `run_chef_client' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/application/base.rb:354:in `run_application' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/application.rb:67:in `run' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-bin-18.3.0/bin/cinc-client:25:in `<top (required)>' /opt/gitlab/embedded/lib/ruby/site_ruby/3.3.0/rubygems.rb:319:in `load' /opt/gitlab/embedded/lib/ruby/site_ruby/3.3.0/rubygems.rb:319:in `activate_and_load_bin_path' /opt/gitlab/embedded/bin/cinc-client:25:in `<main>' >>>> Caused by Mixlib::ShellOut::ShellCommandFailed: Expected process to exit with [0], but received '1' ---- Begin output of "bash" ---- STDOUT: Skipping Topology Service health check due to the cell being disabled Running db:migrate rake task main: == [advisory_lock_connection] object_id: 74360, pg_backend_pid: 2708 main: == 20260126165415 ValidateDiffNotePositionsNamespaceIdNotNullConstraint: migrating main: -- execute("SET statement_timeout TO 0") main: -> 0.0005s main: -- execute("ALTER TABLE diff_note_positions VALIDATE CONSTRAINT check_4c86140f48;") main: -- execute("RESET statement_timeout") main: == [advisory_lock_connection] object_id: 74360, pg_backend_pid: 2708 rake aborted! StandardError: An error has occurred, this and all later migrations canceled: PG::InFailedSqlTransaction: ERROR: current transaction is aborted, commands ignored until end of transaction block /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:33:in `ensure in disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:33:in `disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:119:in `validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:235:in `validate_not_null_constraint' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20260126165415_validate_diff_note_positions_namespace_id_not_null_constraint.rb:9:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:94:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:71:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:123:in `run_block' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:134:in `block in run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:229:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:131:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:129:in `run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:97:in `run' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:44:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:226:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:182:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:114:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: ActiveRecord::StatementInvalid: PG::InFailedSqlTransaction: ERROR: current transaction is aborted, commands ignored until end of transaction block /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:33:in `ensure in disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:33:in `disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:119:in `validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:235:in `validate_not_null_constraint' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20260126165415_validate_diff_note_positions_namespace_id_not_null_constraint.rb:9:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:94:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:71:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:123:in `run_block' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:134:in `block in run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:229:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:131:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:129:in `run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:97:in `run' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:44:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:226:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:182:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:114:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: PG::InFailedSqlTransaction: ERROR: current transaction is aborted, commands ignored until end of transaction block /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:33:in `ensure in disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:33:in `disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:119:in `validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:235:in `validate_not_null_constraint' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20260126165415_validate_diff_note_positions_namespace_id_not_null_constraint.rb:9:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:94:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:71:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:123:in `run_block' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:134:in `block in run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:229:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:131:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:129:in `run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:97:in `run' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:44:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:226:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:182:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:114:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: ActiveRecord::StatementInvalid: PG::CheckViolation: ERROR: check constraint "check_4c86140f48" of relation "diff_note_positions" is violated by some row /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:122:in `block in validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:31:in `disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:119:in `validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:235:in `validate_not_null_constraint' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20260126165415_validate_diff_note_positions_namespace_id_not_null_constraint.rb:9:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:94:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:71:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:123:in `run_block' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:134:in `block in run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:229:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:131:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:129:in `run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:97:in `run' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:44:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:226:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:182:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:114:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: PG::CheckViolation: ERROR: check constraint "check_4c86140f48" of relation "diff_note_positions" is violated by some row /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:122:in `block in validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/timeout_helpers.rb:31:in `disable_statement_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:119:in `validate_check_constraint' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/constraints_helpers.rb:235:in `validate_not_null_constraint' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20260126165415_validate_diff_note_positions_namespace_id_not_null_constraint.rb:9:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:94:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:71:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:123:in `run_block' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:134:in `block in run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:229:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:131:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:129:in `run_block_with_lock_timeout' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/with_lock_retries.rb:97:in `run' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:44:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:226:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:182:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:114:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Tasks: TOP => db:migrate (See full trace by running task with --trace) STDERR: ---- End output of "bash" ---- Ran "bash" returned 1 /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/mixlib-shellout-3.3.9/lib/mixlib/shellout.rb:304:in `invalid!' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/mixlib-shellout-3.3.9/lib/mixlib/shellout.rb:291:in `error!' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/mixlib-shellout-3.3.9/lib/mixlib/shellout/helper.rb:130:in `shell_out_compacted!' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/mixlib-shellout-3.3.9/lib/mixlib/shellout/helper.rb:54:in `shell_out!' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider/execute.rb:52:in `block (2 levels) in <class:Execute>' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/mixin/why_run.rb:51:in `add_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:293:in `converge_by' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider/execute.rb:50:in `block in <class:Execute>' (eval at /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:67):2:in `block in action_run' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:304:in `instance_eval' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:304:in `compile_and_converge_action' (eval at /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:67):2:in `action_run' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:245:in `run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource.rb:601:in `block in run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource.rb:628:in `with_umask' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource.rb:600:in `run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:74:in `run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:108:in `block in run_all_actions' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:108:in `each' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:108:in `run_all_actions' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection.rb:64:in `insert' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/dsl/declare_resource.rb:267:in `declare_resource' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/dsl/resources.rb:36:in `bash_hide_env' /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/resources/rails_migration.rb:20:in `block in class_from_file' (eval at /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:67):2:in `block in action_run' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:304:in `instance_eval' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:304:in `compile_and_converge_action' (eval at /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:67):2:in `action_run' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/provider.rb:245:in `run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource.rb:601:in `block in run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource.rb:628:in `with_umask' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource.rb:600:in `run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:74:in `run_action' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:108:in `block in run_all_actions' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:108:in `each' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:108:in `run_all_actions' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:132:in `block in converge' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection/resource_list.rb:96:in `block in execute_each_resource' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection/stepable_iterator.rb:114:in `call_iterator_block' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection/stepable_iterator.rb:85:in `step' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection/stepable_iterator.rb:103:in `iterate' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection/stepable_iterator.rb:54:in `each_with_index' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/resource_collection/resource_list.rb:94:in `execute_each_resource' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/forwardable-1.3.3/lib/forwardable.rb:240:in `execute_each_resource' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/runner.rb:130:in `converge' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/client.rb:860:in `block in converge' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/client.rb:855:in `catch' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/client.rb:855:in `converge' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/client.rb:879:in `converge_and_save' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/client.rb:298:in `run' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/application.rb:305:in `run_with_graceful_exit_option' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/application.rb:281:in `block in run_chef_client' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/local_mode.rb:42:in `with_server_connectivity' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/application.rb:264:in `run_chef_client' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/application/base.rb:354:in `run_application' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-18.3.0/lib/chef/application.rb:67:in `run' /opt/gitlab/embedded/lib/ruby/gems/3.3.0/gems/chef-bin-18.3.0/bin/cinc-client:25:in `<top (required)>' /opt/gitlab/embedded/lib/ruby/site_ruby/3.3.0/rubygems.rb:319:in `load' /opt/gitlab/embedded/lib/ruby/site_ruby/3.3.0/rubygems.rb:319:in `activate_and_load_bin_path' /opt/gitlab/embedded/bin/cinc-client:25:in `<main>' </pre> </details> ### Details of package version <details> <summary>Provide the package version installation details</summary> <pre> sudo dpkg-query -l "gitlab-*" Desired=Unknown/Install/Remove/Purge/Hold | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad) ||/ Name Version Architecture Description +++-==============-============-============-============================================================ un gitlab-ce <none> <none> (no description available) ii gitlab-ee 18.9.1-ee.0 amd64 GitLab Enterprise Edition (including NGINX, Postgres, Redis) un gitlab-fips <none> <none> (no description available) </pre> </details> ### Environment details * Operating System: `debian 12.13` * Installation Target, remove incorrect values: * VM: `VMWare` * Installation Type, remove incorrect values: * Upgrade from version `18.8.5-ee.0` * Is there any other software running on the machine: `none` * Is this a single or multiple node installation? Single * Resources * CPU: `2` * Memory total: `8Go` ### Configuration details <details> <summary> Provide the relevant sections of `/etc/gitlab/gitlab.rb` </summary> <pre> pba@p1gitlab1b:~$ sudo grep -v -e '^#' -e '^$' /etc/gitlab/gitlab.rb external_url 'https://gitlab.dc.local/' gitlab_rails['gitlab_ssh_user'] = "git" postgresql['enable'] = true nginx['hide_server_tokens'] = "on" nginx['redirect_http_to_https'] = true nginx['ssl_certificate'] = "/etc/gitlab/ssl/gitlab.dc.local.crt" nginx['ssl_certificate_key'] = "/etc/gitlab/ssl/gitlab.dc.local.key" letsencrypt['enable'] = false prometheus_monitoring['enable'] = false node_exporter['enable'] = false alertmanager['enable'] = false pages_external_url 'https://pages.dc.local/' pages_nginx['enable'] = true pages_nginx['listen_https'] = true pages_nginx['listen_port'] = 8443 pages_nginx['namespace_in_path'] = false pages_nginx['redirect_http_to_https'] = false pages_nginx['ssl_certificate'] = "/etc/gitlab/ssl/pages.dc.local.crt" pages_nginx['ssl_certificate_key'] = "/etc/gitlab/ssl/pages.dc.local.key" </pre> </details>