docker-compose setup, migrating from 14.10.5 to 15.0.5 failing in gitlab-rake db:migrate, 'failure to finalize'

Trying to update my docker-compose based GITLAB instance from 14.10.5 to 15.0.5, but the DB migration is failing.

NOTE: I did create a backup from my 14.10.5 instance before moving forward.

I looked up similar issues to see if I could fix it based on other peoples experience, but have not had luck.

This is what I am trying to follow: gitlab#360377 (closed)

My current attempt, related to what I learned was to set the auto_migrate environmental variable to false in docker-compose.yml

gitlab_rails['auto_migrate'] = false

This allowed gitlab to start, and I can access it via web browser.

The idea is then to execute 'gitlab-rake db:migrate' in a bash shell connected to the gitlab container. This is failing.

  1. start bash shell in GITLAB container (running 15.0.5)

docker-compose exec web /bin/bash

  1. Preparatory rake command used before db:migrate

Before db:migrate, the post I was following indicated to do the following:

gitlab-rake gitlab:background_migrations:finalize[ProjectNamespaces::BackfillProjectNamespaces,projects,id,'[null,"up"]']

which I did, via /usr/bin/gitlab-rake, and it indicated 'Done'

  1. /usr/bin/gitlab-rake db:migrate

The following displays when I try to '/usr/bin/gitlab-rake db:migrate' in the bash shell

/usr/bin/gitlab-rake db:migrate
== 20220213103859 RemoveIntegrationsType: migrating ===========================
rake aborted!
StandardError: An error has occurred, all later migrations canceled:

Gitlab::Database::BackgroundMigration::BatchedMigrationRunner::FailedToFinalize
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:76:in `finalize'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:139:in `finalize_batched_background_migration'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers.rb:962:in `ensure_batched_background_migration_is_finished'
/opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20220213103859_remove_integrations_type.rb:48:in `up'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:36:in `ddl_transaction'
/opt/gitlab/embedded/bin/bundle:23:in `load'
/opt/gitlab/embedded/bin/bundle:23:in `<main>'

Caused by:
Gitlab::Database::BackgroundMigration::BatchedMigrationRunner::FailedToFinalize: Gitlab::Database::BackgroundMigration::BatchedMigrationRunner::FailedToFinalize
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:76:in `finalize'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:139:in `finalize_batched_background_migration'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers.rb:962:in `ensure_batched_background_migration_is_finished'
/opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20220213103859_remove_integrations_type.rb:48:in `up'
/opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:36:in `ddl_transaction'
/opt/gitlab/embedded/bin/bundle:23:in `load'
/opt/gitlab/embedded/bin/bundle:23:in `<main>'
Tasks: TOP => db:migrate
(See full trace by running task with --trace)
  1. NOTE: Postgres version is 12.10 as seen in /admin page

GitLab15.0.5 GitLab Shell14.3.0 GitLab Workhorsev15.0.5 GitLab APIv4 GitLab KAS15.0.0 Ruby2.7.5p203 Rails6.1.4.7 PostgreSQL12.10 Redis6.2.6

  1. Output of postgres \d+ projects (in attachment in comment).

The output of postgres '\d+ projects' is in an attachment to this issue (see Activity).

Edited by Stan Hu