Migrations failure: 'PG::UndefinedTable: ERROR: relation "design_management_repositories" does not exist'
Summary
In #4406 (closed), we found that migrations were failing:
2023-03-23 18:52:35 UTC -- Restoring database ... done
2023-03-23 18:52:35 +0000 -- Deleting backup and restore lock file
2023-03-23 18:52:55 UTC -- Restoring repositories ...
{"command":"restore","gl_project_path":"lost-and-found.wiki","level":"info","msg":"started restore","relative_path":"@groups/4e/07/4e07408562bedb8b60ce05c1decfe3ad16b72230967de01f640b7e4729b49fce.wiki.git","storage_name":"default","time":"2023-03-23T18:52:56.297Z"}
{"command":"restore","gl_project_path":"root/testproject1","level":"info","msg":"started restore","relative_path":"@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git","storage_name":"default","time":"2023-03-23T18:52:56.413Z"}
{"command":"restore","error":"manager: repository skipped: restore bundle: filesystem sink: get reader for \"@groups/4e/07/4e07408562bedb8b60ce05c1decfe3ad16b72230967de01f640b7e4729b49fce.wiki.bundle\": doesn't exist","gl_project_path":"lost-and-found.wiki","level":"warning","msg":"skipped restore","relative_path":"@groups/4e/07/4e07408562bedb8b60ce05c1decfe3ad16b72230967de01f640b7e4729b49fce.wiki.git","storage_name":"default","time":"2023-03-23T18:52:56.482Z"}
{"command":"restore","gl_project_path":"root/testproject1.wiki","level":"info","msg":"started restore","relative_path":"@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git","storage_name":"default","time":"2023-03-23T18:52:56.482Z"}
{"command":"restore","error":"manager: repository skipped: restore bundle: filesystem sink: get reader for \"@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.bundle\": doesn't exist","gl_project_path":"root/testproject1.wiki","level":"warning","msg":"skipped restore","relative_path":"@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git","storage_name":"default","time":"2023-03-23T18:52:56.520Z"}
{"command":"restore","gl_project_path":"root/testproject1","level":"info","msg":"completed restore","relative_path":"@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git","storage_name":"default","time":"2023-03-23T18:52:56.693Z"}
2023-03-23 18:52:56 +0000 -- Deleting backup and restore lock file
rake aborted!
ActiveRecord::StatementInvalid: PG::UndefinedTable: ERROR: relation "design_management_repositories" does not exist
LINE 8: WHERE a.attrelid = '"design_management_repositories"'::regc...
...
Caused by:
PG::UndefinedTable: ERROR: relation "design_management_repositories" does not exist
LINE 8: WHERE a.attrelid = '"design_management_repositories"'::regc...
^
/srv/gitlab/vendor/bundle/ruby/3.0.0/gems/activerecord-6.1.7.2/lib/active_record/connection_adapters/postgresql/database_statements.rb:19:in `exec'
...
git@k8s122-production-zpyn8u-toolbox-5bc9495bfb-sngt2:~$ BYPASS_SCHEMA_VERSION=1 /scripts/wait-for-deps
Checking: resque.yml, cable.yml
+ SUCCESS connecting to 'redis://k8s122-production-zpyn8u-redis-master.helm-charts-win.svc:6379' from resque.yml, through k8s122-production-zpyn8u-redis-master.helm-charts-win.svc
+ SUCCESS connecting to 'redis://k8s122-production-zpyn8u-redis-master.helm-charts-win.svc:6379' from cable.yml, through k8s122-production-zpyn8u-redis-master.helm-charts-win.svc
Checking: main
Database Schema - main (gitlabhq_production) - current: 20220314194149, codebase: 20230322151635
When manually running migrations, we see:
main: == 20221214204247 UserAchievementsForeignKeys: migrating ======================
main: -- transaction_open?()
main: -> 0.0000s
rake aborted!
StandardError: An error has occurred, all later migrations canceled:
PG::InvalidTextRepresentation: ERROR: malformed array literal: "user_id"
LINE 1: ...D "postgres_foreign_keys"."constrained_columns" = 'user_id' ...
^
DETAIL: Array value must start with "{" or dimension information.
This seems to be gitlab-org/gitlab#388928 (closed).