PostgreSQL error when upgrading from 18.5.3 -> 18.6.1
<!--- Please read this! Before opening a new issue, make sure to search for keywords in the issues filtered by the "regression" or "type::bug" label: - https://gitlab.com/gitlab-org/gitlab/issues?label_name%5B%5D=regression - https://gitlab.com/gitlab-org/gitlab/issues?label_name%5B%5D=type::bug and verify the issue you're about to submit isn't a duplicate. ---> ### Summary The rails migration fails with a PG::CheckValidation error during an upgrade of gitlab-ee from 18.5.3 to 18.6.1 on Ubuntu 24.04.3. ### Steps to reproduce Upgrade gitlab-ee from 18.4.3 -\> 18.5.3 -\> 18.6.1 in sequence sudo gitlab-ctl reconfigure ### Example Project <!--If possible, please create an example project here on GitLab.com that exhibits the problematic behavior, and link to it here in the bug report. If you are using an older version of GitLab, this will also determine whether the bug is fixed in a more recent version.--> ### What is the current _bug_ behavior? ```log rails_migration[gitlab-rails] fails ``` ### What is the expected _correct_ behavior? <!--Describe what you should see instead.--> ### Relevant logs and/or screenshots <details> <summary>Click to expand</summary> ```null [2025-12-01T10:18:12+00:00] INFO: Started Cinc Zero at chefzero://localhost:1 with repository at /opt/gitlab/embedded (One version per cookbook) Cinc Client, version 18.3.0 Patents: https://www.chef.io/patents Infra Phase starting [2025-12-01T10:18:12+00:00] INFO: *** Cinc Client 18.3.0 *** [2025-12-01T10:18:12+00:00] INFO: Platform: x86_64-linux [2025-12-01T10:18:12+00:00] INFO: Cinc-client pid: 908216 [2025-12-01T10:18:14+00:00] INFO: Setting the run_list to ["recipe[gitlab-base]"] from CLI options [2025-12-01T10:18:14+00:00] INFO: Run List is [recipe[gitlab-base]] [2025-12-01T10:18:14+00:00] INFO: Run List expands to [gitlab-base] [2025-12-01T10:18:14+00:00] INFO: Starting Cinc Client Run for isvn [2025-12-01T10:18:14+00:00] INFO: Running start handlers [2025-12-01T10:18:14+00:00] INFO: Start handlers complete. Resolving cookbooks for run list: ["gitlab-base"] [2025-12-01T10:18:15+00:00] INFO: Loading cookbooks [gitlab-base@0.1.0, package@0.1.0, gitlab@0.0.1, gitlab-ee@0.0.1, runit@5.1.7, logrotate@0.1.0, postgresql@0.1.0, redis@0.1.0, monitoring@0.1.0, registry@0.1.0, mattermost@0.1.0, consul@0.1.0, gitaly@0.1.0, praefect@0.1.0, gitlab-kas@0.1.0, gitlab-pages@0.1.0, letsencrypt@0.1.0, nginx@0.1.0, patroni@0.1.0, pgbouncer@0.1.0, spamcheck@0.1.0, acme@4.1.8, crond@0.1.0] Synchronizing cookbooks: - gitlab-base (0.1.0) - package (0.1.0) - gitlab (0.0.1) - gitlab-ee (0.0.1) - runit (5.1.7) - logrotate (0.1.0) - redis (0.1.0) - postgresql (0.1.0) - registry (0.1.0) - monitoring (0.1.0) - mattermost (0.1.0) - consul (0.1.0) - gitaly (0.1.0) - praefect (0.1.0) - nginx (0.1.0) - gitlab-pages (0.1.0) - gitlab-kas (0.1.0) - letsencrypt (0.1.0) - patroni (0.1.0) - pgbouncer (0.1.0) - spamcheck (0.1.0) - crond (0.1.0) - acme (4.1.8) Installing cookbook gem dependencies: Compiling cookbooks... Loading Cinc Auditor profile files: Loading Cinc Auditor input files: Loading Cinc Auditor waiver files: [2025-12-01T10:18:16+00:00] INFO: Generating default secrets [2025-12-01T10:18:16+00:00] INFO: Generating /etc/gitlab/gitlab-secrets.json file Recipe: gitlab::default * directory[/etc/gitlab] action create (up to date) [2025-12-01T10:18:16+00:00] WARN: gitlab-rails does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: Selected systemd because /run/systemd/system/ exists [2025-12-01T10:18:17+00:00] WARN: gitlab-shell does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: gitlab-sshd does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: logrotate does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: logrotate does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: puma does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: gitlab-rails does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: gitlab-shell does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: gitlab-workhorse does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: gitlab-pages does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: gitlab-kas does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: gitaly does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: mailroom does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: gitaly does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: postgresql does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: postgresql does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: gitlab-kas does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: puma does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: sidekiq does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: gitlab-workhorse does not have a log_group or default logdir mode defined. Setting to 0700. [2025-12-01T10:18:17+00:00] WARN: registry does not have a log_group or default logdir mode defined. Setting to 0700. Converging 291 resources * directory[/etc/gitlab] action create (up to date) * directory[Create /var/opt/gitlab] action create (up to date) * directory[Create /var/log/gitlab] action create (up to date) * directory[/opt/gitlab/embedded/etc] action create (up to date) Recipe: package::web-server * account[Webserver user and group] action create * group[Webserver user and group] action create (up to date) * linux_user[Webserver user and group] action create (up to date) (up to date) Recipe: package::users * directory[/var/opt/gitlab] action create (up to date) * account[GitLab user and group] action create * group[GitLab user and group] action create (up to date) * linux_user[GitLab user and group] action create (up to date) (up to date) * template[/var/opt/gitlab/.gitconfig] action create (up to date) * directory[/var/opt/gitlab/.bundle] action create (up to date) Recipe: gitaly::git_data_dirs * storage_directory[/var/opt/gitlab/git-data/repositories] action create * ruby_block[directory resource: /var/opt/gitlab/git-data/repositories] action run (skipped due to not_if) (up to date) Recipe: gitlab::rails_pages_shared_path * storage_directory[/var/opt/gitlab/gitlab-rails/shared] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-rails/shared] action run (skipped due to not_if) (up to date) * storage_directory[/var/opt/gitlab/gitlab-rails/shared/pages] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-rails/shared/pages] action run (skipped due to not_if) (up to date) Recipe: gitlab::gitlab-rails * storage_directory[/var/opt/gitlab/gitlab-rails/shared/artifacts] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-rails/shared/artifacts] action run (skipped due to not_if) (up to date) * storage_directory[/var/opt/gitlab/gitlab-rails/shared/external-diffs] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-rails/shared/external-diffs] action run (skipped due to not_if) (up to date) * storage_directory[/var/opt/gitlab/gitlab-rails/shared/lfs-objects] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-rails/shared/lfs-objects] action run (skipped due to not_if) (up to date) * storage_directory[/var/opt/gitlab/gitlab-rails/shared/packages] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-rails/shared/packages] action run (skipped due to not_if) (up to date) * storage_directory[/var/opt/gitlab/gitlab-rails/shared/dependency_proxy] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-rails/shared/dependency_proxy] action run (skipped due to not_if) (up to date) * storage_directory[/var/opt/gitlab/gitlab-rails/shared/terraform_state] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-rails/shared/terraform_state] action run (skipped due to not_if) (up to date) * storage_directory[/var/opt/gitlab/gitlab-rails/shared/ci_secure_files] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-rails/shared/ci_secure_files] action run (skipped due to not_if) (up to date) * storage_directory[/var/opt/gitlab/gitlab-rails/shared/encrypted_settings] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-rails/shared/encrypted_settings] action run (skipped due to not_if) (up to date) * storage_directory[/var/opt/gitlab/gitlab-rails/uploads] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-rails/uploads] action run (skipped due to not_if) (up to date) * storage_directory[/var/opt/gitlab/gitlab-ci/builds] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-ci/builds] action run (skipped due to not_if) (up to date) * storage_directory[/var/opt/gitlab/gitlab-rails/shared/cache] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-rails/shared/cache] action run (skipped due to not_if) (up to date) * storage_directory[/var/opt/gitlab/gitlab-rails/shared/tmp] action create * ruby_block[directory resource: /var/opt/gitlab/gitlab-rails/shared/tmp] action run (skipped due to not_if) (up to date) * storage_directory[/opt/gitlab/embedded/service/gitlab-rails/public] action create (skipped due to only_if) * directory[create /var/opt/gitlab/gitlab-rails/etc] action create (up to date) * directory[create /opt/gitlab/etc/gitlab-rails] action create (up to date) * directory[create /var/opt/gitlab/gitlab-rails/working] action create (up to date) * directory[create /var/opt/gitlab/gitlab-rails/tmp] action create (up to date) * directory[create /var/opt/gitlab/gitlab-rails/upgrade-status] action create (up to date) * directory[/var/log/gitlab/gitlab-rails] action create (up to date) * storage_directory[/var/opt/gitlab/backups] action create * ruby_block[directory resource: /var/opt/gitlab/backups] action run (skipped due to not_if) (up to date) * directory[/var/opt/gitlab/gitlab-rails] action create (up to date) * directory[/var/opt/gitlab/gitlab-ci] action create (up to date) * file[/var/opt/gitlab/gitlab-rails/etc/gitlab-registry.key] action create[2025-12-01T10:18:18+00:00] WARN: only_if block for file[/var/opt/gitlab/gitlab-rails/etc/gitlab-registry.key] returned a string, did you mean to run a command? (up to date) * template[/opt/gitlab/etc/gitlab-rails-rc] action create (up to date) * file[/opt/gitlab/embedded/service/gitlab-rails/.secret] action delete (up to date) * file[/var/opt/gitlab/gitlab-rails/etc/secret] action delete (up to date) * templatesymlink[Create a database.yml and create a symlink to Rails root] action create * template[/var/opt/gitlab/gitlab-rails/etc/database.yml] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-rails/config/database.yml to /var/opt/gitlab/gitlab-rails/etc/database.yml] action create (up to date) (up to date) * templatesymlink[Create a clickhouse.yml and create a symlink to Rails root] action create * template[/var/opt/gitlab/gitlab-rails/etc/click_house.yml] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-rails/config/click_house.yml to /var/opt/gitlab/gitlab-rails/etc/click_house.yml] action create (up to date) (up to date) * templatesymlink[Create a secrets.yml and create a symlink to Rails root] action create * template[/var/opt/gitlab/gitlab-rails/etc/secrets.yml] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-rails/config/secrets.yml to /var/opt/gitlab/gitlab-rails/etc/secrets.yml] action create (up to date) (up to date) * templatesymlink[Create a resque.yml and create a symlink to Rails root] action create * template[/var/opt/gitlab/gitlab-rails/etc/resque.yml] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-rails/config/resque.yml to /var/opt/gitlab/gitlab-rails/etc/resque.yml] action create (up to date) (up to date) * templatesymlink[Create an override redis.yml and create a symlink to Rails root] action create * template[/var/opt/gitlab/gitlab-rails/etc/redis.yml] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-rails/config/redis.yml to /var/opt/gitlab/gitlab-rails/etc/redis.yml] action create (up to date) (up to date) * templatesymlink[Create a cable.yml and create a symlink to Rails root] action create * template[/var/opt/gitlab/gitlab-rails/etc/cable.yml] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-rails/config/cable.yml to /var/opt/gitlab/gitlab-rails/etc/cable.yml] action create (up to date) (up to date) * templatesymlink[Create a redis.cache.yml and create a symlink to Rails root] action delete * file[/var/opt/gitlab/gitlab-rails/etc/redis.cache.yml] action delete (up to date) * link[/opt/gitlab/embedded/service/gitlab-rails/config/redis.cache.yml] action delete (up to date) (up to date) * templatesymlink[Create a redis.queues.yml and create a symlink to Rails root] action delete * file[/var/opt/gitlab/gitlab-rails/etc/redis.queues.yml] action delete (up to date) * link[/opt/gitlab/embedded/service/gitlab-rails/config/redis.queues.yml] action delete (up to date) (up to date) * templatesymlink[Create a redis.shared_state.yml and create a symlink to Rails root] action delete * file[/var/opt/gitlab/gitlab-rails/etc/redis.shared_state.yml] action delete (up to date) * link[/opt/gitlab/embedded/service/gitlab-rails/config/redis.shared_state.yml] action delete (up to date) (up to date) * templatesymlink[Create a redis.trace_chunks.yml and create a symlink to Rails root] action delete * file[/var/opt/gitlab/gitlab-rails/etc/redis.trace_chunks.yml] action delete (up to date) * link[/opt/gitlab/embedded/service/gitlab-rails/config/redis.trace_chunks.yml] action delete (up to date) (up to date) * templatesymlink[Create a redis.rate_limiting.yml and create a symlink to Rails root] action delete * file[/var/opt/gitlab/gitlab-rails/etc/redis.rate_limiting.yml] action delete (up to date) * link[/opt/gitlab/embedded/service/gitlab-rails/config/redis.rate_limiting.yml] action delete (up to date) (up to date) * templatesymlink[Create a redis.sessions.yml and create a symlink to Rails root] action delete * file[/var/opt/gitlab/gitlab-rails/etc/redis.sessions.yml] action delete (up to date) * link[/opt/gitlab/embedded/service/gitlab-rails/config/redis.sessions.yml] action delete (up to date) (up to date) * templatesymlink[Create a redis.repository_cache.yml and create a symlink to Rails root] action delete * file[/var/opt/gitlab/gitlab-rails/etc/redis.repository_cache.yml] action delete (up to date) * link[/opt/gitlab/embedded/service/gitlab-rails/config/redis.repository_cache.yml] action delete (up to date) (up to date) * templatesymlink[Create a redis.cluster_rate_limiting.yml and create a symlink to Rails root] action delete * file[/var/opt/gitlab/gitlab-rails/etc/redis.cluster_rate_limiting.yml] action delete (up to date) * link[/opt/gitlab/embedded/service/gitlab-rails/config/redis.cluster_rate_limiting.yml] action delete (up to date) (up to date) * templatesymlink[Create a redis.workhorse.yml and create a symlink to Rails root] action delete * file[/var/opt/gitlab/gitlab-rails/etc/redis.workhorse.yml] action delete (up to date) * link[/opt/gitlab/embedded/service/gitlab-rails/config/redis.workhorse.yml] action delete (up to date) (up to date) * templatesymlink[Create a session_store.yml and create a symlink to Rails root] action create * template[/var/opt/gitlab/gitlab-rails/etc/session_store.yml] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-rails/config/session_store.yml to /var/opt/gitlab/gitlab-rails/etc/session_store.yml] action create (up to date) (up to date) * templatesymlink[Create a smtp_settings.rb and create a symlink to Rails root] action create * template[/var/opt/gitlab/gitlab-rails/etc/smtp_settings.rb] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-rails/config/initializers/smtp_settings.rb to /var/opt/gitlab/gitlab-rails/etc/smtp_settings.rb] action create (up to date) (up to date) * templatesymlink[Create a gitlab.yml and create a symlink to Rails root] action create * template[/var/opt/gitlab/gitlab-rails/etc/gitlab.yml] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-rails/config/gitlab.yml to /var/opt/gitlab/gitlab-rails/etc/gitlab.yml] action create (up to date) (up to date) * templatesymlink[Create a gitlab_workhorse_secret and create a symlink to Rails root] action create * template[/var/opt/gitlab/gitlab-rails/etc/gitlab_workhorse_secret] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-rails/.gitlab_workhorse_secret to /var/opt/gitlab/gitlab-rails/etc/gitlab_workhorse_secret] action create (up to date) (up to date) * templatesymlink[Create a gitlab_shell_secret and create a symlink to Rails root] action create * template[/var/opt/gitlab/gitlab-rails/etc/gitlab_shell_secret] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-rails/.gitlab_shell_secret to /var/opt/gitlab/gitlab-rails/etc/gitlab_shell_secret] action create (up to date) (up to date) * templatesymlink[Create a gitlab_incoming_email_secret and create a symlink to Rails root] action create (skipped due to only_if) * templatesymlink[Create a gitlab_service_desk_email_secret and create a symlink to Rails root] action create (skipped due to only_if) * templatesymlink[Create a gitlab_pages_secret and create a symlink to Rails root] action create[2025-12-01T10:18:18+00:00] WARN: only_if block for templatesymlink[Create a gitlab_pages_secret and create a symlink to Rails root] returned a string, did you mean to run a command? * template[/var/opt/gitlab/gitlab-rails/etc/gitlab_pages_secret] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-rails/.gitlab_pages_secret to /var/opt/gitlab/gitlab-rails/etc/gitlab_pages_secret] action create (up to date) (up to date) * templatesymlink[Create a gitlab_kas_secret and create a symlink to Rails root] action create[2025-12-01T10:18:18+00:00] WARN: only_if block for templatesymlink[Create a gitlab_kas_secret and create a symlink to Rails root] returned a string, did you mean to run a command? * template[/var/opt/gitlab/gitlab-rails/etc/gitlab_kas_secret] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-rails/.gitlab_kas_secret to /var/opt/gitlab/gitlab-rails/etc/gitlab_kas_secret] action create (up to date) (up to date) * link[/opt/gitlab/embedded/service/gitlab-rails/config/initializers/relative_url.rb] action delete (up to date) * file[/var/opt/gitlab/gitlab-rails/etc/relative_url.rb] action delete (up to date) * env_dir[/opt/gitlab/etc/gitlab-rails/env] action create * directory[/opt/gitlab/etc/gitlab-rails/env] action create (up to date) * file[/opt/gitlab/etc/gitlab-rails/env/HOME] action create (up to date) * file[/opt/gitlab/etc/gitlab-rails/env/RAILS_ENV] action create (up to date) * file[/opt/gitlab/etc/gitlab-rails/env/BUNDLE_GEMFILE] action create (up to date) * file[/opt/gitlab/etc/gitlab-rails/env/PUMA_WORKER_MAX_MEMORY] action create (up to date) * file[/opt/gitlab/etc/gitlab-rails/env/SIDEKIQ_MEMORY_KILLER_MAX_RSS] action create (up to date) * file[/opt/gitlab/etc/gitlab-rails/env/PATH] action create (up to date) * file[/opt/gitlab/etc/gitlab-rails/env/ICU_DATA] action create (up to date) * file[/opt/gitlab/etc/gitlab-rails/env/PYTHONPATH] action create (up to date) * file[/opt/gitlab/etc/gitlab-rails/env/EXECJS_RUNTIME] action create (up to date) * file[/opt/gitlab/etc/gitlab-rails/env/TZ] action create (up to date) * file[/opt/gitlab/etc/gitlab-rails/env/SSL_CERT_DIR] action create (up to date) * file[/opt/gitlab/etc/gitlab-rails/env/SSL_CERT_FILE] action create (up to date) * file[/opt/gitlab/etc/gitlab-rails/env/MALLOC_CONF] action create (up to date) (up to date) * link[/opt/gitlab/embedded/service/gitlab-rails/tmp] action create (up to date) * link[/opt/gitlab/embedded/service/gitlab-rails/public/uploads] action create (up to date) * link[/opt/gitlab/embedded/service/gitlab-rails/log] action create (up to date) * link[/var/log/gitlab/gitlab-rails/sidekiq.log] action delete (skipped due to only_if) * file[/opt/gitlab/embedded/service/gitlab-rails/db/structure.sql] action create (up to date) * remote_file[/var/opt/gitlab/gitlab-rails/VERSION] action create (up to date) * remote_file[/var/opt/gitlab/gitlab-rails/REVISION] action create (up to date) * version_file[Create version file for Rails] action create * file[/var/opt/gitlab/gitlab-rails/RUBY_VERSION] action create (up to date) (up to date) * execute[clear the gitlab-rails cache] action nothing (skipped due to action :nothing) * file[/var/opt/gitlab/gitlab-rails/config.ru] action delete (up to date) Recipe: gitlab::selinux * bash[Set proper security context on ssh files for selinux] action nothing (skipped due to action :nothing) Recipe: gitlab::add_trusted_certs * directory[/etc/gitlab/trusted-certs] action create (up to date) * directory[/opt/gitlab/embedded/ssl/certs] action create (up to date) * file[/opt/gitlab/embedded/ssl/certs/README] action create (up to date) * ruby_block[Move existing certs and link to /opt/gitlab/embedded/ssl/certs] action run (skipped due to only_if) Recipe: gitlab::default * service[create a temporary puma service] action nothing (skipped due to action :nothing) * service[create a temporary sidekiq service] action nothing (skipped due to action :nothing) * service[create a temporary mailroom service] action nothing (skipped due to action :nothing) Recipe: package::runit_systemd * directory[/usr/lib/systemd/system] action create (up to date) * template[/usr/lib/systemd/system/gitlab-runsvdir.service] action create (up to date) * file[/etc/systemd/system/default.target.wants/gitlab-runsvdir.service] action delete (up to date) * file[/etc/systemd/system/basic.target.wants/gitlab-runsvdir.service] action delete (up to date) * execute[systemctl daemon-reload] action nothing (skipped due to action :nothing) * execute[systemctl enable gitlab-runsvdir] action nothing (skipped due to action :nothing) * execute[systemctl start gitlab-runsvdir] action nothing (skipped due to action :nothing) Recipe: gitlab::gitlab-shell * storage_directory[/var/opt/gitlab/.ssh] action create * ruby_block[directory resource: /var/opt/gitlab/.ssh] action run (skipped due to not_if) (up to date) * directory[/var/opt/gitlab/gitlab-shell] action create (up to date) * directory[/var/log/gitlab/gitlab-shell] action create (up to date) * bash[generate gitlab-sshd host keys] action run (skipped due to only_if) * templatesymlink[Create a config.yml and create a symlink to Rails root] action create * template[/var/opt/gitlab/gitlab-shell/config.yml] action create (up to date) * link[Link /opt/gitlab/embedded/service/gitlab-shell/config.yml to /var/opt/gitlab/gitlab-shell/config.yml] action create (up to date) (up to date) * link[/opt/gitlab/embedded/service/gitlab-shell/.gitlab_shell_secret] action create (up to date) * file[/var/opt/gitlab/.ssh/authorized_keys] action create_if_missing (up to date) * env_dir[/opt/gitlab/etc/gitlab-sshd/env] action nothing (skipped due to action :nothing) * service[gitlab-sshd] action nothing (skipped due to action :nothing) * runit_service[gitlab-sshd] action disable * ruby_block[disable gitlab-sshd] action run (skipped due to only_if) (up to date) Recipe: package::sysctl * execute[reload all sysctl conf] action nothing (skipped due to action :nothing) Recipe: logrotate::folders_and_configs * directory[/var/opt/gitlab/logrotate] action create (up to date) * directory[/var/opt/gitlab/logrotate/logrotate.d] action create (up to date) * directory[/var/log/gitlab/logrotate] action create (up to date) * template[/var/opt/gitlab/logrotate/logrotate.conf] action create (up to date) * template[/var/opt/gitlab/logrotate/logrotate.d/nginx] action create (up to date) * template[/var/opt/gitlab/logrotate/logrotate.d/puma] action create (up to date) * template[/var/opt/gitlab/logrotate/logrotate.d/gitlab-rails] action create (up to date) * template[/var/opt/gitlab/logrotate/logrotate.d/gitlab-shell] action create (up to date) * template[/var/opt/gitlab/logrotate/logrotate.d/gitlab-workhorse] action create (up to date) * template[/var/opt/gitlab/logrotate/logrotate.d/gitlab-pages] action create (up to date) * template[/var/opt/gitlab/logrotate/logrotate.d/gitlab-kas] action create (up to date) * template[/var/opt/gitlab/logrotate/logrotate.d/gitaly] action create (up to date) * template[/var/opt/gitlab/logrotate/logrotate.d/mailroom] action create (up to date) Recipe: logrotate::enable * service[logrotate] action nothing (skipped due to action :nothing) * runit_service[logrotate] action enable * ruby_block[restart_service] action nothing (skipped due to action :nothing) * ruby_block[restart_log_service] action nothing (skipped due to action :nothing) * ruby_block[reload_log_service] action nothing (skipped due to action :nothing) * directory[/opt/gitlab/sv/logrotate] action create (up to date) * template[/opt/gitlab/sv/logrotate/run] action create (up to date) * directory[/opt/gitlab/sv/logrotate/log] action create (up to date) * directory[/opt/gitlab/sv/logrotate/log/main] action create (up to date) * template[/opt/gitlab/sv/logrotate/log/config] action create (up to date) * ruby_block[verify_chown_persisted_on_logrotate] action nothing (skipped due to action :nothing) * link[/var/log/gitlab/logrotate/config] action create (up to date) * template[/opt/gitlab/sv/logrotate/log/run] action create (up to date) * directory[/opt/gitlab/sv/logrotate/env] action create (up to date) * ruby_block[Delete unmanaged env files for logrotate service] action run (skipped due to only_if) * template[/opt/gitlab/sv/logrotate/check] action create (skipped due to only_if) * template[/opt/gitlab/sv/logrotate/finish] action create (skipped due to only_if) * directory[/opt/gitlab/sv/logrotate/control] action create (up to date) * template[/opt/gitlab/sv/logrotate/control/t] action create (up to date) * link[/opt/gitlab/init/logrotate] action create (up to date) * file[/opt/gitlab/sv/logrotate/down] action nothing (skipped due to action :nothing) * directory[/opt/gitlab/service] action create (up to date) * link[/opt/gitlab/service/logrotate] action create (up to date) * directory[/opt/gitlab/service/logrotate/supervise] action create (up to date) * directory[/opt/gitlab/service/logrotate/log/supervise] action create (up to date) * ruby_block[wait for logrotate service socket] action run (skipped due to not_if) * file[/var/log/gitlab/logrotate/current] action touch (skipped due to only_if) (up to date) Recipe: redis::enable * redis_service[redis] action create[2025-12-01T10:18:19+00:00] WARN: redis does not have a log_group or default logdir mode defined. Setting to 0700. * account[user and group for redis] action create * group[user and group for redis] action create (up to date) * linux_user[user and group for redis] action create (up to date) (up to date) * group[Socket group] action create (up to date) * directory[/var/opt/gitlab/redis] action create (up to date) * directory[/var/log/gitlab/redis] action create (up to date) * template[/var/opt/gitlab/redis/redis.conf] action create (up to date) * service[redis] action nothing (skipped due to action :nothing) * runit_service[redis] action enable * ruby_block[restart_service] action nothing (skipped due to action :nothing) * ruby_block[restart_log_service] action nothing (skipped due to action :nothing) * ruby_block[reload_log_service] action nothing (skipped due to action :nothing) * directory[/opt/gitlab/sv/redis] action create (up to date) * template[/opt/gitlab/sv/redis/run] action create (up to date) * directory[/opt/gitlab/sv/redis/log] action create (up to date) * directory[/opt/gitlab/sv/redis/log/main] action create (up to date) * template[/opt/gitlab/sv/redis/log/config] action create (up to date) * ruby_block[verify_chown_persisted_on_redis] action nothing (skipped due to action :nothing) * link[/var/log/gitlab/redis/config] action create (up to date) * template[/opt/gitlab/sv/redis/log/run] action create (up to date) * directory[/opt/gitlab/sv/redis/env] action create (up to date) * ruby_block[Delete unmanaged env files for redis service] action run (skipped due to only_if) * template[/opt/gitlab/sv/redis/check] action create (skipped due to only_if) * template[/opt/gitlab/sv/redis/finish] action create (skipped due to only_if) * directory[/opt/gitlab/sv/redis/control] action create (up to date) * link[/opt/gitlab/init/redis] action create (up to date) * file[/opt/gitlab/sv/redis/down] action nothing (skipped due to action :nothing) * directory[/opt/gitlab/service] action create (up to date) * link[/opt/gitlab/service/redis] action create (up to date) * directory[/opt/gitlab/service/redis/supervise] action create (up to date) * directory[/opt/gitlab/service/redis/log/supervise] action create (up to date) * ruby_block[wait for redis service socket] action run (skipped due to not_if) * file[/var/log/gitlab/redis/current] action touch (skipped due to only_if) (up to date) * ruby_block[warn pending redis restart] action run (skipped due to only_if) (up to date) * template[/opt/gitlab/etc/gitlab-redis-cli-rc] action create (up to date) Recipe: gitaly::enable * directory[/var/opt/gitlab/gitaly] action create (up to date) * directory[/var/opt/gitlab/gitaly/run] action create (up to date) * directory[/var/log/gitlab/gitaly] action create (up to date) * directory[/var/opt/gitlab/gitaly/internal_sockets] action delete (up to date) * env_dir[/opt/gitlab/etc/gitaly/env] action create * directory[/opt/gitlab/etc/gitaly/env] action create (up to date) * file[/opt/gitlab/etc/gitaly/env/HOME] action create (up to date) * file[/opt/gitlab/etc/gitaly/env/PATH] action create (up to date) * file[/opt/gitlab/etc/gitaly/env/TZ] action create (up to date) * file[/opt/gitlab/etc/gitaly/env/PYTHONPATH] action create (up to date) * file[/opt/gitlab/etc/gitaly/env/ICU_DATA] action create (up to date) * file[/opt/gitlab/etc/gitaly/env/SSL_CERT_DIR] action create (up to date) * file[/opt/gitlab/etc/gitaly/env/GITALY_PID_FILE] action create (up to date) * file[/opt/gitlab/etc/gitaly/env/WRAPPER_JSON_LOGGING] action create (up to date) * file[/opt/gitlab/etc/gitaly/env/GODEBUG] action create (up to date) * file[/opt/gitlab/etc/gitaly/env/MALLOC_CONF] action create (up to date) * file[/opt/gitlab/etc/gitaly/env/GITALY_COMMAND_SPAWN_MAX_PARALLEL] action create (up to date) (up to date) * file[/var/opt/gitlab/gitaly/.gitlab_secret] action create (up to date) * template[Create Gitaly config.toml] action create (up to date) * service[gitaly] action nothing (skipped due to action :nothing) * runit_service[gitaly] action enable * ruby_block[restart_service] action nothing (skipped due to action :nothing) * ruby_block[restart_log_service] action nothing (skipped due to action :nothing) * ruby_block[reload_log_service] action nothing (skipped due to action :nothing) * directory[/opt/gitlab/sv/gitaly] action create (up to date) * template[/opt/gitlab/sv/gitaly/run] action create (up to date) * directory[/opt/gitlab/sv/gitaly/log] action create (up to date) * directory[/opt/gitlab/sv/gitaly/log/main] action create (up to date) * template[/opt/gitlab/sv/gitaly/log/config] action create (up to date) * ruby_block[verify_chown_persisted_on_gitaly] action nothing (skipped due to action :nothing) * link[/var/log/gitlab/gitaly/config] action create (up to date) * template[/opt/gitlab/sv/gitaly/log/run] action create (up to date) * directory[/opt/gitlab/sv/gitaly/env] action create (up to date) * ruby_block[Delete unmanaged env files for gitaly service] action run (skipped due to only_if) * template[/opt/gitlab/sv/gitaly/check] action create (skipped due to only_if) * template[/opt/gitlab/sv/gitaly/finish] action create (skipped due to only_if) * directory[/opt/gitlab/sv/gitaly/control] action create (up to date) * link[/opt/gitlab/init/gitaly] action create (up to date) * file[/opt/gitlab/sv/gitaly/down] action nothing (skipped due to action :nothing) * directory[/opt/gitlab/service] action create (up to date) * link[/opt/gitlab/service/gitaly] action create (up to date) * directory[/opt/gitlab/service/gitaly/supervise] action create (up to date) * directory[/opt/gitlab/service/gitaly/log/supervise] action create (up to date) * ruby_block[wait for gitaly service socket] action run (skipped due to not_if) * file[/var/log/gitlab/gitaly/current] action touch (skipped due to only_if) (up to date) * version_file[Create version file for Gitaly] action create * file[/var/opt/gitlab/gitaly/VERSION] action create (up to date) (up to date) * consul_service[gitaly] action delete * file[/var/opt/gitlab/consul/config.d/gitaly-service.json] action delete (up to date) (up to date) Recipe: postgresql::bin * ruby_block[check_postgresql_version] action run (skipped due to not_if) * ruby_block[check_postgresql_version_is_deprecated] action run (skipped due to not_if) * ruby_block[Link postgresql bin files to the correct version] action run (skipped due to only_if) * template[/opt/gitlab/etc/gitlab-psql-rc] action create (up to date) Recipe: postgresql::user * account[Postgresql user and group] action create * group[Postgresql user and group] action create (up to date) * linux_user[Postgresql user and group] action create (up to date) (up to date) * directory[/var/opt/gitlab/postgresql] action create (up to date) * file[/var/opt/gitlab/postgresql/.profile] action create (up to date) Recipe: postgresql::sysctl * gitlab_sysctl[kernel.shmmax] action create * directory[create /etc/sysctl.d for kernel.shmmax] action create (up to date) * file[create /opt/gitlab/embedded/etc/90-omnibus-gitlab-kernel.shmmax.conf kernel.shmmax] action create (up to date) * link[/etc/sysctl.d/90-omnibus-gitlab-kernel.shmmax.conf] action create (up to date) * execute[load sysctl conf kernel.shmmax] action nothing (skipped due to action :nothing) (up to date) * gitlab_sysctl[kernel.shmall] action create * directory[create /etc/sysctl.d for kernel.shmall] action create (up to date) * file[create /opt/gitlab/embedded/etc/90-omnibus-gitlab-kernel.shmall.conf kernel.shmall] action create (up to date) * link[/etc/sysctl.d/90-omnibus-gitlab-kernel.shmall.conf] action create (up to date) * execute[load sysctl conf kernel.shmall] action nothing (skipped due to action :nothing) (up to date) * gitlab_sysctl[kernel.sem] action create * directory[create /etc/sysctl.d for kernel.sem] action create (up to date) * file[create /opt/gitlab/embedded/etc/90-omnibus-gitlab-kernel.sem.conf kernel.sem] action create (up to date) * link[/etc/sysctl.d/90-omnibus-gitlab-kernel.sem.conf] action create (up to date) * execute[load sysctl conf kernel.sem] action nothing (skipped due to action :nothing) (up to date) Recipe: postgresql::enable * directory[/var/opt/gitlab/postgresql] action create (up to date) * directory[/var/opt/gitlab/postgresql/data] action create (up to date) * directory[/var/opt/gitlab/postgresql/data] action create (up to date) * directory[/var/log/gitlab/postgresql] action create (up to date) * execute[/opt/gitlab/embedded/bin/initdb -D /var/opt/gitlab/postgresql/data -E UTF8] action run (skipped due to not_if) * file[/var/opt/gitlab/postgresql/data/server.crt] action create (up to date) * file[/var/opt/gitlab/postgresql/data/server.key] action create (up to date) * postgresql_config[gitlab] action create * template[/var/opt/gitlab/postgresql/data/postgresql.conf] action create (up to date) * template[/var/opt/gitlab/postgresql/data/runtime.conf] action create (up to date) * template[/var/opt/gitlab/postgresql/data/pg_hba.conf] action create (up to date) * template[/var/opt/gitlab/postgresql/data/pg_ident.conf] action create (up to date) (up to date) Recipe: postgresql::standalone * service[postgresql] action nothing (skipped due to action :nothing) * runit_service[postgresql] action enable * ruby_block[restart_service] action nothing (skipped due to action :nothing) * ruby_block[restart_log_service] action nothing (skipped due to action :nothing) * ruby_block[reload_log_service] action nothing (skipped due to action :nothing) * directory[/opt/gitlab/sv/postgresql] action create (up to date) * template[/opt/gitlab/sv/postgresql/run] action create (up to date) * directory[/opt/gitlab/sv/postgresql/log] action create (up to date) * directory[/opt/gitlab/sv/postgresql/log/main] action create (up to date) * template[/opt/gitlab/sv/postgresql/log/config] action create (up to date) * ruby_block[verify_chown_persisted_on_postgresql] action nothing (skipped due to action :nothing) * link[/var/log/gitlab/postgresql/config] action create (up to date) * template[/opt/gitlab/sv/postgresql/log/run] action create (up to date) * directory[/opt/gitlab/sv/postgresql/env] action create (up to date) * ruby_block[Delete unmanaged env files for postgresql service] action run (skipped due to only_if) * template[/opt/gitlab/sv/postgresql/check] action create (skipped due to only_if) * template[/opt/gitlab/sv/postgresql/finish] action create (skipped due to only_if) * directory[/opt/gitlab/sv/postgresql/control] action create (up to date) * template[/opt/gitlab/sv/postgresql/control/t] action create (up to date) * link[/opt/gitlab/init/postgresql] action create (up to date) * file[/opt/gitlab/sv/postgresql/down] action nothing (skipped due to action :nothing) * directory[/opt/gitlab/service] action create (up to date) * link[/opt/gitlab/service/postgresql] action create (up to date) * directory[/opt/gitlab/service/postgresql/supervise] action create (up to date) * directory[/opt/gitlab/service/postgresql/log/supervise] action create (up to date) * ruby_block[wait for postgresql service socket] action run (skipped due to not_if) * file[/opt/gitlab/service/postgresql/supervise/ok] action touch (skipped due to only_if) * file[/opt/gitlab/service/postgresql/log/supervise/ok] action touch (skipped due to only_if) * file[/opt/gitlab/service/postgresql/supervise/status] action touch (skipped due to only_if) * file[/opt/gitlab/service/postgresql/log/supervise/status] action touch (skipped due to only_if) * file[/opt/gitlab/service/postgresql/supervise/control] action touch (skipped due to only_if) * file[/opt/gitlab/service/postgresql/log/supervise/control] action touch (skipped due to only_if) * file[/var/log/gitlab/postgresql/current] action touch (skipped due to only_if) (up to date) * database_objects[postgresql] action create * postgresql_user[gitlab] action create * execute[create gitlab postgresql user] action run (skipped due to not_if) (up to date) * postgresql_user[gitlab_replicator] action create * execute[create gitlab_replicator postgresql user] action run (skipped due to not_if) * execute[set options for gitlab_replicator postgresql user] action run (skipped due to not_if) (up to date) * postgresql_database[gitlabhq_production] action create * execute[create database gitlabhq_production] action run (skipped due to not_if) (up to date) * postgresql_extension[amcheck] action enable * postgresql_query[enable amcheck extension] action run (skipped due to only_if) (up to date) * postgresql_extension[pg_trgm] action enable * postgresql_query[enable pg_trgm extension] action run (skipped due to only_if) (up to date) * postgresql_extension[btree_gist] action enable * postgresql_query[enable btree_gist extension] action run (skipped due to only_if) (up to date) * postgresql_database[gitlabhq_production] action create * execute[create database gitlabhq_production] action run (skipped due to not_if) (up to date) * postgresql_extension[amcheck] action enable * postgresql_query[enable amcheck extension] action run (skipped due to only_if) (up to date) * postgresql_extension[pg_trgm] action enable * postgresql_query[enable pg_trgm extension] action run (skipped due to only_if) (up to date) * postgresql_extension[btree_gist] action enable * postgresql_query[enable btree_gist extension] action run (skipped due to only_if) (up to date) (up to date) Recipe: registry::database_objects * registry_database_objects[default] action create * postgresql_user[registry] action create * execute[create registry postgresql user] action run (skipped due to not_if) (up to date) * postgresql_database[registry] action create * execute[create database registry] action run (skipped due to not_if) (up to date) (up to date) Recipe: postgresql::standalone * ruby_block[warn registry auto_create is disabled] action run (skipped due to only_if) * version_file[Create version file for PostgreSQL] action create * file[/var/opt/gitlab/postgresql/VERSION] action create (up to date) (up to date) * ruby_block[warn pending postgresql restart] action run (skipped due to only_if) * execute[reload postgresql] action nothing (skipped due to action :nothing) * execute[start postgresql] action nothing (skipped due to action :nothing) Recipe: praefect::disable * service[praefect] action nothing (skipped due to action :nothing) * runit_service[praefect] action disable * ruby_block[disable praefect] action run (skipped due to only_if) (up to date) * consul_service[praefect] action delete * file[/var/opt/gitlab/consul/config.d/praefect-service.json] action delete (up to date) (up to date) Recipe: gitlab-kas::enable * directory[/var/opt/gitlab/gitlab-kas] action create (up to date) * directory[/opt/gitlab/etc/gitlab-kas] action create (up to date) * directory[/var/log/gitlab/gitlab-kas] action create (up to date) * version_file[Create version file for Gitlab KAS] action create * file[/var/opt/gitlab/gitlab-kas/VERSION] action create (up to date) (up to date) * file[/var/opt/gitlab/gitlab-kas/authentication_secret_file] action create (up to date) * file[/var/opt/gitlab/gitlab-kas/private_api_authentication_secret_file] action create (up to date) * file[/var/opt/gitlab/gitlab-kas/websocket_token_secret_file] action create (up to date) * file[/var/opt/gitlab/gitlab-kas/redis_password_file] action create (skipped due to only_if) * file[/var/opt/gitlab/gitlab-kas/redis_sentinels_password_file] action create (skipped due to only_if) * template[/var/opt/gitlab/gitlab-kas/gitlab-kas-config.yml] action create (up to date) * env_dir[/opt/gitlab/etc/gitlab-kas/env] action create * directory[/opt/gitlab/etc/gitlab-kas/env] action create (up to date) * file[/opt/gitlab/etc/gitlab-kas/env/SSL_CERT_DIR] action create (up to date) * file[/opt/gitlab/etc/gitlab-kas/env/GODEBUG] action create (up to date) (up to date) * service[gitlab-kas] action nothing (skipped due to action :nothing) * runit_service[gitlab-kas] action enable * ruby_block[restart_service] action nothing (skipped due to action :nothing) * ruby_block[restart_log_service] action nothing (skipped due to action :nothing) * ruby_block[reload_log_service] action nothing (skipped due to action :nothing) * directory[/opt/gitlab/sv/gitlab-kas] action create (up to date) * template[/opt/gitlab/sv/gitlab-kas/run] action create (up to date) * directory[/opt/gitlab/sv/gitlab-kas/log] action create (up to date) * directory[/opt/gitlab/sv/gitlab-kas/log/main] action create (up to date) * template[/opt/gitlab/sv/gitlab-kas/log/config] action create (up to date) * ruby_block[verify_chown_persisted_on_gitlab-kas] action nothing (skipped due to action :nothing) * link[/var/log/gitlab/gitlab-kas/config] action create (up to date) * template[/opt/gitlab/sv/gitlab-kas/log/run] action create (up to date) * directory[/opt/gitlab/sv/gitlab-kas/env] action create (up to date) * ruby_block[Delete unmanaged env files for gitlab-kas service] action run (skipped due to only_if) * template[/opt/gitlab/sv/gitlab-kas/check] action create (skipped due to only_if) * template[/opt/gitlab/sv/gitlab-kas/finish] action create (skipped due to only_if) * directory[/opt/gitlab/sv/gitlab-kas/control] action create (up to date) * link[/opt/gitlab/init/gitlab-kas] action create (up to date) * file[/opt/gitlab/sv/gitlab-kas/down] action nothing (skipped due to action :nothing) * directory[/opt/gitlab/service] action create (up to date) * link[/opt/gitlab/service/gitlab-kas] action create (up to date) * directory[/opt/gitlab/service/gitlab-kas/supervise] action create (up to date) * directory[/opt/gitlab/service/gitlab-kas/log/supervise] action create (up to date) * ruby_block[wait for gitlab-kas service socket] action run (skipped due to not_if) * file[/var/log/gitlab/gitlab-kas/current] action touch (skipped due to only_if) (up to date) Recipe: gitlab::database_migrations * ruby_block[check remote PG version] action nothing (skipped due to action :nothing) * rails_migration[gitlab-rails] action run[2025-12-01T10:18:22+00:00] WARN: gitlab-rails does not have a log_group or default logdir mode defined. Setting to 0700. * bash_hide_env[migrate gitlab-rails database] action run [execute] Skipping Topology Service health check due to the cell being disabled Running db:migrate rake task main: == [advisory_lock_connection] object_id: 77640, pg_backend_pid: 908710 main: == 20251029020542 FinalizeBackfillPartitionedProjectDailyStatistics: migrating main: -- transaction_open?(nil) main: -> 0.0001s main: -- transaction_open?(nil) main: -> 0.0000s main: == [advisory_lock_connection] object_id: 77640, pg_backend_pid: 908710 rake aborted! StandardError: An error has occurred, all later migrations canceled: PG::CheckViolation: ERROR: no partition of relation "project_daily_statistics_b8088ecbd2" found for row DETAIL: Partition key of the failing row contains (date) = (2025-08-01). /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:150:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:248:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:140:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:96:in `method_missing' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/partitioning_migration_helpers/bulk_copy.rb:31:in `copy_relation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:22:in `block in perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:126:in `block (2 levels) in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/batch/metrics.rb:21:in `instrument_operation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:125:in `block in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block (2 levels) in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `step' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `each_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:124:in `each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:21:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:73:in `execute_batched_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:62:in `execute_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:50:in `execute_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:25:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:30:in `run_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:146:in `run_migration_while' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:80:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:161:in `block (2 levels) in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzers/base.rb:52:in `with_suppressed' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:160:in `block in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/reestablished_connection_stack.rb:21:in `with_restored_connection_stack' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:159:in `finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:252:in `ensure_batched_background_migration_is_finished' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20251029020542_finalize_backfill_partitioned_project_daily_statistics.rb:11:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:83:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:40:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:46:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:191:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:158:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:102:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: ActiveRecord::StatementInvalid: PG::CheckViolation: ERROR: no partition of relation "project_daily_statistics_b8088ecbd2" found for row DETAIL: Partition key of the failing row contains (date) = (2025-08-01). /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:150:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:248:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:140:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:96:in `method_missing' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/partitioning_migration_helpers/bulk_copy.rb:31:in `copy_relation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:22:in `block in perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:126:in `block (2 levels) in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/batch/metrics.rb:21:in `instrument_operation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:125:in `block in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block (2 levels) in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `step' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `each_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:124:in `each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:21:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:73:in `execute_batched_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:62:in `execute_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:50:in `execute_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:25:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:30:in `run_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:146:in `run_migration_while' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:80:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:161:in `block (2 levels) in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzers/base.rb:52:in `with_suppressed' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:160:in `block in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/reestablished_connection_stack.rb:21:in `with_restored_connection_stack' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:159:in `finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:252:in `ensure_batched_background_migration_is_finished' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20251029020542_finalize_backfill_partitioned_project_daily_statistics.rb:11:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:83:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:40:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:46:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:191:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:158:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:102:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: PG::CheckViolation: ERROR: no partition of relation "project_daily_statistics_b8088ecbd2" found for row DETAIL: Partition key of the failing row contains (date) = (2025-08-01). /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:150:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:248:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:140:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:96:in `method_missing' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/partitioning_migration_helpers/bulk_copy.rb:31:in `copy_relation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:22:in `block in perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:126:in `block (2 levels) in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/batch/metrics.rb:21:in `instrument_operation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:125:in `block in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block (2 levels) in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `step' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `each_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:124:in `each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:21:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:73:in `execute_batched_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:62:in `execute_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:50:in `execute_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:25:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:30:in `run_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:146:in `run_migration_while' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:80:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:161:in `block (2 levels) in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzers/base.rb:52:in `with_suppressed' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:160:in `block in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/reestablished_connection_stack.rb:21:in `with_restored_connection_stack' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:159:in `finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:252:in `ensure_batched_background_migration_is_finished' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20251029020542_finalize_backfill_partitioned_project_daily_statistics.rb:11:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:83:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:40:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:46:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:191:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:158:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:102:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Tasks: TOP => db:migrate (See full trace by running task with --trace) ================================================================================ [31mError executing action `run` on resource 'bash_hide_env[migrate gitlab-rails database]'[0m ================================================================================ Mixlib::ShellOut::ShellCommandFailed ------------------------------------ Expected process to exit with [0], but received '1' ---- Begin output of "bash" ---- STDOUT: Skipping Topology Service health check due to the cell being disabled Running db:migrate rake task main: == [advisory_lock_connection] object_id: 77640, pg_backend_pid: 908710 main: == 20251029020542 FinalizeBackfillPartitionedProjectDailyStatistics: migrating main: -- transaction_open?(nil) main: -> 0.0001s main: -- transaction_open?(nil) main: -> 0.0000s main: == [advisory_lock_connection] object_id: 77640, pg_backend_pid: 908710 rake aborted! StandardError: An error has occurred, all later migrations canceled: PG::CheckViolation: ERROR: no partition of relation "project_daily_statistics_b8088ecbd2" found for row DETAIL: Partition key of the failing row contains (date) = (2025-08-01). /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:150:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:248:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:140:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:96:in `method_missing' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/partitioning_migration_helpers/bulk_copy.rb:31:in `copy_relation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:22:in `block in perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:126:in `block (2 levels) in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/batch/metrics.rb:21:in `instrument_operation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:125:in `block in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block (2 levels) in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `step' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `each_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:124:in `each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:21:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:73:in `execute_batched_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:62:in `execute_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:50:in `execute_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:25:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:30:in `run_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:146:in `run_migration_while' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:80:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:161:in `block (2 levels) in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzers/base.rb:52:in `with_suppressed' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:160:in `block in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/reestablished_connection_stack.rb:21:in `with_restored_connection_stack' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:159:in `finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:252:in `ensure_batched_background_migration_is_finished' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20251029020542_finalize_backfill_partitioned_project_daily_statistics.rb:11:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:83:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:40:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:46:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:191:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:158:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:102:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: ActiveRecord::StatementInvalid: PG::CheckViolation: ERROR: no partition of relation "project_daily_statistics_b8088ecbd2" found for row DETAIL: Partition key of the failing row contains (date) = (2025-08-01). /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:150:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:248:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:140:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:96:in `method_missing' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/partitioning_migration_helpers/bulk_copy.rb:31:in `copy_relation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:22:in `block in perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:126:in `block (2 levels) in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/batch/metrics.rb:21:in `instrument_operation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:125:in `block in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block (2 levels) in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `step' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `each_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:124:in `each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:21:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:73:in `execute_batched_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:62:in `execute_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:50:in `execute_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:25:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:30:in `run_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:146:in `run_migration_while' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:80:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:161:in `block (2 levels) in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzers/base.rb:52:in `with_suppressed' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:160:in `block in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/reestablished_connection_stack.rb:21:in `with_restored_connection_stack' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:159:in `finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:252:in `ensure_batched_background_migration_is_finished' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20251029020542_finalize_backfill_partitioned_project_daily_statistics.rb:11:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:83:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:40:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:46:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:191:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:158:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:102:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: PG::CheckViolation: ERROR: no partition of relation "project_daily_statistics_b8088ecbd2" found for row DETAIL: Partition key of the failing row contains (date) = (2025-08-01). /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:150:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:248:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:140:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:96:in `method_missing' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/partitioning_migration_helpers/bulk_copy.rb:31:in `copy_relation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:22:in `block in perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:126:in `block (2 levels) in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/batch/metrics.rb:21:in `instrument_operation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:125:in `block in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block (2 levels) in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `step' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `each_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:124:in `each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:21:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:73:in `execute_batched_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:62:in `execute_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:50:in `execute_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:25:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:30:in `run_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:146:in `run_migration_while' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:80:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:161:in `block (2 levels) in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzers/base.rb:52:in `with_suppressed' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:160:in `block in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/reestablished_connection_stack.rb:21:in `with_restored_connection_stack' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:159:in `finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:252:in `ensure_batched_background_migration_is_finished' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20251029020542_finalize_backfill_partitioned_project_daily_statistics.rb:11:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:83:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:40:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:46:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:191:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:158:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:102:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Tasks: TOP => db:migrate (See full trace by running task with --trace) STDERR: ---- End output of "bash" ---- Ran "bash" returned 1 Cookbook Trace: (most recent call first) ---------------------------------------- /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/resources/rails_migration.rb:20:in `block in class_from_file' Resource Declaration: --------------------- # In /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/resources/rails_migration.rb 20: bash_hide_env "migrate #{new_resource.name} database" do 21: code <<-EOH 22: set -e 23: log_file="#{logging_settings[:log_directory]}/#{new_resource.logfile_prefix}-$(date +%Y-%m-%d-%H-%M-%S).log" 24: umask 077 25: /opt/gitlab/bin/gitlab-rake #{new_resource.rake_task} 2>& 1 | tee ${log_file} 26: STATUS=${PIPESTATUS[0]} 27: chown #{account_helper.gitlab_user}:#{account_helper.gitlab_group} ${log_file} 28: echo $STATUS > #{new_resource.helper.db_migrate_status_file} 29: exit $STATUS 30: EOH 31: 32: environment new_resource.environment if new_resource.property_is_set?(:environment) 33: new_resource.dependent_services.each do |svc| 34: notifies :restart, svc, :immediately 35: end 36: 37: not_if { new_resource.helper.migrated? } 38: sensitive false 39: end 40: end Compiled Resource: ------------------ # Declared in /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/resources/rails_migration.rb:20:in `block in class_from_file' bash_hide_env("migrate gitlab-rails database") do action [:run] default_guard_interpreter :default interpreter "bash" declared_type :bash_hide_env cookbook_name "gitlab" recipe_name "database_migrations" code " set -e\n log_file=\"/var/log/gitlab/gitlab-rails/gitlab-rails-db-migrate-$(date +%Y-%m-%d-%H-%M-%S).log\"\n umask 077\n /opt/gitlab/bin/gitlab-rake gitlab:db:configure 2>& 1 | tee ${log_file}\n STATUS=${PIPESTATUS[0]}\n chown git:git ${log_file}\n echo $STATUS > /var/opt/gitlab/gitlab-rails/upgrade-status/db-migrate-c6697a9cd49e1cfa45cc31b1ecdb90ae-6e920e06fbf\n exit $STATUS\n" environment "*sensitive value suppressed*" not_if { #code block } end System Info: ------------ chef_version=18.3.0 platform=ubuntu platform_version=24.04 ruby=ruby 3.2.8 (2025-03-26 revision 13f495dc2c) [x86_64-linux] program_name=/opt/gitlab/embedded/bin/cinc-client executable=/opt/gitlab/embedded/bin/cinc-client ================================================================================ [31mError executing action `run` on resource 'rails_migration[gitlab-rails]'[0m ================================================================================ Mixlib::ShellOut::ShellCommandFailed ------------------------------------ bash_hide_env[migrate gitlab-rails database] (gitlab::database_migrations line 20) had an error: Mixlib::ShellOut::ShellCommandFailed: Expected process to exit with [0], but received '1' ---- Begin output of "bash" ---- STDOUT: Skipping Topology Service health check due to the cell being disabled Running db:migrate rake task main: == [advisory_lock_connection] object_id: 77640, pg_backend_pid: 908710 main: == 20251029020542 FinalizeBackfillPartitionedProjectDailyStatistics: migrating main: -- transaction_open?(nil) main: -> 0.0001s main: -- transaction_open?(nil) main: -> 0.0000s main: == [advisory_lock_connection] object_id: 77640, pg_backend_pid: 908710 rake aborted! StandardError: An error has occurred, all later migrations canceled: PG::CheckViolation: ERROR: no partition of relation "project_daily_statistics_b8088ecbd2" found for row DETAIL: Partition key of the failing row contains (date) = (2025-08-01). /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:150:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:248:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:140:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:96:in `method_missing' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/partitioning_migration_helpers/bulk_copy.rb:31:in `copy_relation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:22:in `block in perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:126:in `block (2 levels) in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/batch/metrics.rb:21:in `instrument_operation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:125:in `block in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block (2 levels) in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `step' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `each_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:124:in `each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:21:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:73:in `execute_batched_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:62:in `execute_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:50:in `execute_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:25:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:30:in `run_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:146:in `run_migration_while' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:80:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:161:in `block (2 levels) in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzers/base.rb:52:in `with_suppressed' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:160:in `block in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/reestablished_connection_stack.rb:21:in `with_restored_connection_stack' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:159:in `finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:252:in `ensure_batched_background_migration_is_finished' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20251029020542_finalize_backfill_partitioned_project_daily_statistics.rb:11:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:83:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:40:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:46:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:191:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:158:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:102:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: ActiveRecord::StatementInvalid: PG::CheckViolation: ERROR: no partition of relation "project_daily_statistics_b8088ecbd2" found for row DETAIL: Partition key of the failing row contains (date) = (2025-08-01). /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:150:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:248:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:140:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:96:in `method_missing' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/partitioning_migration_helpers/bulk_copy.rb:31:in `copy_relation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:22:in `block in perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:126:in `block (2 levels) in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/batch/metrics.rb:21:in `instrument_operation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:125:in `block in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block (2 levels) in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `step' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `each_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:124:in `each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:21:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:73:in `execute_batched_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:62:in `execute_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:50:in `execute_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:25:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:30:in `run_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:146:in `run_migration_while' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:80:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:161:in `block (2 levels) in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzers/base.rb:52:in `with_suppressed' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:160:in `block in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/reestablished_connection_stack.rb:21:in `with_restored_connection_stack' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:159:in `finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:252:in `ensure_batched_background_migration_is_finished' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20251029020542_finalize_backfill_partitioned_project_daily_statistics.rb:11:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:83:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:40:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:46:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:191:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:158:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:102:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: PG::CheckViolation: ERROR: no partition of relation "project_daily_statistics_b8088ecbd2" found for row DETAIL: Partition key of the failing row contains (date) = (2025-08-01). /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:150:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:248:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:140:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:96:in `method_missing' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/partitioning_migration_helpers/bulk_copy.rb:31:in `copy_relation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:22:in `block in perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:126:in `block (2 levels) in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/batch/metrics.rb:21:in `instrument_operation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:125:in `block in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block (2 levels) in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `step' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `each_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:124:in `each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:21:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:73:in `execute_batched_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:62:in `execute_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:50:in `execute_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:25:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:30:in `run_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:146:in `run_migration_while' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:80:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:161:in `block (2 levels) in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzers/base.rb:52:in `with_suppressed' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:160:in `block in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/reestablished_connection_stack.rb:21:in `with_restored_connection_stack' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:159:in `finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:252:in `ensure_batched_background_migration_is_finished' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20251029020542_finalize_backfill_partitioned_project_daily_statistics.rb:11:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:83:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:40:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:46:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:191:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:158:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:102:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Tasks: TOP => db:migrate (See full trace by running task with --trace) STDERR: ---- End output of "bash" ---- Ran "bash" returned 1 Cookbook Trace: (most recent call first) ---------------------------------------- /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/resources/rails_migration.rb:20:in `block in class_from_file' Resource Declaration: --------------------- # In /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/database_migrations.rb 51: rails_migration "gitlab-rails" do 52: rake_task 'gitlab:db:configure' 53: logfile_prefix 'gitlab-rails-db-migrate' 54: helper migration_helper 55: 56: environment env_variables 57: dependent_services dependent_services 58: notifies :run, "execute[clear the gitlab-rails cache]", :immediately 59: notifies :run, "ruby_block[check remote PG version]", :immediately 60: 61: only_if { migration_helper.attributes_node['auto_migrate'] } 62: end Compiled Resource: ------------------ # Declared in /opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/database_migrations.rb:51:in `from_file' rails_migration("gitlab-rails") do action [:run] default_guard_interpreter :default declared_type :rails_migration cookbook_name "gitlab" recipe_name "database_migrations" rake_task "gitlab:db:configure" logfile_prefix "gitlab-rails-db-migrate" helper "*sensitive value suppressed*" environment "*sensitive value suppressed*" only_if { #code block } end System Info: ------------ chef_version=18.3.0 platform=ubuntu platform_version=24.04 ruby=ruby 3.2.8 (2025-03-26 revision 13f495dc2c) [x86_64-linux] program_name=/opt/gitlab/embedded/bin/cinc-client executable=/opt/gitlab/embedded/bin/cinc-client [2025-12-01T10:19:00+00:00] INFO: Running queued delayed notifications before re-raising exception Running handlers: [2025-12-01T10:19:00+00:00] ERROR: Running exception handlers Running handlers complete [2025-12-01T10:19:00+00:00] ERROR: Exception handlers complete Infra Phase failed. 0 resources updated in 47 seconds [2025-12-01T10:19:00+00:00] FATAL: Stacktrace dumped to /opt/gitlab/embedded/cookbooks/cache/cinc-stacktrace.out [2025-12-01T10:19:00+00:00] FATAL: --------------------------------------------------------------------------------------- [2025-12-01T10:19:00+00:00] FATAL: PLEASE PROVIDE THE CONTENTS OF THE stacktrace.out FILE (above) IF YOU FILE A BUG REPORT [2025-12-01T10:19:00+00:00] FATAL: --------------------------------------------------------------------------------------- [2025-12-01T10:19:00+00:00] FATAL: Mixlib::ShellOut::ShellCommandFailed: rails_migration[gitlab-rails] (gitlab::database_migrations line 51) had an error: Mixlib::ShellOut::ShellCommandFailed: bash_hide_env[migrate gitlab-rails database] (gitlab::database_migrations line 20) had an error: Mixlib::ShellOut::ShellCommandFailed: Expected process to exit with [0], but received '1' ---- Begin output of "bash" ---- STDOUT: Skipping Topology Service health check due to the cell being disabled Running db:migrate rake task main: == [advisory_lock_connection] object_id: 77640, pg_backend_pid: 908710 main: == 20251029020542 FinalizeBackfillPartitionedProjectDailyStatistics: migrating main: -- transaction_open?(nil) main: -> 0.0001s main: -- transaction_open?(nil) main: -> 0.0000s main: == [advisory_lock_connection] object_id: 77640, pg_backend_pid: 908710 rake aborted! StandardError: An error has occurred, all later migrations canceled: PG::CheckViolation: ERROR: no partition of relation "project_daily_statistics_b8088ecbd2" found for row DETAIL: Partition key of the failing row contains (date) = (2025-08-01). /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:150:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:248:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:140:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:96:in `method_missing' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/partitioning_migration_helpers/bulk_copy.rb:31:in `copy_relation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:22:in `block in perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:126:in `block (2 levels) in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/batch/metrics.rb:21:in `instrument_operation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:125:in `block in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block (2 levels) in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `step' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `each_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:124:in `each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:21:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:73:in `execute_batched_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:62:in `execute_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:50:in `execute_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:25:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:30:in `run_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:146:in `run_migration_while' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:80:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:161:in `block (2 levels) in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzers/base.rb:52:in `with_suppressed' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:160:in `block in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/reestablished_connection_stack.rb:21:in `with_restored_connection_stack' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:159:in `finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:252:in `ensure_batched_background_migration_is_finished' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20251029020542_finalize_backfill_partitioned_project_daily_statistics.rb:11:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:83:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:40:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:46:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:191:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:158:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:102:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: ActiveRecord::StatementInvalid: PG::CheckViolation: ERROR: no partition of relation "project_daily_statistics_b8088ecbd2" found for row DETAIL: Partition key of the failing row contains (date) = (2025-08-01). /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:150:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:248:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:140:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:96:in `method_missing' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/partitioning_migration_helpers/bulk_copy.rb:31:in `copy_relation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:22:in `block in perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:126:in `block (2 levels) in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/batch/metrics.rb:21:in `instrument_operation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:125:in `block in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block (2 levels) in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `step' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `each_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:124:in `each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:21:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:73:in `execute_batched_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:62:in `execute_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:50:in `execute_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:25:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:30:in `run_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:146:in `run_migration_while' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:80:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:161:in `block (2 levels) in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzers/base.rb:52:in `with_suppressed' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:160:in `block in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/reestablished_connection_stack.rb:21:in `with_restored_connection_stack' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:159:in `finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:252:in `ensure_batched_background_migration_is_finished' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20251029020542_finalize_backfill_partitioned_project_daily_statistics.rb:11:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:83:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:40:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:46:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:191:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:158:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:102:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Caused by: PG::CheckViolation: ERROR: no partition of relation "project_daily_statistics_b8088ecbd2" found for row DETAIL: Partition key of the failing row contains (date) = (2025-08-01). /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:150:in `block in read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:248:in `retry_with_backoff' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/load_balancer.rb:140:in `read_write' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/load_balancing/connection_proxy.rb:96:in `method_missing' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/partitioning_migration_helpers/bulk_copy.rb:31:in `copy_relation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:22:in `block in perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:126:in `block (2 levels) in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/batch/metrics.rb:21:in `instrument_operation' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:125:in `block in each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block (2 levels) in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:102:in `block in each_batch' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `step' /opt/gitlab/embedded/service/gitlab-rails/app/models/concerns/each_batch.rb:72:in `each_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/batched_migration_job.rb:124:in `each_sub_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/background_migration/backfill_partitioned_table.rb:21:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:73:in `execute_batched_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:62:in `execute_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:50:in `execute_batch' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_wrapper.rb:25:in `perform' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:30:in `run_migration_job' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:146:in `run_migration_while' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:80:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/background_migration/batched_migration_runner.rb:10:in `finalize' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:161:in `block (2 levels) in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzers/base.rb:52:in `with_suppressed' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:160:in `block in finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/reestablished_connection_stack.rb:21:in `with_restored_connection_stack' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:159:in `finalize_batched_background_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/batched_background_migration_helpers.rb:252:in `ensure_batched_background_migration_is_finished' /opt/gitlab/embedded/service/gitlab-rails/db/post_migrate/20251029020542_finalize_backfill_partitioned_project_daily_statistics.rb:11:in `up' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:33:in `block in exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/query_analyzer.rb:83:in `within' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/restrict_gitlab_schema.rb:30:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/automatic_lock_writes_on_tables.rb:21:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migration_helpers/require_disable_ddl_transaction_for_multiple_locks.rb:40:in `exec_migration' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/lock_retry_mixin.rb:46:in `ddl_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/runner_backoff/active_record_mixin.rb:21:in `execute_migration_in_transaction' /opt/gitlab/embedded/service/gitlab-rails/lib/gitlab/database/migrations/pg_backend_pid.rb:14:in `with_advisory_lock' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:191:in `configure_database' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:158:in `configure_pg_databases' /opt/gitlab/embedded/service/gitlab-rails/lib/tasks/gitlab/db.rake:102:in `block (3 levels) in <top (required)>' /opt/gitlab/embedded/bin/bundle:25:in `<main>' Tasks: TOP => db:migrate (See full trace by running task with --trace) STDERR: ---- End output of "bash" ---- Ran "bash" returned 1 ``` </details> ### Output of checks <!--If you are reporting a bug on GitLab.com, uncomment below--> <!--This bug happens on GitLab.com--> <!--and uncomment below if you have /label privileges--> <!--/label ~"reproduced on GitLab.com"--> <!--or follow up with an issue comment of `@gitlab-bot label ~"reproduced on GitLab.com"` if you do not--> #### Results of GitLab environment info <!--Input any relevant GitLab environment information if needed.--> <details> <summary>Expand for output related to GitLab environment info</summary> <pre> (For installations with omnibus-gitlab package run and paste the output of: \\\`sudo gitlab-rake gitlab:env:info\\\`) (For installations from source run and paste the output of: \\\`sudo -u git -H bundle exec rake gitlab:env:info RAILS_ENV=production\\\`) </pre> </details> #### Results of GitLab application Check <!--Input any relevant GitLab application check information if needed.--> <details> <summary>Expand for output related to the GitLab application check</summary> <pre> (For installations with omnibus-gitlab package run and paste the output of: \`sudo gitlab-rake gitlab:check SANITIZE=true\`) (For installations from source run and paste the output of: \`sudo -u git -H bundle exec rake gitlab:check RAILS_ENV=production SANITIZE=true\`) (we will only investigate if the tests are passing) </pre> </details> ### Possible fixes <!--If you can, link to the line of code that might be responsible for the problem.--> ### Patch release information for backports If the bug fix needs to be backported in a [patch release](https://handbook.gitlab.com/handbook/engineering/releases/patch-releases) to a version under [the maintenance policy](https://docs.gitlab.com/policy/maintenance/), please follow the steps on the [patch release runbook for GitLab engineers](https://gitlab.com/gitlab-org/release/docs/-/blob/master/general/patch/engineers.md). Refer to the [internal "Release Information" dashboard](https://dashboards.gitlab.net/d/delivery-release_info/delivery3a-release-information?orgId=1) for information about the next patch release, including the targeted versions, expected release date, and current status. #### High-severity bug remediation To remediate high-severity issues requiring an [internal release](https://handbook.gitlab.com/handbook/engineering/releases/internal-releases/) for single-tenant SaaS instances, refer to the [internal release process for engineers](https://gitlab.com/gitlab-org/release/docs/-/blob/master/general/internal-releases/engineers.md?ref_type=heads). <!--If you don't have /label privileges, follow up with an issue comment of `@gitlab-bot label ~"type::bug"`-->
issue