icu4c updates break brand new GDK installations

added Category:GDK Engineering Productivity featureenhancement typefeature labels

added gdk-performance gdk-reliability gdk-usability labels

changed the description

@ipedowitz We need to remove the problematic install of charlock_holmes that's installed on your machine. The easiest way to do this without needing to worry about ensuring you're using the correct version of Ruby is run the following from your terminal:

rm -rf /Users/ipedowitz/.asdf/installs/ruby/3.2.3/lib/ruby/gems/3.2.0/gems/charlock_holmes-0.7.7

If you re-attempt the GDK install I believe it will progress further.

As the core issue is icu4c has been upgraded, there could be other gems that rely on an older install of icu4c that might also display a similar error. In that case, removing the root of the problematic gem (like above) should also help.

Hi @ashmckenzie - I just did that, but now hit a new error:

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/01_admin.rb
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/lib/ruby/gems/3.2.0/gems/bootsnap-1.18.3/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30: warning: ⛔️ WARNING: Sidekiq testing API enabled, but this is not the test environment.  Your jobs will not go to Redis.
rake aborted!
ActiveRecord::RecordInvalid: Validation failed: Email has already been taken, Username has already been taken
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
(eval):4:in `block (3 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:94:in `block (3 levels) in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:122:in `without_new_note_notifications'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:93:in `block (2 levels) in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:132:in `without_statement_timeout'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:92:in `block in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:148:in `without_database_logging'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:91:in `quiet'
(eval):3:in `block (2 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:359:in `block in transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:358:in `transaction'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `load'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `<main>'
Tasks: TOP => db:seed_fu
(See full trace by running task with --trace)
ERROR: 'asdf exec bundle exec rake db:seed_fu' failed.
ERROR: The rake task 'db:seed_fu' failed. Trying to run it again!
make: *** [_postgresql-seed-rails] Error 1
ERROR: Failed to install.
-------------------------------------------------------
You can try the following that may be of assistance:

- Run 'gdk doctor'.

- Visit the troubleshooting documentation:
  https://gitlab.com/gitlab-org/gitlab-development-kit/-/blob/main/doc/troubleshooting/index.md.
- Visit https://gitlab.com/gitlab-org/gitlab-development-kit/-/issues to
  see if there are known issues.

- Run 'gdk reset-data' if appropriate.
- Run 'gdk pristine' which will restore your GDK to a pristine state.
-------------------------------------------------------

Running gdk doctor gives me this:

➜  gitlab-development-kit git:(main) gdk doctor               
................Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
........
⚠️  WARNING: Your GDK may need attention.

Geo
================================================================================
GDK could be a Geo primary node. However, geo.enabled is not set to true in your gdk.yml.
Update your gdk.yml to set geo.enabled to true.

https://gitlab.com/gitlab-org/gitlab-development-kit/blob/main/doc/howto/geo.md


Stale Data
================================================================================
You might encounter a PG::CheckViolation error during database migrations, likely due to stale data in the ci database that belongs in the main database, or vice versa. To address this, you can run:

  gdk truncate-legacy-tables

I then ran gdk truncate-legacy-tables and get this:

✅️ Legacy table truncation completed successfully.

But when I open http://127.0.0.1:3000/ afterwards, and after a gdk stop and gdk start, I get the This site can’t be reached error:

Is this a branch new GDK install, I ask because:

Geo
================================================================================
GDK could be a Geo primary node. However, geo.enabled is not set to true in your gdk.yml.
Update your gdk.yml to set geo.enabled to true.

https://gitlab.com/gitlab-org/gitlab-development-kit/blob/main/doc/howto/geo.md

? I'd recommend running a gdk reset-data or even deleting the entire GDK install and installing a fresh one as from the output of gdk doctor, it looks like this was an existing GDK that's been configured as a Geo node at some point but no longer.

@ashmckenzie this is a new install. I just rm -fr'd the directory and redid it, and this is what I get:

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/01_admin.rb
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/lib/ruby/gems/3.2.0/gems/bootsnap-1.18.3/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30: warning: ⛔️ WARNING: Sidekiq testing API enabled, but this is not the test environment.  Your jobs will not go to Redis.
rake aborted!
ActiveRecord::RecordInvalid: Validation failed: Email has already been taken, Username has already been taken
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
(eval):4:in `block (3 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:94:in `block (3 levels) in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:122:in `without_new_note_notifications'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:93:in `block (2 levels) in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:132:in `without_statement_timeout'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:92:in `block in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:148:in `without_database_logging'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:91:in `quiet'
(eval):3:in `block (2 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:359:in `block in transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:358:in `transaction'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `load'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `<main>'
Tasks: TOP => db:seed_fu
(See full trace by running task with --trace)
ERROR: 'asdf exec bundle exec rake db:seed_fu' failed. Retrying in 2 secs..

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/001_create_base_work_item_types.rb

OK

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/002_default_organization.rb

OK

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/01_admin.rb
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/lib/ruby/gems/3.2.0/gems/bootsnap-1.18.3/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30: warning: ⛔️ WARNING: Sidekiq testing API enabled, but this is not the test environment.  Your jobs will not go to Redis.
rake aborted!
ActiveRecord::RecordInvalid: Validation failed: Email has already been taken, Username has already been taken
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
(eval):4:in `block (3 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:94:in `block (3 levels) in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:122:in `without_new_note_notifications'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:93:in `block (2 levels) in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:132:in `without_statement_timeout'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:92:in `block in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:148:in `without_database_logging'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:91:in `quiet'
(eval):3:in `block (2 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:359:in `block in transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:358:in `transaction'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `load'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `<main>'
Tasks: TOP => db:seed_fu
(See full trace by running task with --trace)
ERROR: 'asdf exec bundle exec rake db:seed_fu' failed.
ERROR: The rake task 'db:seed_fu' failed. Trying to run it again!
make: *** [_postgresql-seed-rails] Error 1
ERROR: Failed to install.
-------------------------------------------------------
You can try the following that may be of assistance:

- Run 'gdk doctor'.

- Visit the troubleshooting documentation:
  https://gitlab.com/gitlab-org/gitlab-development-kit/-/blob/main/doc/troubleshooting/index.md.
- Visit https://gitlab.com/gitlab-org/gitlab-development-kit/-/issues to
  see if there are known issues.

- Run 'gdk reset-data' if appropriate.
- Run 'gdk pristine' which will restore your GDK to a pristine state.
-------------------------------------------------------

After running gdk doctor I get this:

➜  gitlab-development-kit git:(main) gdk doctor               
................Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
........
⚠️  WARNING: Your GDK may need attention.

Geo
================================================================================
GDK could be a Geo primary node. However, geo.enabled is not set to true in your gdk.yml.
Update your gdk.yml to set geo.enabled to true.

https://gitlab.com/gitlab-org/gitlab-development-kit/blob/main/doc/howto/geo.md


Stale Data
================================================================================
You might encounter a PG::CheckViolation error during database migrations, likely due to stale data in the ci database that belongs in the main database, or vice versa. To address this, you can run:

  gdk truncate-legacy-tables


Stale Services
================================================================================
The following GDK services appear to be stale:

praefect-gitaly-0
redis

You can try killing them by running 'gdk kill' or:

 kill 16891 16895

So not sure how to proceed .

You must still have some GDK related files on disk due to:

ActiveRecord::RecordInvalid: Validation failed: Email has already been taken, Username has already been taken

and in memory:

The following GDK services appear to be stale:

praefect-gitaly-0
redis

You can try killing them by running 'gdk kill' or:

 kill 16891 16895

I'd recommend a reboot to clear up the stale services and try to install in a completely different directory. If it still fails, can you please attach the full output from the very beginning when you start the install.

In the meantime, I'm trying a local install from scratch to verify there isn't an Issue within the GDK, GitLab or such via:

$ cd /tmp
$ git clone git@gitlab.com:gitlab-org/gitlab-development-kit.git
$ cd gitlab-development-kit
$ make install

Utilising a GitLab Workspace might also be an option for you https://gitlab.com/-/remote_development/workspaces/new?project=gitlab-org%2Fgitlab.

Interesting! I believe we have an issue with either GDK or GitLab as a fresh install fails for me:

$ make install
--snip--
--------------------------------------------------------------------------------
Ensuring necessary databases are setup and seeded
--------------------------------------------------------------------------------
--snip--

Seeding issues for the 'twitter/Typeahead.Js' project
.........
9 issues created!

OK

== Seed from /private/tmp/gitlab-development-kit/gitlab/db/fixtures/development/10_merge_requests.rb
........rake aborted!
ActiveRecord::ConnectionNotEstablished: connection is closed
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database.rb:398:in `rollback'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database.rb:359:in `block in transaction'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database.rb:358:in `transaction'
/Users/ash/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `load'
/Users/ash/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `<main>'

Caused by:
PG::ConnectionBad: connection is closed
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database.rb:398:in `rollback'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database.rb:359:in `block in transaction'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database.rb:358:in `transaction'
/Users/ash/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `load'
/Users/ash/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `<main>'

Caused by:
NameError: undefined method `original_new_note' for class `NotificationService'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:124:in `alias_method'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:124:in `ensure in without_new_note_notifications'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:125:in `without_new_note_notifications'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:93:in `block (2 levels) in quiet'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:132:in `without_statement_timeout'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:92:in `block in quiet'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:148:in `without_database_logging'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:91:in `quiet'
(eval):20:in `block (2 levels) in run_file'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database.rb:359:in `block in transaction'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database.rb:358:in `transaction'
/Users/ash/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `load'
/Users/ash/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `<main>'

Caused by:
LoadError: cannot load such file -- sass
<internal:/Users/ash/.asdf/installs/ruby/3.2.3/lib/ruby/site_ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
<internal:/Users/ash/.asdf/installs/ruby/3.2.3/lib/ruby/site_ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
<internal:/Users/ash/.asdf/installs/ruby/3.2.3/lib/ruby/site_ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
<internal:/Users/ash/.asdf/installs/ruby/3.2.3/lib/ruby/site_ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
/private/tmp/gitlab-development-kit/gitlab/app/helpers/application_helper.rb:467:in `asset_to_string'
--snip--

== Seed from /private/tmp/gitlab-development-kit/gitlab/db/fixtures/development/01_admin.rb
/Users/ash/.asdf/installs/ruby/3.2.3/lib/ruby/gems/3.2.0/gems/bootsnap-1.18.3/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30: warning: ⛔️ WARNING: Sidekiq testing API enabled, but this is not the test environment.  Your jobs will not go to Redis.
rake aborted!
ActiveRecord::RecordInvalid: Validation failed: Email has already been taken, Username has already been taken
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
(eval):4:in `block (3 levels) in run_file'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:94:in `block (3 levels) in quiet'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:122:in `without_new_note_notifications'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:93:in `block (2 levels) in quiet'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:132:in `without_statement_timeout'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:92:in `block in quiet'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:148:in `without_database_logging'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:91:in `quiet'
(eval):3:in `block (2 levels) in run_file'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database.rb:359:in `block in transaction'
/private/tmp/gitlab-development-kit/gitlab/lib/gitlab/database.rb:358:in `transaction'
/Users/ash/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `load'
/Users/ash/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `<main>'
Tasks: TOP => db:seed_fu
(See full trace by running task with --trace)
❌️ ERROR: 'asdf exec bundle exec rake db:seed_fu' failed.
❌️ ERROR: The rake task 'db:seed_fu' failed. Trying to run it again!
make: *** [_postgresql-seed-rails] Error 1

Am curious if you see the same ActiveRecord::ConnectionNotEstablished: connection is closed error before the ActiveRecord::RecordInvalid: Validation failed: Email has already been taken, Username has already been taken errors.

cc @gl-quality/eng-prod

@ashmckenzie as requested, I've restarted my computer and reattempted from scratch. Here's the full output from the very beginning of the install.

Utilising a GitLab Workspace might also be an option for you https://gitlab.com/-/remote_development/workspaces/new?project=gitlab-org%2Fgitlab.

What's a GitLab Workspace compared to GDK? Not sure I've heard of them before.

Interesting! I believe we have an issue with either GDK or GitLab as a fresh install fails for me:

Oh! So you can reproduce this now too?!

Am curious if you see the same ActiveRecord::ConnectionNotEstablished: connection is closed error before the ActiveRecord::RecordInvalid: Validation failed: Email has already been taken, Username has already been taken errors.

Hrmm, looks like I don't see that?

Full output after reboot

➜  GitLab.com curl "https://gitlab.com/gitlab-org/gitlab-development-kit/-/raw/main/support/install" | bash

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  4473  100  4473    0     0  13676      0 --:--:-- --:--:-- --:--:-- 13720

INFO: This is the GDK one line installation. For more information, please visit:
INFO: https://gitlab.com/gitlab-org/gitlab-development-kit/-/blob/main/doc/index.md#one-line-installation
INFO:
INFO: The source for the installation script can be viewed at:
INFO: https://gitlab.com/gitlab-org/gitlab-development-kit/-/blob/main/support/install

Where would you like to install the GDK? [./gitlab-development-kit]


Which GitLab repo URL would you like to clone? [https://gitlab.com/gitlab-org/gitlab.git]

ATTENTION: For members of the wider community, it is recommended to use the community fork (https://gitlab.com/gitlab-community/gitlab.git).
See https://gitlab.com/gitlab-community/meta for instructions on how to join.
If you'd prefer to use your own repository, please ensure that its visibility is set to public.


To improve GDK, GitLab would like to collect basic error and usage data. Please choose one of the following options:

- To send data to GitLab, enter your GitLab username.
- To send data to GitLab anonymously, leave blank.
- To avoid sending data to GitLab, enter a period ('.').
ipedowitz
Cloning into 'gitlab-development-kit'...
remote: Enumerating objects: 42966, done.
remote: Counting objects: 100% (119/119), done.
remote: Compressing objects: 100% (80/80), done.
remote: Total 42966 (delta 61), reused 77 (delta 37), pack-reused 42847
Receiving objects: 100% (42966/42966), 26.34 MiB | 1.98 MiB/s, done.
Resolving deltas: 100% (30805/30805), done.
From gitlab.com:gitlab-org/gitlab-development-kit
 * branch              main       -> FETCH_HEAD
Already on 'main'
Your branch is up to date with 'origin/main'.
INFO: Performing common preflight checks..
INFO: Setting up 'darwin' platform..
==> Downloading https://formulae.brew.sh/api/formula.jws.json
######################################################################### 100.0%
Using cmake
Using coreutils
Using docutils
Using dpkg
Using exiftool
Using fzf
Using git
Using git-lfs
Using gnupg
Using gpgme
Using graphicsmagick
Using groff
Using heimdal
Using icu4c
Using libiconv
Using libssh2
Using lychee
Using openssl@1.1
Using pkg-config
Using re2
Using runit
Using sqlite
Using vault
Using yamllint
Homebrew Bundle complete! 24 Brewfile dependencies now installed.
INFO: Installing asdf..
INFO: Installing/updating asdf plugins..
Location of golang plugin: /Users/ipedowitz/.asdf/plugins/golang
Updating golang to master
Already on 'master'
Your branch is up to date with 'origin/master'.
Location of minio plugin: /Users/ipedowitz/.asdf/plugins/minio
Updating minio to master
Already on 'master'
Your branch is up to date with 'origin/master'.
Location of nodejs plugin: /Users/ipedowitz/.asdf/plugins/nodejs
Updating nodejs to master
Already on 'master'
Your branch is up to date with 'origin/master'.
Location of postgres plugin: /Users/ipedowitz/.asdf/plugins/postgres
Updating postgres to master
Already on 'master'
Your branch is up to date with 'origin/master'.
Location of redis plugin: /Users/ipedowitz/.asdf/plugins/redis
Updating redis to master
Already on 'master'
Your branch is up to date with 'origin/master'.
Location of ruby plugin: /Users/ipedowitz/.asdf/plugins/ruby
Updating ruby to master
Already on 'master'
Your branch is up to date with 'origin/master'.
Location of shellcheck plugin: /Users/ipedowitz/.asdf/plugins/shellcheck
Updating shellcheck to master
Already on 'master'
Your branch is up to date with 'origin/master'.
Location of vale plugin: /Users/ipedowitz/.asdf/plugins/vale
Updating vale to main
Already on 'main'
Your branch is up to date with 'origin/main'.
Location of yarn plugin: /Users/ipedowitz/.asdf/plugins/yarn
Updating yarn to main
Already on 'main'
Your branch is up to date with 'origin/main'.
INFO: Installing asdf tools..
support/bootstrap: line 62: !version_patches: unbound variable
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
golang 1.21.7 is already installed
minio 2022-07-15T03-44-22Z is already installed
nodejs 18.17.0 is already installed
postgres 14.9 is already installed
postgres 13.12 is already installed
redis 7.0.14 is already installed
ruby 3.2.3 is already installed
shellcheck 0.9.0 is already installed
vale 3.0.7 is already installed
yarn 1.22.19 is already installed
INFO: Reshimming asdf..
Reshimming 'golang': 1.21.7
Reshimming 'minio': 2022-07-15T03-44-22Z
Reshimming 'nodejs': 18.17.0
Reshimming 'postgres': 14.9
Reshimming 'postgres': 13.12
Reshimming 'redis': 7.0.14
Reshimming 'ruby': 3.2.3
Reshimming 'shellcheck': 0.9.0
Reshimming 'vale': 3.0.7
Reshimming 'yarn': 1.22.19
INFO: Installing gitlab-development-kit Ruby gem..
INFO: Configuring Ruby..
Latest version already installed. Done.

INFO: Bootstrap successful!
INFO: To make sure GDK commands are available in this shell, please run the command corresponding to your shell.

sh / bash / zsh:
source "/opt/homebrew/opt/asdf/libexec/asdf.sh"

fish:
source "/opt/homebrew/opt/asdf/libexec/asdf.fish"

elvish:
source "/opt/homebrew/opt/asdf/libexec/asdf.elv"

nushell:
source "/opt/homebrew/opt/asdf/libexec/asdf.nu"
A backup of 'gdk.yml' has been made at '.backups/gdk.yml.20240305205317'.
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Bundle check passed.

--------------------------------------------------------------------------------
Cloning gitlab-org/gitlab
--------------------------------------------------------------------------------
Note: switching to 'v14.34.0'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at 7118b75 Merge branch 'ashmckenzie/gitlab-shell-release-14-34-0' into 'main'

--------------------------------------------------------------------------------
Installing asdf tools from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab-shell/.tool-versions
--------------------------------------------------------------------------------
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
golang 1.22.0 is already installed
ruby 3.2.3 is already installed

--------------------------------------------------------------------------------
Installing gitlab-org/gitlab-shell Ruby gems
--------------------------------------------------------------------------------
Bundle check passed.
Generating public/private rsa key pair.
Your identification has been saved in /Users/ipedowitz/GitLab.com/gitlab-development-kit/openssh/ssh_host_rsa_key
Your public key has been saved in /Users/ipedowitz/GitLab.com/gitlab-development-kit/openssh/ssh_host_rsa_key.pub
The key fingerprint is:
SHA256:1tUD/zmB90jOMZOUeEutftsnVwe4ANbGTkwGoG8jVN4 ipedowitz@ians-mbp.lan
The key's randomart image is:
+---[RSA 3072]----+
|      o..*o ...o |
|     + .o.* .==..|
|    o ..E=  .=X= |
|   . .   .o..+=B+|
|    . + S .. o++o|
|     o o    . . =|
|               .=|
|              ..+|
|               o.|
+----[SHA256]-----+
Generating public/private ed25519 key pair.
Your identification has been saved in /Users/ipedowitz/GitLab.com/gitlab-development-kit/openssh/ssh_host_ed25519_key
Your public key has been saved in /Users/ipedowitz/GitLab.com/gitlab-development-kit/openssh/ssh_host_ed25519_key.pub
The key fingerprint is:
SHA256:7RVmcmDE/AAYM5Pp+uLoQfDKKmK22EZk3WmBlaTcH6g ipedowitz@ians-mbp.lan
The key's randomart image is:
+--[ED25519 256]--+
|     +B*.=+      |
|   ..o*= .+.     |
|.  .oooo. .o=    |
| oo ..=. o =..   |
| oo Eo  S . .    |
|.o. .    . .     |
|.o.  .    .      |
|=+.o. .          |
|B+=...           |
+----[SHA256]-----+
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files

--------------------------------------------------------------------------------
Installing asdf tools from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/.tool-versions
--------------------------------------------------------------------------------
gitleaks 8.16.4 is already installed
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
minio 2022-07-15T03-44-22Z is already installed
nodejs 18.17.0 is already installed
postgres 14.9 is already installed
postgres 13.12 is already installed
redis 7.0.14 is already installed
ruby 3.2.3 is already installed
rust 1.73.0 is already installed
vale 3.0.7 is already installed
yarn 1.22.19 is already installed

--------------------------------------------------------------------------------
Setting up Ruby bundler
--------------------------------------------------------------------------------

--------------------------------------------------------------------------------
Installing gitlab-org/gitlab Ruby gems
--------------------------------------------------------------------------------
Bundle check passed.

--------------------------------------------------------------------------------
Installing the gitlab-development-kit gem
--------------------------------------------------------------------------------

--------------------------------------------------------------------------------
Enabling Lefthook for gitlab-org/gitlab
--------------------------------------------------------------------------------
sync hooks: ✔️ (pre-commit, pre-push, auto-fix)

--------------------------------------------------------------------------------
Installing gitlab-org/gitlab Node.js packages
--------------------------------------------------------------------------------
[WARNING] package.json changed significantly. Removing node_modules to be sure there are no problems.
warning "@gitlab/application-sdk-browser > @snowplow/browser-plugin-error-tracking@3.13.1" has incorrect peer dependency "@snowplow/browser-tracker@~3.13.1".
warning " > @gitlab/ui@78.1.1" has incorrect peer dependency "vue@^2.7.16".
warning " > @vue/apollo-components@4.0.0-beta.4" has incorrect peer dependency "vue@^3.1.0".
warning " > @vue/apollo-option@4.0.0-beta.4" has incorrect peer dependency "vue@^3.1.0".
warning " > vue-router-vue3@4.1.6" has incorrect peer dependency "vue@^3.2.0".
warning " > vuex-vue3@4.0.0" has incorrect peer dependency "vue@^3.0.2".
warning "@gitlab/eslint-plugin > eslint-plugin-jest > @typescript-eslint/utils > @typescript-eslint/typescript-estree > tsutils@3.21.0" has unmet peer dependency "typescript@>=2.8.0 || >= 3.2.0-dev || >= 3.3.0-dev || >= 3.4.0-dev || >= 3.5.0-dev || >= 3.6.0-dev || >= 3.6.0-beta || >= 3.7.0-dev || >= 3.7.0-beta".
warning " > @vue/compat@3.2.47" has incorrect peer dependency "vue@3.2.47".
warning " > @vue/test-utils-vue3@2.3.1" has unmet peer dependency "@vue/compiler-dom@^3.0.1".
warning " > @vue/test-utils-vue3@2.3.1" has unmet peer dependency "@vue/server-renderer@^3.0.1".
warning " > @vue/test-utils-vue3@2.3.1" has incorrect peer dependency "vue@^3.0.1".
warning "@vue/test-utils-vue3 > @vue/server-renderer@3.2.47" has incorrect peer dependency "vue@3.2.47".
warning " > @vue/vue3-jest@29.2.3" has incorrect peer dependency "babel-jest@29.x".
warning " > @vue/vue3-jest@29.2.3" has incorrect peer dependency "jest@29.x".
warning " > @vue/vue3-jest@29.2.3" has incorrect peer dependency "vue@^3.0.0-0".
warning "swagger-cli > @apidevtools/swagger-cli > @apidevtools/swagger-parser@10.1.0" has unmet peer dependency "openapi-types@>=7".
warning Workspaces can only be enabled in private projects.

--------------------------------------------------------------------------------
Generating gitlab-org/gitlab Rails translations
--------------------------------------------------------------------------------
Updated 0 paths from the index
Successfully fetched and checked out 'f68eed8a9d41bfe20840e87c8a9f6cd58db30de3' for 'gitaly/'

--------------------------------------------------------------------------------
Installing asdf tools from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitaly/.tool-versions
--------------------------------------------------------------------------------
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
golang 1.22.0 is already installed
ruby 3.2.3 is already installed

--------------------------------------------------------------------------------
Building gitlab-org/gitaly f68eed8a9d41bfe20840e87c8a9f6cd58db30de3
--------------------------------------------------------------------------------
GIT_VERSION = 2.43.0
    * new build flags
    GEN hook-list.h
    CC builtin/hook.o
    GEN config-list.h
    CC builtin/init-db.o
    CC builtin/index-pack.o
    CC builtin/log.o
    * new prefix flags
    CC builtin/interpret-trailers.o
    CC builtin/ls-files.o
    * new link flags
    CC builtin/ls-remote.o
    CC builtin/ls-tree.o
    CC builtin/mailinfo.o
    CC builtin/mailsplit.o
    CC builtin/merge-base.o
    CC builtin/merge-file.o
    CC builtin/merge-index.o
    CC builtin/merge-ours.o
    CC builtin/merge-recursive.o
    CC builtin/merge-tree.o
    CC builtin/merge.o
    CC builtin/mktag.o
    CC builtin/mktree.o
    CC builtin/multi-pack-index.o
    CC builtin/mv.o
    CC builtin/name-rev.o
    CC builtin/notes.o
    CC builtin/pack-objects.o
    CC builtin/pack-redundant.o
    CC builtin/pack-refs.o
    CC builtin/patch-id.o
    CC builtin/prune-packed.o
    CC builtin/prune.o
    CC builtin/pull.o
    CC builtin/push.o
    CC builtin/range-diff.o
    CC builtin/read-tree.o
    CC builtin/rebase.o
    CC builtin/receive-pack.o
    CC builtin/reflog.o
    CC builtin/remote-ext.o
    CC builtin/remote-fd.o
    CC builtin/remote.o
    CC builtin/repack.o
    CC builtin/replace.o
    CC builtin/rerere.o
    CC builtin/reset.o
    CC builtin/rev-list.o
    CC builtin/rev-parse.o
    CC builtin/revert.o
    CC builtin/rm.o
    CC builtin/send-pack.o
    CC builtin/shortlog.o
    CC builtin/show-branch.o
    CC builtin/show-index.o
    CC builtin/show-ref.o
    CC builtin/sparse-checkout.o
    CC builtin/stash.o
    CC builtin/stripspace.o
    CC builtin/submodule--helper.o
    CC builtin/symbolic-ref.o
    CC builtin/tag.o
    CC builtin/unpack-file.o
    CC builtin/unpack-objects.o
    CC builtin/update-index.o
    CC builtin/update-ref.o
    CC builtin/update-server-info.o
    CC builtin/upload-archive.o
    CC builtin/upload-pack.o
    CC builtin/var.o
    CC builtin/verify-commit.o
    CC builtin/verify-pack.o
    CC builtin/verify-tag.o
    CC builtin/worktree.o
    CC builtin/write-tree.o
    CC abspath.o
    CC common-main.o
    CC add-interactive.o
    CC add-patch.o
    CC advice.o
    CC alias.o
    CC alloc.o
    CC apply.o
    CC archive-tar.o
    CC archive-zip.o
    CC archive.o
    CC attr.o
    CC base85.o
    CC bisect.o
    CC blame.o
    CC blob.o
    CC bloom.o
    CC branch.o
    CC bundle-uri.o
    CC bulk-checkin.o
    CC bundle.o
    CC cache-tree.o
    CC cbtree.o
    CC chdir-notify.o
    CC checkout.o
    CC chunk-format.o
    CC color.o
    CC column.o
    CC combine-diff.o
    CC commit-graph.o
    CC commit-reach.o
    CC commit.o
    CC compat/nonblock.o
    CC compat/obstack.o
    CC compat/terminal.o
    CC compat/zlib-uncompress2.o
    CC config.o
    CC connect.o
    CC connected.o
    CC convert.o
    CC copy.o
    CC credential.o
    CC csum-file.o
    CC ctype.o
    CC date.o
    CC decorate.o
    CC delta-islands.o
    CC diagnose.o
    CC diff-delta.o
    CC diff-lib.o
    CC diff-merges.o
    CC diff-no-index.o
    CC diff.o
    CC diffcore-break.o
    CC diffcore-delta.o
    CC diffcore-order.o
    CC diffcore-pickaxe.o
    CC diffcore-rename.o
    CC diffcore-rotate.o
    CC dir-iterator.o
    CC dir.o
    CC editor.o
    CC entry.o
    CC environment.o
    CC ewah/bitmap.o
    CC ewah/ewah_bitmap.o
    CC ewah/ewah_io.o
    CC ewah/ewah_rlw.o
    CC exec-cmd.o
    CC fetch-negotiator.o
    CC fetch-pack.o
    CC fmt-merge-msg.o
    CC fsck.o
    CC fsmonitor.o
    CC fsmonitor-ipc.o
    CC gettext.o
    CC fsmonitor-settings.o
    CC git-zlib.o
    CC gpg-interface.o
    CC graph.o
    CC grep.o
    CC hash-lookup.o
    CC hashmap.o
    GEN command-list.h
    CC hex.o
    CC hex-ll.o
    CC hook.o
    CC ident.o
    CC json-writer.o
    CC kwset.o
    CC levenshtein.o
    CC line-log.o
    CC line-range.o
    CC linear-assignment.o
    CC list-objects-filter-options.o
    CC list-objects-filter.o
    CC list-objects.o
    CC lockfile.o
    CC log-tree.o
    CC ls-refs.o
    CC mailinfo.o
    CC mailmap.o
    CC match-trees.o
    CC mem-pool.o
    CC merge-blobs.o
    CC merge-ll.o
    CC merge-ort.o
    CC merge-ort-wrappers.o
    CC merge-recursive.o
    CC merge.o
    CC midx.o
    CC name-hash.o
    CC negotiator/noop.o
    CC negotiator/default.o
    CC negotiator/skipping.o
    CC notes-cache.o
    CC notes-merge.o
    CC notes-utils.o
    CC notes.o
    CC object-file.o
    CC object-name.o
    CC object.o
    CC oid-array.o
    CC oidmap.o
    CC oidset.o
    CC oidtree.o
    CC pack-bitmap-write.o
    CC pack-bitmap.o
    CC pack-check.o
    CC pack-mtimes.o
    CC pack-objects.o
    CC pack-revindex.o
    CC pack-write.o
    CC packfile.o
    CC pager.o
    CC parallel-checkout.o
    CC parse.o
    CC parse-options-cb.o
    CC parse-options.o
    CC patch-delta.o
    CC patch-ids.o
    CC path.o
    CC pathspec.o
    CC pkt-line.o
    CC preload-index.o
    CC pretty.o
    CC prio-queue.o
    CC progress.o
    CC promisor-remote.o
    CC prompt.o
    CC protocol.o
    CC protocol-caps.o
    CC prune-packed.o
    CC quote.o
    CC range-diff.o
    CC reachable.o
    CC rebase-interactive.o
    CC read-cache.o
    CC rebase.o
    CC ref-filter.o
    CC reflog-walk.o
    CC reflog.o
    CC refs.o
    CC refs/debug.o
    CC refs/files-backend.o
    CC refs/iterator.o
    CC refs/packed-backend.o
    CC refs/ref-cache.o
    CC refspec.o
    CC remote.o
    CC replace-object.o
    CC repo-settings.o
    CC repository.o
    CC rerere.o
    CC reset.o
    CC resolve-undo.o
    CC revision.o
    CC run-command.o
    CC send-pack.o
    CC sequencer.o
    CC serve.o
    CC server-info.o
    CC setup.o
    CC shallow.o
    CC sideband.o
    CC sigchain.o
    CC sparse-index.o
    CC split-index.o
    CC stable-qsort.o
    CC statinfo.o
    CC strbuf.o
    CC streaming.o
    CC string-list.o
    CC strmap.o
    CC strvec.o
    CC sub-process.o
    CC submodule-config.o
    CC submodule.o
    CC symlinks.o
    CC tag.o
    CC tempfile.o
    CC thread-utils.o
    CC tmp-objdir.o
    CC trace.o
    CC trace2.o
    CC trace2/tr2_cfg.o
    CC trace2/tr2_cmd_name.o
    CC trace2/tr2_ctr.o
    CC trace2/tr2_dst.o
    CC trace2/tr2_sid.o
    CC trace2/tr2_sysenv.o
    CC trace2/tr2_tbuf.o
    CC trace2/tr2_tgt_event.o
    CC trace2/tr2_tgt_normal.o
    CC trace2/tr2_tgt_perf.o
    CC trace2/tr2_tls.o
    CC trailer.o
    CC trace2/tr2_tmr.o
    CC transport-helper.o
    CC transport.o
    CC tree-diff.o
    CC tree-walk.o
    CC tree.o
    CC unpack-trees.o
    CC upload-pack.o
    CC url.o
    CC urlmatch.o
    CC usage.o
    CC userdiff.o
    CC utf8.o
    CC varint.o
    CC versioncmp.o
    CC walker.o
    CC wildmatch.o
    CC worktree.o
    CC write-or-die.o
    CC wrapper.o
    CC ws.o
    CC wt-status.o
    CC unix-socket.o
    CC xdiff-interface.o
    CC unix-stream-server.o
    CC compat/simple-ipc/ipc-shared.o
    CC compat/simple-ipc/ipc-unix-socket.o
    CC sha1dc_git.o
    CC sha1dc/sha1.o
    CC sha1dc/ubc_check.o
    CC sha256/block/sha256.o
    CC compat/precompose_utf8.o
    CC compat/fopen.o
    CC compat/open.o
    CC compat/memmem.o
    CC compat/qsort_s.o
    CC compat/regcomp_enhanced.o
    CC compat/stub/procinfo.o
    CC compat/fsmonitor/fsm-listen-darwin.o
    CC compat/fsmonitor/fsm-health-darwin.o
    CC compat/fsmonitor/fsm-settings-darwin.o
    CC compat/fsmonitor/fsm-ipc-darwin.o
    CC xdiff/xdiffi.o
    CC compat/fsmonitor/fsm-path-utils-darwin.o
    CC xdiff/xemit.o
    CC xdiff/xhistogram.o
    CC xdiff/xmerge.o
    CC xdiff/xpatience.o
    CC xdiff/xprepare.o
    CC xdiff/xutils.o
    CC reftable/basics.o
    CC reftable/error.o
    CC reftable/block.o
    CC reftable/blocksource.o
    CC reftable/iter.o
    CC reftable/publicbasics.o
    CC reftable/merged.o
    CC reftable/reader.o
    CC reftable/pq.o
    CC reftable/record.o
    CC reftable/refname.o
    CC reftable/generic.o
    CC reftable/tree.o
    CC reftable/stack.o
    CC reftable/writer.o
    CC remote-curl.o
    CC http.o
    CC http-backend.o
    CC builtin/add.o
    CC git.o
    CC http-walker.o
    CC builtin/am.o
    CC builtin/annotate.o
    CC builtin/apply.o
    CC builtin/archive.o
    CC builtin/branch.o
    CC builtin/blame.o
    CC builtin/bisect.o
    CC builtin/bugreport.o
    CC builtin/bundle.o
    CC builtin/cat-file.o
    CC builtin/check-attr.o
    CC builtin/check-ignore.o
    CC builtin/check-mailmap.o
    CC builtin/check-ref-format.o
    CC builtin/checkout--worker.o
    CC builtin/checkout-index.o
    CC builtin/checkout.o
    CC builtin/clean.o
    CC builtin/clone.o
    CC builtin/column.o
    CC builtin/commit-graph.o
    CC builtin/commit-tree.o
    CC builtin/commit.o
    CC builtin/config.o
    CC builtin/count-objects.o
    CC builtin/credential-cache--daemon.o
    CC builtin/credential-cache.o
    CC builtin/credential-store.o
    CC builtin/credential.o
    CC builtin/describe.o
    CC builtin/diagnose.o
    CC builtin/diff-files.o
    CC builtin/diff-index.o
    CC builtin/diff-tree.o
    CC builtin/diff.o
    CC builtin/difftool.o
    CC builtin/fast-export.o
    CC builtin/fast-import.o
    CC builtin/fetch-pack.o
    CC builtin/fetch.o
    CC builtin/fmt-merge-msg.o
    CC builtin/for-each-ref.o
    CC builtin/for-each-repo.o
    CC builtin/fsck.o
    CC builtin/fsmonitor--daemon.o
    CC builtin/gc.o
    CC builtin/grep.o
    CC builtin/get-tar-commit-id.o
    CC builtin/hash-object.o
    CC builtin/help.o
    CC help.o
    CC version.o
    AR xdiff/lib.a
    AR reftable/libreftable.a
    AR libgit.a
    LINK git-remote-http
    LINK git-http-backend
ld: warning: ignoring duplicate libraries: 'libgit.a'
ld: warning: ignoring duplicate libraries: 'libgit.a'
    LINK git
ld: warning: ignoring duplicate libraries: 'libgit.a'
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
Notice: Behaving like ASDF_GOLANG_MOD_VERSION_ENABLED=true
        In the future this will have to be set to continue
        reading from the go.mod and go.work files
The files belonging to this database system will be owned by user "ipedowitz".
This user must also own the server process.

The database cluster will be initialized with locale "C".
The default text search configuration will be set to "english".

Data page checksums are disabled.

creating directory /Users/ipedowitz/GitLab.com/gitlab-development-kit/postgresql/data ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... America/Phoenix
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok

initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.

Success. You can now start the database server using:

    /Users/ipedowitz/.asdf/installs/postgres/14.9/bin/pg_ctl -D /Users/ipedowitz/GitLab.com/gitlab-development-kit/postgresql/data -l logfile start


--------------------------------------------------------------------------------
Ensuring necessary data services are running
--------------------------------------------------------------------------------
ok: run: /Users/ipedowitz/GitLab.com/gitlab-development-kit/services/postgresql: (pid 51201) 0s, normally down
ok: run: /Users/ipedowitz/GitLab.com/gitlab-development-kit/services/praefect: (pid 51202) 0s, normally down
ok: run: /Users/ipedowitz/GitLab.com/gitlab-development-kit/services/praefect-gitaly-0: (pid 51204) 0s, normally down
ok: run: /Users/ipedowitz/GitLab.com/gitlab-development-kit/services/redis: (pid 51203) 0s, normally down

--------------------------------------------------------------------------------
Ensuring GDK managed configuration files are up-to-date
--------------------------------------------------------------------------------

--------------------------------------------------------------------------------
Ensuring necessary databases are setup and seeded
--------------------------------------------------------------------------------
praefect sql-migrate: migrations to apply: 42

=  2024-03-05T21:02:03 20200109161404_hello_world: migrating
== 2024-03-05T21:02:03 20200109161404_hello_world: applied (755.459µs)
=  2024-03-05T21:02:03 20200113151438_1_test_migration: migrating
== 2024-03-05T21:02:03 20200113151438_1_test_migration: applied (550.959µs)
=  2024-03-05T21:02:03 20200224220728_job_queue: migrating
== 2024-03-05T21:02:03 20200224220728_job_queue: applied (9.461833ms)
=  2024-03-05T21:02:03 20200225220728_readd_job_queue: migrating
== 2024-03-05T21:02:03 20200225220728_readd_job_queue: applied (8.224459ms)
=  2024-03-05T21:02:03 20200324001604_add_sql_election_tables: migrating
== 2024-03-05T21:02:03 20200324001604_add_sql_election_tables: applied (11.335042ms)
=  2024-03-05T21:02:03 20200422131451_add_shard_read_only_column: migrating
== 2024-03-05T21:02:03 20200422131451_add_shard_read_only_column: applied (976.542µs)
=  2024-03-05T21:02:03 20200512131219_replication_job_indexing: migrating
== 2024-03-05T21:02:03 20200512131219_replication_job_indexing: applied (7.292125ms)
=  2024-03-05T21:02:03 20200527103816_drop_old_gitaly_tables: migrating
== 2024-03-05T21:02:03 20200527103816_drop_old_gitaly_tables: applied (481.041µs)
=  2024-03-05T21:02:03 20200602154246_remember_previous_writable_primary: migrating
== 2024-03-05T21:02:03 20200602154246_remember_previous_writable_primary: applied (367.041µs)
=  2024-03-05T21:02:03 20200707101830_repositories_table: migrating
== 2024-03-05T21:02:03 20200707101830_repositories_table: applied (1.735584ms)
=  2024-03-05T21:02:03 20200810055650_replication_queue_cleanup: migrating
== 2024-03-05T21:02:03 20200810055650_replication_queue_cleanup: applied (651.166µs)
=  2024-03-05T21:02:03 20200921154417_repositories_nullable_generation: migrating
== 2024-03-05T21:02:03 20200921154417_repositories_nullable_generation: applied (348.083µs)
=  2024-03-05T21:02:03 20200921170311_repositories_primary_column: migrating
== 2024-03-05T21:02:03 20200921170311_repositories_primary_column: applied (290.708µs)
=  2024-03-05T21:02:03 20201006125956_trigger_repository_update_generation: migrating
== 2024-03-05T21:02:03 20201006125956_trigger_repository_update_generation: applied (735.541µs)
=  2024-03-05T21:02:03 20201102115118_variable_replication_factor: migrating
== 2024-03-05T21:02:03 20201102115118_variable_replication_factor: applied (407.083µs)
=  2024-03-05T21:02:03 20201102171914_virtual_storage_configuration: migrating
== 2024-03-05T21:02:03 20201102171914_virtual_storage_configuration: applied (1.769167ms)
=  2024-03-05T21:02:03 20201126165633_repository_assignments_table: migrating
== 2024-03-05T21:02:03 20201126165633_repository_assignments_table: applied (1.257583ms)
=  2024-03-05T21:02:03 20201208163237_cleanup_notifiactions_payload: migrating
== 2024-03-05T21:02:03 20201208163237_cleanup_notifiactions_payload: applied (556.458µs)
=  2024-03-05T21:02:03 20201231075619_remove_unused_assigned_column: migrating
== 2024-03-05T21:02:03 20201231075619_remove_unused_assigned_column: applied (622.75µs)
=  2024-03-05T21:02:03 20210223130233_delete_replica_unique_index: migrating
== 2024-03-05T21:02:03 20210223130233_delete_replica_unique_index: applied (1.062834ms)
=  2024-03-05T21:02:03 20210225101159_replication_queue_target_index: migrating
== 2024-03-05T21:02:03 20210225101159_replication_queue_target_index: applied (1.228125ms)
=  2024-03-05T21:02:03 20210525143540_healthy_storages_view: migrating
== 2024-03-05T21:02:03 20210525143540_healthy_storages_view: applied (1.325708ms)
=  2024-03-05T21:02:03 20210525173505_valid_primaries_view: migrating
== 2024-03-05T21:02:03 20210525173505_valid_primaries_view: applied (1.271ms)
=  2024-03-05T21:02:03 20210607124235_optimize_valid_primaries_view: migrating
== 2024-03-05T21:02:03 20210607124235_optimize_valid_primaries_view: applied (1.069833ms)
=  2024-03-05T21:02:03 20210727085659_repository_ids: migrating
== 2024-03-05T21:02:03 20210727085659_repository_ids: applied (4.079958ms)
=  2024-03-05T21:02:03 20210906130405_add_replica_path: migrating
== 2024-03-05T21:02:03 20210906130405_add_replica_path: applied (557.417µs)
=  2024-03-05T21:02:03 20210906145021_link_repository_id: migrating
== 2024-03-05T21:02:03 20210906145021_link_repository_id: applied (968.625µs)
=  2024-03-05T21:02:03 20210914115710_storage_cleanups_table: migrating
== 2024-03-05T21:02:03 20210914115710_storage_cleanups_table: applied (1.137666ms)
=  2024-03-05T21:02:03 20210921131816_backfill_replica_path: migrating
== 2024-03-05T21:02:03 20210921131816_backfill_replica_path: applied (456.417µs)
=  2024-03-05T21:02:03 20210922091614_repository_id_primary_key_indexes: migrating
== 2024-03-05T21:02:03 20210922091614_repository_id_primary_key_indexes: applied (1.135208ms)
=  2024-03-05T21:02:03 20210922143752_storage_repositories_cascade_delete: migrating
== 2024-03-05T21:02:03 20210922143752_storage_repositories_cascade_delete: applied (924.208µs)
=  2024-03-05T21:02:03 20210923155827_valid_primaries_view_repository_id: migrating
== 2024-03-05T21:02:03 20210923155827_valid_primaries_view_repository_id: applied (1.221833ms)
=  2024-03-05T21:02:03 20210927083631_repository_path_index: migrating
== 2024-03-05T21:02:03 20210927083631_repository_path_index: applied (903.958µs)
=  2024-03-05T21:02:03 20211018142158_valid_primaries_view_join_repo_id: migrating
== 2024-03-05T21:02:03 20211018142158_valid_primaries_view_join_repo_id: applied (1.13375ms)
=  2024-03-05T21:02:03 20211025113445_remove_cancelled_replication_events: migrating
== 2024-03-05T21:02:03 20211025113445_remove_cancelled_replication_events: applied (641.083µs)
=  2024-03-05T21:02:03 20211105100456_check_non_null_repository_id: migrating
== 2024-03-05T21:02:03 20211105100456_check_non_null_repository_id: applied (633.083µs)
=  2024-03-05T21:02:03 20211105100458_non_nullable_repository_id: migrating
== 2024-03-05T21:02:03 20211105100458_non_nullable_repository_id: applied (855.459µs)
=  2024-03-05T21:02:03 20220215160117_replication_queue_cleanup_again: migrating
== 2024-03-05T21:02:03 20220215160117_replication_queue_cleanup_again: applied (642.541µs)
=  2024-03-05T21:02:03 20220303105110_background_verification_columns: migrating
== 2024-03-05T21:02:03 20220303105110_background_verification_columns: applied (1.001292ms)
=  2024-03-05T21:02:03 20220404131105_stale_verification_lease_index: migrating
== 2024-03-05T21:02:03 20220404131105_stale_verification_lease_index: applied (815.709µs)
=  2024-03-05T21:02:03 20220407111624_ignore_verification_in_triggers: migrating
== 2024-03-05T21:02:03 20220407111624_ignore_verification_in_triggers: applied (735.083µs)
=  2024-03-05T21:02:03 20220520083313_remove_maintenance_replication_events: migrating
== 2024-03-05T21:02:03 20220520083313_remove_maintenance_replication_events: applied (1.106667ms)

praefect sql-migrate: OK (applied 42 migrations)
Waiting for praefect to boot.OK
Missing Rails.application.secrets.secret_key_base for development environment. The secret will be generated and stored in config/secrets.yml.
Missing Rails.application.secrets.otp_key_base for development environment. The secret will be generated and stored in config/secrets.yml.
Missing Rails.application.secrets.db_key_base for development environment. The secret will be generated and stored in config/secrets.yml.
Missing Rails.application.secrets.openid_connect_signing_key for development environment. The secret will be generated and stored in config/secrets.yml.
Dropped database 'gitlabhq_development'
Dropped database 'gitlabhq_development_ci'
Dropped database 'gitlabhq_test'
Dropped database 'gitlabhq_test_ci'
Created database 'gitlabhq_development'
Created database 'gitlabhq_development_ci'
Created database 'gitlabhq_test'
Created database 'gitlabhq_test_ci'
Waiting for praefect to boot.OK

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/001_create_base_work_item_types.rb

OK

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/002_default_organization.rb

OK

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/01_admin.rb
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/lib/ruby/gems/3.2.0/gems/bootsnap-1.18.3/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30: warning: ⛔️ WARNING: Sidekiq testing API enabled, but this is not the test environment.  Your jobs will not go to Redis.
.
OK

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/02_application_settings.rb
Creating the default ApplicationSetting record.
Enable hashed storage for every new projects.
rake aborted!
ActiveRecord::RecordInvalid: Validation failed: Diagramsnet url is blocked: execution expired
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
(eval):8:in `block (2 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:359:in `block in transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:358:in `transaction'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `load'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `<main>'
Tasks: TOP => db:seed_fu
(See full trace by running task with --trace)
ERROR: 'asdf exec bundle exec rake db:seed_fu' failed. Retrying in 2 secs..

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/001_create_base_work_item_types.rb

OK

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/002_default_organization.rb

OK

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/01_admin.rb
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/lib/ruby/gems/3.2.0/gems/bootsnap-1.18.3/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30: warning: ⛔️ WARNING: Sidekiq testing API enabled, but this is not the test environment.  Your jobs will not go to Redis.
rake aborted!
ActiveRecord::RecordInvalid: Validation failed: Email has already been taken, Username has already been taken
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
(eval):4:in `block (3 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:94:in `block (3 levels) in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:122:in `without_new_note_notifications'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:93:in `block (2 levels) in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:132:in `without_statement_timeout'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:92:in `block in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:148:in `without_database_logging'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:91:in `quiet'
(eval):3:in `block (2 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:359:in `block in transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:358:in `transaction'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `load'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `<main>'
Tasks: TOP => db:seed_fu
(See full trace by running task with --trace)
ERROR: 'asdf exec bundle exec rake db:seed_fu' failed. Retrying in 2 secs..

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/001_create_base_work_item_types.rb

OK

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/002_default_organization.rb

OK

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/01_admin.rb
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/lib/ruby/gems/3.2.0/gems/bootsnap-1.18.3/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30: warning: ⛔️ WARNING: Sidekiq testing API enabled, but this is not the test environment.  Your jobs will not go to Redis.
rake aborted!
ActiveRecord::RecordInvalid: Validation failed: Email has already been taken, Username has already been taken
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
(eval):4:in `block (3 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:94:in `block (3 levels) in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:122:in `without_new_note_notifications'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:93:in `block (2 levels) in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:132:in `without_statement_timeout'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:92:in `block in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:148:in `without_database_logging'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:91:in `quiet'
(eval):3:in `block (2 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:359:in `block in transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:358:in `transaction'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `load'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `<main>'
Tasks: TOP => db:seed_fu
(See full trace by running task with --trace)
ERROR: 'asdf exec bundle exec rake db:seed_fu' failed. Retrying in 2 secs..

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/001_create_base_work_item_types.rb

OK

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/002_default_organization.rb

OK

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/01_admin.rb
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/lib/ruby/gems/3.2.0/gems/bootsnap-1.18.3/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30: warning: ⛔️ WARNING: Sidekiq testing API enabled, but this is not the test environment.  Your jobs will not go to Redis.
rake aborted!
ActiveRecord::RecordInvalid: Validation failed: Email has already been taken, Username has already been taken
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
(eval):4:in `block (3 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:94:in `block (3 levels) in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:122:in `without_new_note_notifications'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:93:in `block (2 levels) in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:132:in `without_statement_timeout'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:92:in `block in quiet'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:148:in `without_database_logging'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/seeder.rb:91:in `quiet'
(eval):3:in `block (2 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:359:in `block in transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:358:in `transaction'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `load'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `<main>'
Tasks: TOP => db:seed_fu
(See full trace by running task with --trace)
ERROR: 'asdf exec bundle exec rake db:seed_fu' failed.
ERROR: The rake task 'db:seed_fu' failed. Trying to run it again!
make: *** [_postgresql-seed-rails] Error 1
ERROR: Failed to install.
-------------------------------------------------------
You can try the following that may be of assistance:

- Run 'gdk doctor'.

- Visit the troubleshooting documentation:
  https://gitlab.com/gitlab-org/gitlab-development-kit/-/blob/main/doc/troubleshooting/index.md.
- Visit https://gitlab.com/gitlab-org/gitlab-development-kit/-/issues to
  see if there are known issues.

- Run 'gdk reset-data' if appropriate.
- Run 'gdk pristine' which will restore your GDK to a pristine state.
-------------------------------------------------------
➜  GitLab.com

@ashmckenzie I suspect there may be an idle-in-transaction timeout as a result of making merge requests seeded properly via gitlab!146431 (merged). I'm inclined to change Sidekiq::Testing.inline! to Sidekiq::Testing.disable! to make the NewMergeRequestWorker in an actual Sidekiq job to avoid this, since Seed Fu runs everything in a transaction.

I'm also inclined to suggest that we support a mode with Seed Fu that doesn't run everything in a transaction, since this does more harm that good.

In the above stack trace, I see db/fixtures/development/01_admin.rb running twice. Was this a result of retrying the seeding? We should probably make that fixture idempotent.

I also see:

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/02_application_settings.rb
Creating the default ApplicationSetting record.
Enable hashed storage for every new projects.
rake aborted!
ActiveRecord::RecordInvalid: Validation failed: Diagramsnet url is blocked: execution expired

I'm a bit confused why diagramsnet_url is blocked by default?

Ok, can you try again? gitlab!146737 (merged) was merged, and I think this resolves some issues with seeding. gitlab!146739 (merged) should also allow retries to proceed further.

@stanhu just tried again, and I'm now getting this error:

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/01_admin.rb
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/lib/ruby/gems/3.2.0/gems/bootsnap-1.18.3/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:30: warning: ⛔️ WARNING: Sidekiq testing API enabled, but this is not the test environment.  Your jobs will not go to Redis.
Admin user already exists, skipping

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/02_application_settings.rb
Creating the default ApplicationSetting record.
Enable hashed storage for every new projects.
Generate CI JWT signing key
rake aborted!
ActiveRecord::RecordInvalid: Validation failed: Diagramsnet url is blocked: execution expired
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
(eval):11:in `block (2 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:359:in `block in transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:358:in `transaction'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `load'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `<main>'
Tasks: TOP => db:seed_fu
(See full trace by running task with --trace)
ERROR: 'asdf exec bundle exec rake db:seed_fu' failed.
ERROR: The rake task 'db:seed_fu' failed. Trying to run it again!
make: *** [_postgresql-seed-rails] Error 1
ERROR: Failed to install.
-------------------------------------------------------
You can try the following that may be of assistance:

- Run 'gdk doctor'.

- Visit the troubleshooting documentation:
  https://gitlab.com/gitlab-org/gitlab-development-kit/-/blob/main/doc/troubleshooting/index.md.
- Visit https://gitlab.com/gitlab-org/gitlab-development-kit/-/issues to
  see if there are known issues.

- Run 'gdk reset-data' if appropriate.
- Run 'gdk pristine' which will restore your GDK to a pristine state.
-------------------------------------------------------

I suspect you have some stale seed data from the last run. Could you try this to recover?

cd gitlab
bundle exec rake gitlab:db:setup

@stanhu this was a brand new installation. I rm -fr'd the directory before running curl "https://gitlab.com/gitlab-org/gitlab-development-kit/-/raw/main/support/install" | bash

I just installed a fresh GDK locally from master, but I couldn't get the same result. Here are the commands I've used:

git clone https://gitlab.com/gitlab-org/gitlab-development-kit.git gdk7`
cd gdk7
make bootstrap
gdk install
gdk start

Now, I'll try again using the one-line installation method.

Yeah, I think the DB seed wasn’t working yesterday, but it should be fixed with the latest changes. Ian, when did you try this clean install? It looks like the DB still had data.

...

On Wed, Mar 6, 2024 at 11:15 AM Nao Hashizume (@nao.hashizume) < gitlab@mg.gitlab.com> wrote:

Nao Hashizume https://gitlab.com/nao.hashizume commented on a discussion #2062 (comment 1804210362):

I just installed a fresh GDK locally from master, but I couldn't get the same result. Here are the commands I've used:

git clone https://gitlab.com/gitlab-org/gitlab-development-kit.git gdk7`cd gdk7make bootstrapgdk install

Now, I'll try again using the one-line installation method.

— Reply to this email directly or view it on GitLab #2062 (comment 1804210362).

You're receiving this email because of your account on gitlab.com. Unsubscribe https://gitlab.com/-/sent_notifications/REDACTED/unsubscribe from this thread · Manage all notifications https://gitlab.com/-/profile/notifications · Help https://gitlab.com/help

@stanhu I removed the directory, and ran the one-line installation method shortly after I saw your previous message.

Running again now and will report back.

The one-line installation worked for me. I ran into a UI error after setting a new password, but I think it's unrelated to this thread.

I just did another reinstall, and it appeared to succeed, however, when the install succeeded, the following file opened in my browser: file:///Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/tmp/letter_opener/1709755531_373121_f38550e/rich.html. Is that expected?

I'll remove and reinstall to test once again.

After running gdk stop and deleting the gitlab-development-kit and trying the one-line install, it now fails again. The only thing I did differently was I entered my username, ipedowitz, when prompted To improve GDK, GitLab would like to collect basic error and usage data. Please choose one of the following options

output

== Seed from /Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/db/fixtures/development/02_application_settings.rb
Creating the default ApplicationSetting record.
Enable hashed storage for every new projects.
rake aborted!
ActiveRecord::RecordInvalid: Validation failed: Diagramsnet url is blocked: execution expired
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
(eval):8:in `block (2 levels) in run_file'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `public_send'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:127:in `block in write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:141:in `block in read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:228:in `retry_with_backoff'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/load_balancer.rb:130:in `read_write'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:126:in `write_using_load_balancer'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database/load_balancing/connection_proxy.rb:78:in `transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:359:in `block in transaction'
/Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/lib/gitlab/database.rb:358:in `transaction'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `load'
/Users/ipedowitz/.asdf/installs/ruby/3.2.3/bin/bundle:25:in `<main>'
Tasks: TOP => db:seed_fu
(See full trace by running task with --trace)
ERROR: 'asdf exec bundle exec rake db:seed_fu' failed.
ERROR: The rake task 'db:seed_fu' failed. Trying to run it again!
make: *** [_postgresql-seed-rails] Error 1
ERROR: Failed to install.
-------------------------------------------------------
You can try the following that may be of assistance:

- Run 'gdk doctor'.

- Visit the troubleshooting documentation:
  https://gitlab.com/gitlab-org/gitlab-development-kit/-/blob/main/doc/troubleshooting/index.md.
- Visit https://gitlab.com/gitlab-org/gitlab-development-kit/-/issues to
  see if there are known issues.

- Run 'gdk reset-data' if appropriate.
- Run 'gdk pristine' which will restore your GDK to a pristine state.
-------------------------------------------------------

I then tried removing/reinstalling again, and didn't enter my username, and it worked... This time opening this URL when done: file:///Users/ipedowitz/GitLab.com/gitlab-development-kit/gitlab/tmp/letter_opener/1709760001_064676_697dca5/rich.html

Is there a bug related to the reporting and entering usernames?

I see two issues:

That e-mail is popping open because of gitlab!146737 (merged): now that merge requests are actually being created properly in a Sidekiq job, the GDK is sending e-mail notifications about them. letter_opener executes a command to open a browser window when the e-mail gets sent. I wonder how we should deal with this. Ideally we would suppress all notifications until the GDK is booted for the first time.
02_application_settings.rb seed: Somehow this is failing due to ActiveRecord::RecordInvalid: Validation failed: Diagramsnet url is blocked: execution expired. By default, it seems that we set these values: https://gitlab.com/gitlab-org/gitlab/-/blob/f3b281c6e53ce15374b73e85256c0d27da08e31d/app/models/application_setting_implementation.rb#L149-150. But we also allow external access by default. Why is execution expired showing up here? That message comes from Timeout.timeout. Possibly here? https://gitlab.com/gitlab-org/gitlab/-/blob/0ae68d1d7761eb7c3bdc7824e4183de0deeaf552/gems/gitlab-http/lib/gitlab/http_v2/url_blocker.rb#L196

For the first item, I'm inclined to change this back to an inline Sidekiq worker so we have more control over notifications etc. However, we probably should fork https://github.com/mbleigh/seed-fu since that project has gone unmaintained, and we'd need to add support for disabling database transactions to do this.

Thanks, @stanhu! Just curious, do you know why when I set the username for error/usage data, the install fails, but if I leave it blank, it succeeds?

I'm not sure how that would be related. Did it take about 15 seconds to fail? The error suggests that embeds.diagram.net couldn't be resolved on your system for some reason.

Hrmm, no, it was many minutes after kicking off the one-line install.

Oh, yes, it wouldn't fail until it got to that point. We don't have timestamps in the logs. I suspect what happened:

The 02_application_settings database seed started.
It created an entry with the defaults with embeds.diagram.net as the Diagrams URL.
The seed attempted to update the hashed_storage_enabled column.
The updating of the setting caused a validation of embeds.diagram.net, but this timed out after 15 seconds for some reason.

I don't know why it timed out, but we could improve this by avoiding multiple updates to that row: gitlab!146837 (merged)

mentioned in commit gitlab@ff90c0a1

mentioned in merge request gitlab!146737 (merged)

mentioned in commit gitlab@2fe54cbb

mentioned in merge request gitlab!146739 (merged)

mentioned in commit gitlab@d1f714eb

mentioned in commit gitlab@617f263b

mentioned in merge request gitlab!146837 (merged)

mentioned in commit gitlab@3bb16b4c

mentioned in commit gitlab@49b47755

mentioned in commit 1c420ef4

mentioned in merge request !3631 (merged)

mentioned in commit gitlab@5d9eb422

mentioned in merge request gitlab!147721 (merged)

FYI, with !3631 (merged) and gitlab!147721 (merged), this issue will be resolved on macOS.

assigned to @stanhu

changed milestone to %16.11

mentioned in commit 8dcb7bc6

mentioned in commit gitlab@4f5136b7

I'm going to close this now that !3631 (merged) and gitlab!147721 (merged) have been merged. This issue should no longer happen for macOS users.

closed

mentioned in issue omnibus-gitlab#8514

icu4c updates break brand new GDK installations

Overview

Impacted categories

Steps to replicate (optional)

Proposal (optional)

Environment (optional)

Designs

Child items ...

Activity