Master failing at rspec-pg-ee 2/10

Master is failing: https://gitlab.com/gitlab-org/gitlab-ee/-/jobs/163081228

Failures seem related to ~Geo:

...
-- create_table("file_registry", {:force=>:cascade})
   -> 0.0719s
-- create_table("job_artifact_registry", {:force=>:cascade})
   -> 0.0621s
-- create_table("project_registry", {:force=>:cascade})
   -> 0.2587s
-- initialize_schema_migrations_table()
   -> 0.0228s
[32;1m$ date[0;m
Mon Feb 18 10:12:49 UTC 2019
[32;1m$ JOB_NAME=( $CI_JOB_NAME )[0;m
[32;1m$ TEST_TOOL=${JOB_NAME[0]}[0;m
[32;1m$ export KNAPSACK_TEST_FILE_PATTERN="ee/spec/**{,/*/**}/*_spec.rb" KNAPSACK_GENERATE_REPORT=true CACHE_CLASSES=true[0;m
[32;1m$ export KNAPSACK_REPORT_PATH=knapsack/${CI_PROJECT_NAME}/${TEST_TOOL}_node_${CI_NODE_INDEX}_${CI_NODE_TOTAL}_report.json[0;m
[32;1m$ cp ${EE_KNAPSACK_RSPEC_SUITE_REPORT_PATH} ${KNAPSACK_REPORT_PATH}[0;m
[32;1m$ scripts/gitaly-test-spawn[0;m
Checking gitaly-ruby bundle...
Warning: the running version of Bundler (1.17.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.
The Gemfile's dependencies are satisfied
Trying to connect to gitaly: .... OK
[32;1m$ knapsack rspec "-Ispec --color --format documentation --format RspecJunitFormatter --out junit_rspec.xml --tag ~geo"[0;m
RSpec's reporter has already been initialized with #<IO:<STDERR>> as the deprecation stream, so your change to `deprecation_stream` will be ignored. You should configure it earlier for it to take effect, or use the `--deprecation-out` CLI option. (Called from /builds/gitlab-org/gitlab-ee/spec/support/rspec.rb:8:in `block in <top (required)>')
Knapsack report generator started!
Run options: exclude {:geo=>true}

==> Setting up GitLab Shell...
    GitLab Shell set up in 0.799404707 seconds...

==> Setting up Gitaly...
    Gitaly set up in 0.00013308 seconds...

DropRepositoryStorageEventsForGeoEvents
NOTICE:  index "index_projects_on_lower_name" does not exist, skipping
  #up
    table_name: :geo_hashed_storage_migrated_events
      dropped the repository_storage_path column (FAILED - 1)
    table_name: :geo_repository_created_events
rspec_profiling couldn't collect an example: FATAL:  remaining connection slots are reserved for non-replication superuser connections
. Further warnings suppressed.
      dropped the repository_storage_path column (FAILED - 2)
    table_name: :geo_repository_deleted_events
      dropped the repository_storage_path column (FAILED - 3)
    table_name: :geo_repository_renamed_events
      dropped the repository_storage_path column (FAILED - 4)
  #down
    geo_hashed_storage_migrated_events
      behaves like recreates the repository_storage_path column
        creates repository_storage_path column (FAILED - 5)
        fills in all repository_storage_path cells (FAILED - 6)
        fills in repository_storage_path with the legacy_disk_path (FAILED - 7)
    geo_repository_created_events
      behaves like recreates the repository_storage_path column
        creates repository_storage_path column (FAILED - 8)
        fills in all repository_storage_path cells (FAILED - 9)
        fills in repository_storage_path with the legacy_disk_path (FAILED - 10)
    geo_repository_deleted_events
      behaves like recreates the repository_storage_path column
        creates repository_storage_path column (FAILED - 11)
        fills in all repository_storage_path cells (FAILED - 12)
        fills in repository_storage_path with the legacy_disk_path (FAILED - 13)
    geo_repository_renamed_events
      behaves like recreates the repository_storage_path column
        creates repository_storage_path column (FAILED - 14)
        fills in all repository_storage_path cells (FAILED - 15)
        fills in repository_storage_path with the legacy_disk_path (FAILED - 16)

An error occurred in an `after(:context)` hook.
Failure/Error: klass.reset_column_information

PG::ConnectionBad:
  FATAL:  remaining connection slots are reserved for non-replication superuser connections
# ./spec/support/helpers/migrations_helpers.rb:64:in `reset_column_information'
# ./ee/spec/support/helpers/ee/migrations_helpers.rb:7:in `reset_column_information'
# ./spec/support/helpers/migrations_helpers.rb:49:in `each'
# ./spec/support/helpers/migrations_helpers.rb:49:in `reset_column_in_all_models'
# ./spec/support/helpers/migrations_helpers.rb:109:in `schema_migrate_up!'
# ./ee/spec/support/helpers/ee/migrations_helpers.rb:36:in `block in schema_migrate_up!'
# ./ee/spec/support/helpers/ee/migrations_helpers.rb:48:in `with_db_config'
# ./ee/spec/support/helpers/ee/migrations_helpers.rb:36:in `schema_migrate_up!'
# ./spec/spec_helper.rb:232:in `block (2 levels) in <top (required)>'

ApprovalState
  #approval_rules_overwritten?
    when approval rule on the merge request does not exist
2nd Try error in ./ee/spec/models/approval_state_spec.rb:62:
 PG::UndefinedColumn: ERROR:  column "runners_token_encrypted" of relation "projects" does not exist
LINE 1: ...l", "cached_markdown_version", "storage_version", "runners_t...
                                                             ^
: INSERT INTO "projects" ("name", "path", "created_at", "updated_at", "creator_id", "namespace_id", "runners_token", "has_external_issue_tracker", "description_html", "cached_markdown_version", "storage_version", "runners_token_encrypted", "archived", "visibility_level", "resolve_outdated_diff_discussions", "container_registry_enabled", "repository_storage", "shared_runners_enabled", "only_allow_merge_if_all_discussions_are_resolved", "packages_enabled") VALUES ('project1', 'project1', '2019-02-18 10:13:21.907029', '2019-02-18 10:13:21.907029', 1, 1, 'RNozS5sphhs3KMo8sxt_', 'f', '', 917504, 2, 'yb2VK86t+gubVlFZCoj5aHt6vXOjenW8ZOP/0v0YD2UParOa', 'f', 0, 'f', 't', 'default', 't', 'f', 't') RETURNING "id" 
...
Edited Feb 18, 2019 by Toon Claes
Assignee Loading
Time tracking Loading