Skip to content
Snippets Groups Projects

rspec-ee background_migration pg13 single-db-ci-connection 1/2

Passed Started by
🤖 GitLab Bot 🤖
@gitlab-bot
1Running with gitlab-runner 15.9.0~beta.212.g8ccc65e7 (8ccc65e7)
2 on green-4.private.runners-manager.gitlab.com/gitlab.com/gitlab-org rpvz2FF9, system ID: s_d704414ba02a
3 feature flags: FF_NETWORK_PER_BUILD:true, FF_USE_FASTZIP:true, FF_USE_IMPROVED_URL_MASKING:true
4 Resolving secrets 00:00
5 Preparing the "docker+machine" executor 00:34
6Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 ...
7Starting service postgres:13 ...
8Pulling docker image postgres:13 ...
9Using docker image sha256:dd421ca1f7f13d81c5c145d77d97d8d84cd0e6f1e045936ee506ce0f50ee397a for postgres:13 with digest postgres@sha256:00f455399f30cc3f2fe4185476601438b7a4959c74653665582d7c313a783d51 ...
10Starting service redis:6.2-alpine ...
11Pulling docker image redis:6.2-alpine ...
12Using docker image sha256:3616f0c0705d2a35d30dde109daf3cbe58ae7284121aafa6f5cfa987db98d1a8 for redis:6.2-alpine with digest redis@sha256:edddbcad5a41d58df2f142d68439922f1860ea902903d016257337c3342f30fc ...
13Starting service elasticsearch:7.17.6 ...
14Pulling docker image elasticsearch:7.17.6 ...
15Using docker image sha256:5fad10241ffd65d817ed0ddfaf6e87eee1f7dc2a7db33db1047835560ea71fda for elasticsearch:7.17.6 with digest elasticsearch@sha256:6c128de5d01c0c130a806022d6bd99b3e4c27a9af5bfc33b6b81861ae117d028 ...
16Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.0 ...
17Authenticating with credentials from job payload (GitLab Registry)
18Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.0 ...
19Using docker image sha256:4777ec1fa89def7d692d4979d05cb05234df25da1c6a3f67a564a433ec5ba1c8 for registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.0 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:80c0cee4566aefe4f1f287e1091263e08b0ebc41ed3dc4e76930df3634ccb9aa ...
20Waiting for services to be up and running (timeout 30 seconds)...
21Authenticating with credentials from job payload (GitLab Registry)
22Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 ...
23Using docker image sha256:7a1b51158a1ee23b080b514ce6ebbf52ac51585877198fb52709e5cd01805a77 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13@sha256:412d55913d43377094427ced549cb422ed2f2c7223e6a605d0d3e0151cb892b0 ...
24 Preparing environment 00:01
25Running on runner-rpvz2ff9-project-278964-concurrent-0 via runner-rpvz2ff9-private-1680164969-1e46828c...
26 Getting source from Git repository 00:41
27$ eval "$CI_PRE_CLONE_SCRIPT"
28Fetching changes with git depth set to 20...
29Initialized empty Git repository in /builds/gitlab-org/gitlab/.git/
30Created fresh repository.
31remote: Enumerating objects: 135903, done.
32remote: Counting objects: 100% (135903/135903), done.
33remote: Compressing objects: 100% (88560/88560), done.
34remote: Total 135903 (delta 58315), reused 94618 (delta 42152), pack-reused 0
35Receiving objects: 100% (135903/135903), 121.35 MiB | 30.38 MiB/s, done.
36Resolving deltas: 100% (58315/58315), done.
37From https://git-us-east1-d.ci-gateway.int.gprd.gitlab.net:8989/gitlab-org/gitlab
38 * [new ref] refs/pipelines/822866544 -> refs/pipelines/822866544
39Checking out 523abdde as detached HEAD (ref is refs/merge-requests/116270/merge)...
40Skipping Git submodules setup
41$ git remote set-url origin "${CI_REPOSITORY_URL}"
42 Restoring cache 00:14
43Checking cache for ruby-gems-debian-bullseye-ruby-3.0-16...
44cache.zip is up to date
45Successfully extracted cache
46Checking cache for gitaly-ruby-gems-debian-bullseye-ruby-3.0-16...
47cache.zip is up to date
48Successfully extracted cache
49 Downloading artifacts 00:21
50Downloading artifacts for compile-test-assets (4031138198)...
51Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4031138198 responseStatus=200 OK token=64_hGz-c
52Downloading artifacts for detect-tests (4031138213)...
53Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4031138213 responseStatus=200 OK token=64_hGz-c
54Downloading artifacts for retrieve-tests-metadata (4031138217)...
55Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4031138217 responseStatus=200 OK token=64_hGz-c
56Downloading artifacts for setup-test-env (4031138204)...
57Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4031138204 responseStatus=200 OK token=64_hGz-c
58 Executing "step_script" stage of the job script 13:38
59Using docker image sha256:7a1b51158a1ee23b080b514ce6ebbf52ac51585877198fb52709e5cd01805a77 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13@sha256:412d55913d43377094427ced549cb422ed2f2c7223e6a605d0d3e0151cb892b0 ...
60$ echo $FOSS_ONLY
61$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
62$ export GOPATH=$CI_PROJECT_DIR/.go
63$ mkdir -p $GOPATH
64$ source scripts/utils.sh
65$ source scripts/prepare_build.sh
66 Installing gems 00:12
716Using decomposed database config (config/database.yml.postgresql)
717Enabling ci connection (database_tasks: false) in config/database.yml
718Geo DB will be set up.
719$ setup_db_user_only
720CREATE ROLE
721GRANT
722==> 'setup_db_user_only' succeeded in 0 seconds.
723$ bundle exec rake db:drop db:create db:schema:load db:migrate gitlab:db:lock_writes
724Dropped database 'gitlabhq_test'
725Dropped database 'gitlabhq_geo_test'
726Created database 'gitlabhq_test'
727Created database 'gitlabhq_geo_test'
728==> 'bundle exec rake db:drop db:create db:schema:load db:migrate gitlab:db:lock_writes' succeeded in 38 seconds.
729$ setup_db_praefect
730SELECT pg_catalog.set_config('search_path', '', false);
731CREATE DATABASE praefect_test ENCODING 'UTF8';
732==> 'setup_db_praefect' succeeded in 0 seconds.
733$ source ./scripts/rspec_helpers.sh
734$ run_timed_command "gem install knapsack --no-document"
735$ gem install knapsack --no-document
736Successfully installed knapsack-4.0.0
7371 gem installed
738==> 'gem install knapsack --no-document' succeeded in 0 seconds.
739$ echo -e "\e[0Ksection_start:`date +%s`:gitaly-test-spawn[collapsed=true]\r\e[0KStarting Gitaly"
740 Starting Gitaly 00:10
843$ rspec_paralellized_job "--tag ~quarantine --tag ~zoekt"
844SKIP_FLAKY_TESTS_AUTOMATICALLY: false
845RETRY_FAILED_TESTS_IN_NEW_PROCESS: true
846KNAPSACK_GENERATE_REPORT: true
847FLAKY_RSPEC_GENERATE_REPORT: true
848KNAPSACK_TEST_FILE_PATTERN: {ee/}spec/{lib/gitlab/background_migration,lib/ee/gitlab/background_migration}{,/**/}*_spec.rb
849KNAPSACK_LOG_LEVEL: debug
850KNAPSACK_REPORT_PATH: knapsack/rspec-ee_background_migration_pg13_single-db-ci-connection_1_2_report.json
851FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json
852FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec-ee_background_migration_pg13_single-db-ci-connection_1_2_report.json
853NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec-ee_background_migration_pg13_single-db-ci-connection_1_2_report.json
854SKIPPED_FLAKY_TESTS_REPORT_PATH: rspec/flaky/skipped_flaky_tests_rspec-ee_background_migration_pg13_single-db-ci-connection_1_2_report.txt
855CRYSTALBALL:
856Knapsack report generator started!
857Run options: exclude {:quarantine=>true, :zoekt=>true}
858Test environment set up in 0.762087364 seconds
859Gitlab::BackgroundMigration::MigrateApproverToApprovalRules
860 sync approval rule and its members
861 merge request
862 behaves like sync approval member
863 when member in old schema but not in new schema
864 creates in new schema
865 when rule is not created yet
866 creates rule in new schema
867 when member not in old schema but in new schema
868 removes in new schema
869 when approver has user_id which no longer exists
870 ignores broken reference when assigning
871 when project rule is present
872 sets MR rule's source to project rule without duplication
873 when project rule is absent
874 has MR rule's source as nil
875 when approvals_before_merge is nil
876 updates with project's approvals_required
877 when approvals_before_merge is too big
878 caps at allowed maximum
879 when approver is no longer overwritten
880 removes rule
881 #sync_code_owners_with_approvers
882 when merge request is merged
883 does nothing
884 when code owner rule does not exist
885 creates rule
886 when code owner rule exists
887 reuses and updates existing rule
888 when there is no code owner
889 removes rule
890 project
891 behaves like sync approval member
892 when member in old schema but not in new schema
893 creates in new schema
894 when rule is not created yet
895 creates rule in new schema
896 when member not in old schema but in new schema
897 removes in new schema
898 when approver has user_id which no longer exists
899 ignores broken reference when assigning
900 when target is deleted
901 does not err
902 when project has no repository
903 does not err
904Gitlab::BackgroundMigration::BackfillIterationCadenceIdForBoards
905 up
906 when group does not have cadences
907 back-fill project boards
908 behaves like resets iteration_id to nil
909 resets iteration_id to nil
910 with pagination
911 expect batched updates
912 behaves like resets iteration_id to nil
913 resets iteration_id to nil
914 back-fill group boards
915 behaves like resets iteration_id to nil
916 resets iteration_id to nil
917 with pagination
918 expect batched updates
919 behaves like resets iteration_id to nil
920 resets iteration_id to nil
921 when group has cadences
922 when group does not have cadences
923 back-fill project boards
924 behaves like sets the correct cadence id
925 sets correct cadence id
926 with pagination
927 expect batched updates
928 behaves like sets the correct cadence id
929 sets correct cadence id
930 back-fill group boards
931 behaves like sets the correct cadence id
932 sets correct cadence id
933 with pagination
934 expect batched updates
935 behaves like sets the correct cadence id
936 sets correct cadence id
937 down
938 resets cadence id to nil
939 batched
940 resets cadence id to nil
941Gitlab::BackgroundMigration::RemoveAllTraceExpirationDates
942 on gitlab.com
943 sets expire_at for artifacts in range to nil
944 does not change expire_at timestamps that are not set to midnight
945 does not change expire_at timestamps that are set to midnight on a day other than the 22nd
946 does not touch artifacts outside id range
947 does not touch artifacts outside date range
948Gitlab::BackgroundMigration::RecalculateVulnerabilityFindingSignaturesForFindings
949 updates finding signatures
950 logs error on unexpected failure
951 logs error on malformed JSON failure
952 drops invalid row when metadata is missing tracking
953 drops invalid row when tracking signatures data is malformed
954Gitlab::BackgroundMigration::PopulateResolvedOnDefaultBranchColumn
955 #perform
956 calls `PopulateResolvedOnDefaultBranchColumnForProject.perform` for each project by given ids
957 EE::Gitlab::BackgroundMigration::PopulateResolvedOnDefaultBranchColumn::PopulateResolvedOnDefaultBranchColumnForProject
958 .perform
959 instantiates the utility service object and calls #perform on it
960 #perform
961 sets `resolved_on_default_branch` attribute of disappeared vulnerabilities
962Gitlab::BackgroundMigration::BackfillProjectStatisticsContainerRepositorySize
963 #filter_batch
964 filters out container repositories out of scope
965 #perform
966 when project_statistics backfill runs
967 when project_statistics.container_registry_size is zero
968 calls deduplicated_size API
969 when the Container Registry deduplicated_size is non-zero
970 schedules Namespaces::ScheduleAggregationWorker
971 when the Container Registry deduplicated_size is zero
972 does not schedules Namespaces::ScheduleAggregationWorker
973 when project_statistics.container_registry_size is non-zero
974 doesn't call deduplicated_size API and schedules Namespaces::ScheduleAggregationWorker
975Gitlab::BackgroundMigration::CreateSecuritySetting
976 #perform
977 adds setting object for existing projects
978Gitlab::BackgroundMigration::PopulateLatestPipelineIds
979 #perform
980 sets the latest_pipeline_id
981Gitlab::BackgroundMigration::DeleteInvalidEpicIssues
982 #perform
983 removes invalid epic issues
984 logs deleted records
985 prevents N+1 queries
986Gitlab::BackgroundMigration::PopulateNamespaceStatistics
987 creates/updates all namespace_statistics and update root storage statistics
988 when group wikis are not enabled
989 does not update wiki stats
990 when just a stat is passed
991 calls the statistics update service with just that stat
992Gitlab::BackgroundMigration::MigrateApproverToApprovalRulesInBatch
993 when there is no more MigrateApproverToApprovalRules jobs
994 migrates individual target
995Gitlab::BackgroundMigration::BackfillEpicCacheCounts
996 # order random
997 #perform
998 updates cache counts recursively from most nested subepics
999 when there are too many nested levels
1000 aborts update when reaching max depth and logs error
1001Gitlab::BackgroundMigration::BackfillNamespaceLdapSettings
1002 # order random
1003 #perform
1004 migrates LDAP sync values by batch
1005 does not create multiple entries or conflict on existing record
1006Gitlab::BackgroundMigration::BackfillComplianceViolations
1007 # order random
1008 migrates data from merge_requests and merge_request_metrics into compliance violations table
1009Gitlab::BackgroundMigration::FixSecurityScanStatuses
1010 # order random
1011 #perform
1012 fixes the scan statuses
1013Knapsack report was generated. Preview:
1014{
1015 "ee/spec/lib/ee/gitlab/background_migration/migrate_approver_to_approval_rules_spec.rb": 74.03413628300041,
1016 "ee/spec/lib/ee/gitlab/background_migration/backfill_iteration_cadence_id_for_boards_spec.rb": 51.15833752300023,
1017 "ee/spec/lib/gitlab/background_migration/remove_all_trace_expiration_dates_spec.rb": 38.932879536001565,
1018 "ee/spec/lib/ee/gitlab/background_migration/recalculate_vulnerability_finding_signatures_for_findings_spec.rb": 35.967355828999644,
1019 "ee/spec/lib/ee/gitlab/background_migration/populate_resolved_on_default_branch_column_spec.rb": 31.484745052999642,
1020 "ee/spec/lib/ee/gitlab/background_migration/backfill_project_statistics_container_repository_size_spec.rb": 33.85431425600109,
1021 "ee/spec/lib/ee/gitlab/background_migration/create_security_setting_spec.rb": 28.181464493998647,
1022 "ee/spec/lib/ee/gitlab/background_migration/populate_latest_pipeline_ids_spec.rb": 28.695755665999968,
1023 "ee/spec/lib/ee/gitlab/background_migration/delete_invalid_epic_issues_spec.rb": 8.85225110600004,
1024 "ee/spec/lib/ee/gitlab/background_migration/populate_namespace_statistics_spec.rb": 8.690935693000938,
1025 "ee/spec/lib/ee/gitlab/background_migration/migrate_approver_to_approval_rules_in_batch_spec.rb": 7.046143248999215,
1026 "ee/spec/lib/ee/gitlab/background_migration/backfill_epic_cache_counts_spec.rb": 6.231739429998925,
1027 "ee/spec/lib/ee/gitlab/background_migration/backfill_namespace_ldap_settings_spec.rb": 5.073471260000588,
1028 "ee/spec/lib/ee/gitlab/background_migration/backfill_compliance_violations_spec.rb": 3.1907448820002173,
1029 "ee/spec/lib/ee/gitlab/background_migration/fix_security_scan_statuses_spec.rb": 4.248167432999253
1030}
1031Knapsack global time execution for tests: 06m 05s
1032Finished in 11 minutes 14 seconds (files took 1 minute 8.17 seconds to load)
103366 examples, 0 failures
1034Randomized with seed 38964
1035[TEST PROF INFO] Time spent in factories: 00:36.090 (5.14% of total time)
1036RSpec exited with 0.
1037No examples to retry, congrats!
1038 Saving cache for successful job 00:00
1039Not uploading cache ruby-gems-debian-bullseye-ruby-3.0-16 due to policy
1040Not uploading cache gitaly-ruby-gems-debian-bullseye-ruby-3.0-16 due to policy
1041 Uploading artifacts for successful job 00:06
1042Uploading artifacts...
1043coverage/: found 5 matching artifact files and directories
1044crystalball/: found 2 matching artifact files and directories
1045WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
1046knapsack/: found 3 matching artifact files and directories
1047WARNING: query_recorder/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
1048rspec/: found 14 matching artifact files and directories
1049WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
1050log/*.log: found 13 matching artifact files and directories
1051WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/4031139193/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
1052WARNING: Retrying... context=artifacts-uploader error=request redirected
1053Uploading artifacts as "archive" to coordinator... 201 Created id=4031139193 responseStatus=201 Created token=64_hGz-c
1054Uploading artifacts...
1055rspec/junit_rspec.xml: found 1 matching artifact files and directories
1056WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/4031139193/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com
1057WARNING: Retrying... context=artifacts-uploader error=request redirected
1058Uploading artifacts as "junit" to coordinator... 201 Created id=4031139193 responseStatus=201 Created token=64_hGz-c
1059 Cleaning up project directory and file based variables 00:00
1060Job succeeded