Skip to content
Snippets Groups Projects

rspec-ee background_migration pg13 single-db 1/2

Passed Started by
🤖 GitLab Bot 🤖
@gitlab-bot
1Running with gitlab-runner 15.9.0~beta.115.g598a7c91 (598a7c91)
2 on green-4.shared-gitlab-org.runners-manager.gitlab.com/default x5QiHUKw, system ID: s_b9637080a79e
3 feature flags: FF_NETWORK_PER_BUILD:true, FF_USE_FASTZIP:true, FF_USE_IMPROVED_URL_MASKING:true
4 Resolving secrets 00:00
5 Preparing the "docker+machine" executor 00:25
6Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 ...
7Starting service postgres:13 ...
8Pulling docker image postgres:13 ...
9Using docker image sha256:dd421ca1f7f13d81c5c145d77d97d8d84cd0e6f1e045936ee506ce0f50ee397a for postgres:13 with digest postgres@sha256:00f455399f30cc3f2fe4185476601438b7a4959c74653665582d7c313a783d51 ...
10Starting service redis:6.2-alpine ...
11Pulling docker image redis:6.2-alpine ...
12Using docker image sha256:3616f0c0705d2a35d30dde109daf3cbe58ae7284121aafa6f5cfa987db98d1a8 for redis:6.2-alpine with digest redis@sha256:edddbcad5a41d58df2f142d68439922f1860ea902903d016257337c3342f30fc ...
13Starting service elasticsearch:7.17.6 ...
14Pulling docker image elasticsearch:7.17.6 ...
15Using docker image sha256:5fad10241ffd65d817ed0ddfaf6e87eee1f7dc2a7db33db1047835560ea71fda for elasticsearch:7.17.6 with digest elasticsearch@sha256:6c128de5d01c0c130a806022d6bd99b3e4c27a9af5bfc33b6b81861ae117d028 ...
16Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.0 ...
17Authenticating with credentials from job payload (GitLab Registry)
18Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.0 ...
19Using docker image sha256:4777ec1fa89def7d692d4979d05cb05234df25da1c6a3f67a564a433ec5ba1c8 for registry.gitlab.com/gitlab-org/gitlab-build-images:zoekt-ci-image-1.0 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:80c0cee4566aefe4f1f287e1091263e08b0ebc41ed3dc4e76930df3634ccb9aa ...
20Waiting for services to be up and running (timeout 30 seconds)...
21Authenticating with credentials from job payload (GitLab Registry)
22Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 ...
23Using docker image sha256:7a1b51158a1ee23b080b514ce6ebbf52ac51585877198fb52709e5cd01805a77 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13@sha256:412d55913d43377094427ced549cb422ed2f2c7223e6a605d0d3e0151cb892b0 ...
24 Preparing environment 00:01
25Running on runner-x5qihukw-project-278964-concurrent-0 via runner-x5qihukw-shared-gitlab-org-1680164852-55f776cc...
26 Getting source from Git repository 00:38
27$ eval "$CI_PRE_CLONE_SCRIPT"
28Fetching changes with git depth set to 20...
29Initialized empty Git repository in /builds/gitlab-org/gitlab/.git/
30Created fresh repository.
31remote: Enumerating objects: 135903, done.
32remote: Counting objects: 100% (135903/135903), done.
33remote: Compressing objects: 100% (88560/88560), done.
34remote: Total 135903 (delta 58315), reused 94618 (delta 42152), pack-reused 0
35Receiving objects: 100% (135903/135903), 121.35 MiB | 31.55 MiB/s, done.
36Resolving deltas: 100% (58315/58315), done.
37From https://git-us-east1-d.ci-gateway.int.gprd.gitlab.net:8989/gitlab-org/gitlab
38 * [new ref] refs/pipelines/822866544 -> refs/pipelines/822866544
39Checking out 523abdde as detached HEAD (ref is refs/merge-requests/116270/merge)...
40Skipping Git submodules setup
41$ git remote set-url origin "${CI_REPOSITORY_URL}"
42 Restoring cache 00:14
43Checking cache for ruby-gems-debian-bullseye-ruby-3.0-16...
44cache.zip is up to date
45Successfully extracted cache
46Checking cache for gitaly-ruby-gems-debian-bullseye-ruby-3.0-16...
47cache.zip is up to date
48Successfully extracted cache
49 Downloading artifacts 00:21
50Downloading artifacts for compile-test-assets (4031138198)...
51Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4031138198 responseStatus=200 OK token=64_KxULT
52Downloading artifacts for detect-tests (4031138213)...
53Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4031138213 responseStatus=200 OK token=64_KxULT
54Downloading artifacts for retrieve-tests-metadata (4031138217)...
55Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4031138217 responseStatus=200 OK token=64_KxULT
56Downloading artifacts for setup-test-env (4031138204)...
57Downloading artifacts from coordinator... ok host=storage.googleapis.com id=4031138204 responseStatus=200 OK token=64_KxULT
58 Executing "step_script" stage of the job script 10:59
59Using docker image sha256:7a1b51158a1ee23b080b514ce6ebbf52ac51585877198fb52709e5cd01805a77 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-13@sha256:412d55913d43377094427ced549cb422ed2f2c7223e6a605d0d3e0151cb892b0 ...
60$ echo $FOSS_ONLY
61$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
62$ export GOPATH=$CI_PROJECT_DIR/.go
63$ mkdir -p $GOPATH
64$ source scripts/utils.sh
65$ source scripts/prepare_build.sh
66 Installing gems 00:15
716Using decomposed database config (config/database.yml.postgresql)
717Geo DB will be set up.
718$ setup_db_user_only
719CREATE ROLE
720GRANT
721==> 'setup_db_user_only' succeeded in 0 seconds.
722$ bundle exec rake db:drop db:create db:schema:load db:migrate gitlab:db:lock_writes
723Dropped database 'gitlabhq_test'
724Dropped database 'gitlabhq_geo_test'
725Created database 'gitlabhq_test'
726Created database 'gitlabhq_geo_test'
727==> 'bundle exec rake db:drop db:create db:schema:load db:migrate gitlab:db:lock_writes' succeeded in 38 seconds.
728$ setup_db_praefect
729SELECT pg_catalog.set_config('search_path', '', false);
730CREATE DATABASE praefect_test ENCODING 'UTF8';
731==> 'setup_db_praefect' succeeded in 0 seconds.
732$ source ./scripts/rspec_helpers.sh
733$ run_timed_command "gem install knapsack --no-document"
734$ gem install knapsack --no-document
735Successfully installed knapsack-4.0.0
7361 gem installed
737==> 'gem install knapsack --no-document' succeeded in 1 seconds.
738$ echo -e "\e[0Ksection_start:`date +%s`:gitaly-test-spawn[collapsed=true]\r\e[0KStarting Gitaly"
739 Starting Gitaly 00:11
842$ rspec_paralellized_job "--tag ~quarantine --tag ~zoekt"
843SKIP_FLAKY_TESTS_AUTOMATICALLY: false
844RETRY_FAILED_TESTS_IN_NEW_PROCESS: true
845KNAPSACK_GENERATE_REPORT: true
846FLAKY_RSPEC_GENERATE_REPORT: true
847KNAPSACK_TEST_FILE_PATTERN: {ee/}spec/{lib/gitlab/background_migration,lib/ee/gitlab/background_migration}{,/**/}*_spec.rb
848KNAPSACK_LOG_LEVEL: debug
849KNAPSACK_REPORT_PATH: knapsack/rspec-ee_background_migration_pg13_single-db_1_2_report.json
850FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json
851FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec-ee_background_migration_pg13_single-db_1_2_report.json
852NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec-ee_background_migration_pg13_single-db_1_2_report.json
853SKIPPED_FLAKY_TESTS_REPORT_PATH: rspec/flaky/skipped_flaky_tests_rspec-ee_background_migration_pg13_single-db_1_2_report.txt
854CRYSTALBALL:
855Knapsack report generator started!
856Run options: exclude {:quarantine=>true, :zoekt=>true}
857Test environment set up in 0.664734324 seconds
858Gitlab::BackgroundMigration::MigrateApproverToApprovalRules
859 sync approval rule and its members
860 merge request
861 behaves like sync approval member
862 when member in old schema but not in new schema
863 creates in new schema
864 when rule is not created yet
865 creates rule in new schema
866 when member not in old schema but in new schema
867 removes in new schema
868 when approver has user_id which no longer exists
869 ignores broken reference when assigning
870 when project rule is present
871 sets MR rule's source to project rule without duplication
872 when project rule is absent
873 has MR rule's source as nil
874 when approvals_before_merge is nil
875 updates with project's approvals_required
876 when approvals_before_merge is too big
877 caps at allowed maximum
878 when approver is no longer overwritten
879 removes rule
880 #sync_code_owners_with_approvers
881 when merge request is merged
882 does nothing
883 when code owner rule does not exist
884 creates rule
885 when code owner rule exists
886 reuses and updates existing rule
887 when there is no code owner
888 removes rule
889 project
890 behaves like sync approval member
891 when member in old schema but not in new schema
892 creates in new schema
893 when rule is not created yet
894 creates rule in new schema
895 when member not in old schema but in new schema
896 removes in new schema
897 when approver has user_id which no longer exists
898 ignores broken reference when assigning
899 when target is deleted
900 does not err
901 when project has no repository
902 does not err
903Gitlab::BackgroundMigration::BackfillIterationCadenceIdForBoards
904 up
905 when group does not have cadences
906 back-fill project boards
907 behaves like resets iteration_id to nil
908 resets iteration_id to nil
909 with pagination
910 expect batched updates
911 behaves like resets iteration_id to nil
912 resets iteration_id to nil
913 back-fill group boards
914 behaves like resets iteration_id to nil
915 resets iteration_id to nil
916 with pagination
917 expect batched updates
918 behaves like resets iteration_id to nil
919 resets iteration_id to nil
920 when group has cadences
921 when group does not have cadences
922 back-fill project boards
923 behaves like sets the correct cadence id
924 sets correct cadence id
925 with pagination
926 expect batched updates
927 behaves like sets the correct cadence id
928 sets correct cadence id
929 back-fill group boards
930 behaves like sets the correct cadence id
931 sets correct cadence id
932 with pagination
933 expect batched updates
934 behaves like sets the correct cadence id
935 sets correct cadence id
936 down
937 resets cadence id to nil
938 batched
939 resets cadence id to nil
940Gitlab::BackgroundMigration::RemoveAllTraceExpirationDates
941 on gitlab.com
942 sets expire_at for artifacts in range to nil
943 does not change expire_at timestamps that are not set to midnight
944 does not change expire_at timestamps that are set to midnight on a day other than the 22nd
945 does not touch artifacts outside id range
946 does not touch artifacts outside date range
947Gitlab::BackgroundMigration::RecalculateVulnerabilityFindingSignaturesForFindings
948 updates finding signatures
949 logs error on unexpected failure
950 logs error on malformed JSON failure
951 drops invalid row when metadata is missing tracking
952 drops invalid row when tracking signatures data is malformed
953Gitlab::BackgroundMigration::PopulateResolvedOnDefaultBranchColumn
954 #perform
955 calls `PopulateResolvedOnDefaultBranchColumnForProject.perform` for each project by given ids
956 EE::Gitlab::BackgroundMigration::PopulateResolvedOnDefaultBranchColumn::PopulateResolvedOnDefaultBranchColumnForProject
957 .perform
958 instantiates the utility service object and calls #perform on it
959 #perform
960 sets `resolved_on_default_branch` attribute of disappeared vulnerabilities
961Gitlab::BackgroundMigration::BackfillProjectStatisticsContainerRepositorySize
962 #filter_batch
963 filters out container repositories out of scope
964 #perform
965 when project_statistics backfill runs
966 when project_statistics.container_registry_size is zero
967 calls deduplicated_size API
968 when the Container Registry deduplicated_size is non-zero
969 schedules Namespaces::ScheduleAggregationWorker
970 when the Container Registry deduplicated_size is zero
971 does not schedules Namespaces::ScheduleAggregationWorker
972 when project_statistics.container_registry_size is non-zero
973 doesn't call deduplicated_size API and schedules Namespaces::ScheduleAggregationWorker
974Gitlab::BackgroundMigration::CreateSecuritySetting
975 #perform
976 adds setting object for existing projects
977Gitlab::BackgroundMigration::PopulateLatestPipelineIds
978 #perform
979 sets the latest_pipeline_id
980Gitlab::BackgroundMigration::DeleteInvalidEpicIssues
981 #perform
982 removes invalid epic issues
983 logs deleted records
984 prevents N+1 queries
985Gitlab::BackgroundMigration::PopulateNamespaceStatistics
986 creates/updates all namespace_statistics and update root storage statistics
987 when group wikis are not enabled
988 does not update wiki stats
989 when just a stat is passed
990 calls the statistics update service with just that stat
991Gitlab::BackgroundMigration::MigrateApproverToApprovalRulesInBatch
992 when there is no more MigrateApproverToApprovalRules jobs
993 migrates individual target
994Gitlab::BackgroundMigration::BackfillEpicCacheCounts
995 # order random
996 #perform
997 updates cache counts recursively from most nested subepics
998 when there are too many nested levels
999 aborts update when reaching max depth and logs error
1000Gitlab::BackgroundMigration::BackfillNamespaceLdapSettings
1001 # order random
1002 #perform
1003 migrates LDAP sync values by batch
1004 does not create multiple entries or conflict on existing record
1005Gitlab::BackgroundMigration::BackfillComplianceViolations
1006 # order random
1007 migrates data from merge_requests and merge_request_metrics into compliance violations table
1008Gitlab::BackgroundMigration::FixSecurityScanStatuses
1009 # order random
1010 #perform
1011 fixes the scan statuses
1012Knapsack report was generated. Preview:
1013{
1014 "ee/spec/lib/ee/gitlab/background_migration/migrate_approver_to_approval_rules_spec.rb": 49.823430526001175,
1015 "ee/spec/lib/ee/gitlab/background_migration/backfill_iteration_cadence_id_for_boards_spec.rb": 33.531651162000344,
1016 "ee/spec/lib/gitlab/background_migration/remove_all_trace_expiration_dates_spec.rb": 34.163571107999815,
1017 "ee/spec/lib/ee/gitlab/background_migration/recalculate_vulnerability_finding_signatures_for_findings_spec.rb": 31.31149468499825,
1018 "ee/spec/lib/ee/gitlab/background_migration/populate_resolved_on_default_branch_column_spec.rb": 28.647060518000217,
1019 "ee/spec/lib/ee/gitlab/background_migration/backfill_project_statistics_container_repository_size_spec.rb": 27.21193106500141,
1020 "ee/spec/lib/ee/gitlab/background_migration/create_security_setting_spec.rb": 25.959960452000814,
1021 "ee/spec/lib/ee/gitlab/background_migration/populate_latest_pipeline_ids_spec.rb": 27.57589072999872,
1022 "ee/spec/lib/ee/gitlab/background_migration/delete_invalid_epic_issues_spec.rb": 5.419183298999997,
1023 "ee/spec/lib/ee/gitlab/background_migration/populate_namespace_statistics_spec.rb": 4.307255294999777,
1024 "ee/spec/lib/ee/gitlab/background_migration/migrate_approver_to_approval_rules_in_batch_spec.rb": 5.428946377998727,
1025 "ee/spec/lib/ee/gitlab/background_migration/backfill_epic_cache_counts_spec.rb": 3.421433886000159,
1026 "ee/spec/lib/ee/gitlab/background_migration/backfill_namespace_ldap_settings_spec.rb": 2.7275070729992876,
1027 "ee/spec/lib/ee/gitlab/background_migration/backfill_compliance_violations_spec.rb": 1.938716138000018,
1028 "ee/spec/lib/ee/gitlab/background_migration/fix_security_scan_statuses_spec.rb": 1.8400390339993464
1029}
1030Knapsack global time execution for tests: 04m 43s
1031Finished in 8 minutes 41 seconds (files took 1 minute 4.31 seconds to load)
103266 examples, 0 failures
1033Randomized with seed 51
1034[TEST PROF INFO] Time spent in factories: 00:36.644 (6.74% of total time)
1035RSpec exited with 0.
1036No examples to retry, congrats!
1037 Saving cache for successful job 00:01
1038Not uploading cache ruby-gems-debian-bullseye-ruby-3.0-16 due to policy
1039Not uploading cache gitaly-ruby-gems-debian-bullseye-ruby-3.0-16 due to policy
1040 Uploading artifacts for successful job 00:05
1041Uploading artifacts...
1042coverage/: found 5 matching artifact files and directories
1043crystalball/: found 2 matching artifact files and directories
1044WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
1045knapsack/: found 3 matching artifact files and directories
1046WARNING: query_recorder/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
1047rspec/: found 14 matching artifact files and directories
1048WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
1049log/*.log: found 13 matching artifact files and directories
1050WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/4031139177/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
1051WARNING: Retrying... context=artifacts-uploader error=request redirected
1052Uploading artifacts as "archive" to coordinator... 201 Created id=4031139177 responseStatus=201 Created token=64_KxULT
1053Uploading artifacts...
1054rspec/junit_rspec.xml: found 1 matching artifact files and directories
1055WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/4031139177/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com
1056WARNING: Retrying... context=artifacts-uploader error=request redirected
1057Uploading artifacts as "junit" to coordinator... 201 Created id=4031139177 responseStatus=201 Created token=64_KxULT
1058 Cleaning up project directory and file based variables 00:01
1059Job succeeded