Skip to content
Snippets Groups Projects

rspec background_migration pg14 9/10

Passed Started by
🤖 GitLab Bot 🤖
@gitlab-bot
1Running with gitlab-runner 17.0.0~pre.88.g761ae5dd (761ae5dd)
2 on green-1.private.runners-manager.gitlab.com/gitlab.com/gitlab-org 4bq1s9yM, system ID: s_9d15f3e4e7ae
3 feature flags: FF_NETWORK_PER_BUILD:true
4Resolving secrets
5 Preparing the "docker+machine" executor 00:09
6Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.1.5-golang-1.22-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
7Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...
8Authenticating with credentials from job payload (GitLab Registry)
9Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 ...
10Using docker image sha256:82f132c22567f8ce17cc132c14b2f9aa3eaf9bb5424d91c2d966912433f0257d for registry.gitlab.com/gitlab-org/gitlab-build-images:postgres-14-pgvector-0.4.1 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:c55e1364ee4327b244a9cfa1750f19feea14fc774eaf792b725967d146eb45f5 ...
11WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
12WARNING: Service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 is already created. Ignoring.
13Starting service registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...
14Authenticating with credentials from job payload (GitLab Registry)
15Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 ...
16Using docker image sha256:5c5ba5b83d6c60cb0b225bd670b7a43be8c238cc72347d24af57e5027c3648f3 for registry.gitlab.com/gitlab-org/gitlab-build-images:redis-cluster-6.2.12 with digest registry.gitlab.com/gitlab-org/gitlab-build-images@sha256:46aceab84c42d0e819c8e7940f2f98ce9e184785cd7b22d95872024a35f52407 ...
17Starting service redis:6.2-alpine ...
18Pulling docker image redis:6.2-alpine ...
19Using docker image sha256:36c1d3cfe18f4b12d4640576f7048068acbfc3625027b6bbb46bba0e31b11831 for redis:6.2-alpine with digest redis@sha256:e3b17ba9479deec4b7d1eeec1548a253acc5374d68d3b27937fcfe4df8d18c7e ...
20Waiting for services to be up and running (timeout 30 seconds)...
21Authenticating with credentials from job payload (GitLab Registry)
22Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.1.5-golang-1.22-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 ...
23Using docker image sha256:b26253b493531cada33f45ef568f38c50a310442d05c39f517656e0f7d305dc7 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.1.5-golang-1.22-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.1.5-golang-1.22-rust-1.73-node-20.12-postgresql-14@sha256:543339542a02edc250c2c0424c5077b673f1fca2877024fdc5fb670eff44f8cf ...
24 Preparing environment 00:00
25Running on runner-4bq1s9ym-project-278964-concurrent-0 via runner-4bq1s9ym-private-1722413270-5a61a9cd...
26 Getting source from Git repository 00:01
27Skipping Git repository setup
28Skipping Git checkout
29Skipping Git submodules setup
30 Restoring cache 00:17
31Checking cache for ruby-gems-debian-bookworm-ruby-3.1.5-17...
32Downloading cache from https://storage.googleapis.com/gitlab-com-runners-cache/project/278964/ruby-gems-debian-bookworm-ruby-3.1.5-17
33Successfully extracted cache
34 Downloading artifacts 00:39
35Downloading artifacts for clone-gitlab-repo (7471344368)...
36Downloading artifacts from coordinator... ok host=storage.googleapis.com id=7471344368 responseStatus=200 OK token=glcbt-66
37WARNING: Part of .git directory is on the list of files to extract
38WARNING: This may introduce unexpected problems
39Downloading artifacts for compile-test-assets (7471344747)...
40Downloading artifacts from coordinator... ok host=storage.googleapis.com id=7471344747 responseStatus=200 OK token=glcbt-66
41Downloading artifacts for retrieve-tests-metadata (7471344898)...
42Downloading artifacts from coordinator... ok host=storage.googleapis.com id=7471344898 responseStatus=200 OK token=glcbt-66
43Downloading artifacts for setup-test-env (7471344810)...
44Downloading artifacts from coordinator... ok host=storage.googleapis.com id=7471344810 responseStatus=200 OK token=glcbt-66
45 Executing "step_script" stage of the job script
46Using docker image sha256:b26253b493531cada33f45ef568f38c50a310442d05c39f517656e0f7d305dc7 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.1.5-golang-1.22-rust-1.73-node-20.12-postgresql-14:rubygems-3.4-git-2.36-lfs-2.9-chrome-123-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bookworm-ruby-3.1.5-golang-1.22-rust-1.73-node-20.12-postgresql-14@sha256:543339542a02edc250c2c0424c5077b673f1fca2877024fdc5fb670eff44f8cf ...
47$ echo $FOSS_ONLY
48$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
49$ export GOPATH=$CI_PROJECT_DIR/.go
50$ mkdir -p $GOPATH
51$ source scripts/utils.sh
52$ source scripts/prepare_build.sh
53 Installing gems 00:19
82Using decomposed database config (config/database.yml.decomposed-postgresql)
83Geo DB won't be set up.
84Embedding DB won't be set up.
85 Setting up DBs 01:15
96$ source ./scripts/rspec_helpers.sh
97$ run_timed_command "gem install knapsack --no-document"
98$ gem install knapsack --no-document
99Successfully installed knapsack-4.0.0
1001 gem installed
101==> 'gem install knapsack --no-document' succeeded in 2 seconds.
102$ section_start "gitaly-test-spawn" "Spawning Gitaly"; scripts/gitaly-test-spawn; section_end "gitaly-test-spawn"
103 Spawning Gitaly 00:04
107$ export RSPEC_SKIPPED_TESTS_REPORT_PATH="rspec/skipped_tests-${CI_JOB_ID}.txt"
108$ export RSPEC_RETRIED_TESTS_REPORT_PATH="rspec/retried_tests-${CI_JOB_ID}.txt"
109$ tooling/bin/create_job_metrics_file || true
110[job-metrics] Creating the job metrics file for the CI/CD job.
111$ rspec_section rspec_parallelized_job "--fail-fast=${RSPEC_FAIL_FAST_THRESHOLD} --tag ~quarantine --tag ~zoekt --tag ~click_house"
112 RSpec 26:08
113[10:14:28] Starting rspec_parallelized_job
114RETRY_FAILED_TESTS_IN_NEW_PROCESS: true
115KNAPSACK_GENERATE_REPORT: true
116FLAKY_RSPEC_GENERATE_REPORT: true
117KNAPSACK_TEST_FILE_PATTERN: spec/{lib/gitlab/background_migration,lib/ee/gitlab/background_migration}{,/**/}*_spec.rb
118KNAPSACK_LOG_LEVEL: debug
119KNAPSACK_REPORT_PATH: knapsack/rspec_background_migration_pg14_9_10_278964_report.json
120FLAKY_RSPEC_SUITE_REPORT_PATH: rspec/flaky/report-suite.json
121FLAKY_RSPEC_REPORT_PATH: rspec/flaky/all_rspec_background_migration_pg14_9_10_278964_report.json
122NEW_FLAKY_RSPEC_REPORT_PATH: rspec/flaky/new_rspec_background_migration_pg14_9_10_278964_report.json
123RSPEC_SKIPPED_TESTS_REPORT_PATH: rspec/skipped_tests-7471345492.txt
124CRYSTALBALL: true
125RSPEC_TESTS_MAPPING_ENABLED:
126RSPEC_TESTS_FILTER_FILE:
127Shell set options (set -o) enabled:
128braceexpand on
129hashall on
130interactive-comments on
131pipefail on
132Knapsack report generator started!
133warning: parser/current is loading parser/ruby31, which recognizes 3.1.6-compliant syntax, but you are running 3.1.5.
134Please see https://github.com/whitequark/parser#compatibility-with-ruby-mri.
135Run options: exclude {:quarantine=>true, :zoekt=>true, :click_house=>true}
136# [RSpecRunTime] Starting RSpec timer...
137[TEST PROF INFO] EventProf enabled (sql.active_record)
138unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.
139unknown OID 2249: failed to recognize type of 'pg_stat_file'. It will be treated as String.
140Test environment set up in 1.702248631 seconds
141# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_missing_ci_cd_settings_spec.rb. Expected to take 2 minutes 3.38 seconds.
142Gitlab::BackgroundMigration::BackfillMissingCiCdSettings
143 creates ci_cd_settings for projects without ci_cd_settings
144 creates ci_cd_settings with default values
145INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree
146INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"
147INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
148INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"
149INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
150INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_102"
151INFO: "ci_runner_machine_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
152INFO: analyzing "public.p_ci_job_annotations" inheritance tree
153INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"
154INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
155INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"
156INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
157INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_102"
158INFO: "ci_job_annotations_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
159INFO: analyzing "public.p_ci_builds_metadata" inheritance tree
160INFO: analyzing "public.ci_builds_metadata"
161INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
162INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"
163INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
164INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_102"
165INFO: "ci_builds_metadata_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
166INFO: analyzing "public.p_ci_builds" inheritance tree
167INFO: analyzing "public.ci_builds"
168INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
169INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"
170INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
171INFO: analyzing "gitlab_partitions_dynamic.ci_builds_102"
172INFO: "ci_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
173I, [2024-07-31T10:18:23.276443 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_build_ch_sync_events': Lock Writes
174I, [2024-07-31T10:18:42.484531 #326] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
175INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
176INFO: analyzing "public.ci_pipeline_variables"
177INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
178I, [2024-07-31T10:18:44.054304 #326] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
179I, [2024-07-31T10:18:44.055446 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
180I, [2024-07-31T10:18:44.056263 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
181INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
182INFO: analyzing "public.ci_pipeline_variables"
183INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
184INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
185INFO: analyzing "public.ci_job_artifacts"
186INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
187I, [2024-07-31T10:18:49.943692 #326] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
188I, [2024-07-31T10:18:49.944901 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
189I, [2024-07-31T10:18:49.945722 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
190INFO: analyzing "public.p_ci_stages" inheritance tree
191INFO: analyzing "public.ci_stages"
192INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
193I, [2024-07-31T10:18:53.134694 #326] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
194I, [2024-07-31T10:18:53.135892 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
195I, [2024-07-31T10:18:53.137213 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
196I, [2024-07-31T10:18:54.270926 #326] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
197I, [2024-07-31T10:19:00.496535 #326] INFO -- : Database: 'main', Table: 'p_ci_builds_execution_configs': Lock Writes
198I, [2024-07-31T10:19:13.449069 #326] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
199I, [2024-07-31T10:19:13.450630 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
200I, [2024-07-31T10:19:13.451394 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
201I, [2024-07-31T10:19:24.591904 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
202I, [2024-07-31T10:19:30.958388 #326] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
203# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_missing_ci_cd_settings_spec.rb. It took 3 minutes 21.19 seconds. Expected to take 2 minutes 3.38 seconds.
204# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/legacy_upload_mover_spec.rb. Expected to take 1 minute 53.8 seconds.
205Gitlab::BackgroundMigration::LegacyUploadMover
206 when no note found for the upload
207 behaves like legacy upload deletion
208WARNING: All log messages before absl::InitializeLog() is called are written to STDERR
209I0000 00:00:1722421183.716403 326 rb_grpc.c:331] GRPC_RUBY: grpc_ruby_init_threads g_bg_thread_init_done=0
210 removes the upload record
211# [RSpecRunTime] RSpec elapsed time: 3 minutes 34.11 seconds. Current RSS: ~1423M. Threads: 4. load average: 0.90 1.13 1.25 1/281 416
212.
213 when upload does not belong to a note
214 does not remove the upload
215# [RSpecRunTime] RSpec elapsed time: 3 minutes 40.1 seconds. Current RSS: ~1481M. Threads: 4. load average: 0.91 1.12 1.25 1/281 417
216.
217 when the upload move fails
218 behaves like move error
219 does not remove the upload file
220# [RSpecRunTime] RSpec elapsed time: 3 minutes 46.92 seconds. Current RSS: ~1451M. Threads: 4. load average: 0.92 1.12 1.25 1/281 418
221.
222 when the upload is in local storage
223 when the upload file does not exist on the filesystem
224 behaves like legacy upload deletion
225 removes the upload record
226# [RSpecRunTime] RSpec elapsed time: 3 minutes 52.74 seconds. Current RSS: ~1444M. Threads: 4. load average: 1.01 1.13 1.25 1/281 419
227.
228 when an upload belongs to a legacy_diff_note
229 when the file does not exist for the upload
230 behaves like move error
231 does not remove the upload file
232# [RSpecRunTime] RSpec elapsed time: 3 minutes 58.84 seconds. Current RSS: ~1473M. Threads: 4. load average: 1.01 1.13 1.25 1/281 420
233.
234 when the file does not exist on expected path
235 behaves like move error
236 does not remove the upload file
237# [RSpecRunTime] RSpec elapsed time: 4 minutes 4.7 seconds. Current RSS: ~1454M. Threads: 4. load average: 1.09 1.14 1.26 1/281 421
238.
239 when the file path does not include system/note/attachment
240 behaves like move error
241 does not remove the upload file
242# [RSpecRunTime] RSpec elapsed time: 4 minutes 10.46 seconds. Current RSS: ~1443M. Threads: 4. load average: 0.99 1.12 1.25 1/281 422
243.
244 when the file move raises an error
245 behaves like move error
246 does not remove the upload file
247# [RSpecRunTime] RSpec elapsed time: 4 minutes 16.24 seconds. Current RSS: ~1472M. Threads: 4. load average: 0.91 1.10 1.24 1/281 423
248.
249 when upload has mount_point nil
250 behaves like migrates the file correctly
251 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
252# [RSpecRunTime] RSpec elapsed time: 4 minutes 22.13 seconds. Current RSS: ~1446M. Threads: 4. load average: 1.00 1.12 1.25 1/281 424
253.
254 when the file can be handled correctly
255 behaves like migrates the file correctly
256 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
257# [RSpecRunTime] RSpec elapsed time: 4 minutes 28.2 seconds. Current RSS: ~1468M. Threads: 4. load average: 1.00 1.12 1.24 1/281 425
258.
259 when object storage is disabled for FileUploader
260 when the file belongs to a legacy project
261 behaves like migrates the file correctly
262 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
263# [RSpecRunTime] RSpec elapsed time: 4 minutes 33.86 seconds. Current RSS: ~1447M. Threads: 4. load average: 1.00 1.12 1.24 1/281 426
264.
265 when the file belongs to a hashed project
266 behaves like migrates the file correctly
267 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
268# [RSpecRunTime] RSpec elapsed time: 4 minutes 39.7 seconds. Current RSS: ~1469M. Threads: 4. load average: 1.00 1.11 1.24 1/281 427
269.
270 when object storage is enabled for FileUploader
271 when the file belongs to a legacy project
272 behaves like migrates the file correctly
273 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
274# [RSpecRunTime] RSpec elapsed time: 4 minutes 45.66 seconds. Current RSS: ~1441M. Threads: 4. load average: 1.00 1.11 1.24 1/281 428
275.
276 when the file belongs to a hashed project
277 behaves like migrates the file correctly
278 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
279# [RSpecRunTime] RSpec elapsed time: 4 minutes 51.39 seconds. Current RSS: ~1447M. Threads: 4. load average: 1.00 1.11 1.24 1/281 429
280.
281 when legacy uploads are stored in object storage
282 when the upload file does not exist on the filesystem
283 behaves like legacy upload deletion
284 removes the upload record
285# [RSpecRunTime] RSpec elapsed time: 4 minutes 57.14 seconds. Current RSS: ~1428M. Threads: 4. load average: 1.00 1.11 1.23 1/281 430
286.
287 when the file belongs to a legacy project
288 behaves like migrates the file correctly
289 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
290# [RSpecRunTime] RSpec elapsed time: 5 minutes 4.94 seconds. Current RSS: ~1425M. Threads: 4. load average: 1.00 1.10 1.23 1/281 431
291.
292 when the file belongs to a hashed project
293 behaves like migrates the file correctly
294 creates a new upload record correctly, updates the legacy upload note so that it references the file in the markdown, removes the attachment from the note model, removes the file, moves legacy uploads to the correct location, removes the upload record
295# [RSpecRunTime] RSpec elapsed time: 5 minutes 10.64 seconds. Current RSS: ~1459M. Threads: 4. load average: 1.08 1.12 1.24 2/281 432
296.
297# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/legacy_upload_mover_spec.rb. It took 1 minute 53.04 seconds. Expected to take 1 minute 53.8 seconds.
298# [RSpecRunTime] RSpec elapsed time: 5 minutes 19.15 seconds. Current RSS: ~1403M. Threads: 4. load average: 1.07 1.11 1.23 1/280 433
299.
300# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_has_merge_request_of_vulnerability_reads_spec.rb. Expected to take 1 minute 32.72 seconds.
301Gitlab::BackgroundMigration::BackfillHasMergeRequestOfVulnerabilityReads
302 sets the has_merge_request of existing record
303 does not modify has_merge_request of other vulnerabilities which do not have merge request
304INFO: analyzing "public.p_ci_runner_machine_builds" inheritance tree
305INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_100"
306INFO: "ci_runner_machine_builds_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
307INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_101"
308INFO: "ci_runner_machine_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
309INFO: analyzing "gitlab_partitions_dynamic.ci_runner_machine_builds_102"
310INFO: "ci_runner_machine_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
311INFO: analyzing "public.p_ci_job_annotations" inheritance tree
312INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_100"
313INFO: "ci_job_annotations_100": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
314INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_101"
315INFO: "ci_job_annotations_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
316INFO: analyzing "gitlab_partitions_dynamic.ci_job_annotations_102"
317INFO: "ci_job_annotations_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
318INFO: analyzing "public.p_ci_builds_metadata" inheritance tree
319INFO: analyzing "public.ci_builds_metadata"
320INFO: "ci_builds_metadata": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
321INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_101"
322INFO: "ci_builds_metadata_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
323INFO: analyzing "gitlab_partitions_dynamic.ci_builds_metadata_102"
324INFO: "ci_builds_metadata_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
325INFO: analyzing "public.p_ci_builds" inheritance tree
326INFO: analyzing "public.ci_builds"
327INFO: "ci_builds": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
328INFO: analyzing "gitlab_partitions_dynamic.ci_builds_101"
329INFO: "ci_builds_101": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
330INFO: analyzing "gitlab_partitions_dynamic.ci_builds_102"
331INFO: "ci_builds_102": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
332I, [2024-07-31T10:23:00.116194 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_build_ch_sync_events': Lock Writes
333I, [2024-07-31T10:23:19.574226 #326] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
334INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
335INFO: analyzing "public.ci_pipeline_variables"
336INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
337I, [2024-07-31T10:23:21.162448 #326] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
338I, [2024-07-31T10:23:21.163632 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
339I, [2024-07-31T10:23:21.164354 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
340INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
341INFO: analyzing "public.ci_pipeline_variables"
342INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
343INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
344INFO: analyzing "public.ci_job_artifacts"
345INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
346I, [2024-07-31T10:23:26.886585 #326] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
347I, [2024-07-31T10:23:26.887747 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
348I, [2024-07-31T10:23:26.888557 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
349INFO: analyzing "public.p_ci_stages" inheritance tree
350INFO: analyzing "public.ci_stages"
351INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
352I, [2024-07-31T10:23:30.103745 #326] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
353I, [2024-07-31T10:23:30.104812 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
354I, [2024-07-31T10:23:30.105581 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
355I, [2024-07-31T10:23:31.213874 #326] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
356I, [2024-07-31T10:23:37.299814 #326] INFO -- : Database: 'main', Table: 'p_ci_builds_execution_configs': Lock Writes
357I, [2024-07-31T10:23:50.332634 #326] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
358I, [2024-07-31T10:23:50.333748 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
359I, [2024-07-31T10:23:50.334497 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
360I, [2024-07-31T10:24:01.494515 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
361I, [2024-07-31T10:24:08.217679 #326] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
362# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_has_merge_request_of_vulnerability_reads_spec.rb. It took 2 minutes 44.24 seconds. Expected to take 1 minute 32.72 seconds.
363# [RSpecRunTime] RSpec elapsed time: 8 minutes 3.45 seconds. Current RSS: ~1411M. Threads: 4. load average: 1.01 1.08 1.20 1/280 434
364.
365# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_packages_tags_project_id_spec.rb. Expected to take 1 minute 15.86 seconds.
366Gitlab::BackgroundMigration::BackfillPackagesTagsProjectId
367 backfills the missing project_id for the batch
368I, [2024-07-31T10:25:42.191383 #326] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
369INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
370INFO: analyzing "public.ci_pipeline_variables"
371INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
372I, [2024-07-31T10:25:43.827467 #326] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
373I, [2024-07-31T10:25:43.828534 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
374I, [2024-07-31T10:25:43.829282 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
375INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
376INFO: analyzing "public.ci_pipeline_variables"
377INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
378INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
379INFO: analyzing "public.ci_job_artifacts"
380INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
381I, [2024-07-31T10:25:49.548074 #326] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
382I, [2024-07-31T10:25:49.549456 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
383I, [2024-07-31T10:25:49.550224 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
384INFO: analyzing "public.p_ci_stages" inheritance tree
385INFO: analyzing "public.ci_stages"
386INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
387I, [2024-07-31T10:25:52.815503 #326] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
388I, [2024-07-31T10:25:52.817448 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
389I, [2024-07-31T10:25:52.818247 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
390I, [2024-07-31T10:25:53.918575 #326] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
391I, [2024-07-31T10:25:59.899551 #326] INFO -- : Database: 'main', Table: 'p_ci_builds_execution_configs': Lock Writes
392I, [2024-07-31T10:26:12.724599 #326] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
393I, [2024-07-31T10:26:12.726140 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
394I, [2024-07-31T10:26:12.726885 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
395I, [2024-07-31T10:26:23.867480 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
396I, [2024-07-31T10:26:30.247372 #326] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
397# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_packages_tags_project_id_spec.rb. It took 2 minutes 21.92 seconds. Expected to take 1 minute 15.86 seconds.
398# [RSpecRunTime] RSpec elapsed time: 10 minutes 25.43 seconds. Current RSS: ~1394M. Threads: 4. load average: 1.06 1.08 1.18 1/280 435
399.
400# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/delete_invalid_protected_tag_create_access_levels_spec.rb. Expected to take 1 minute 0.26 second.
401Gitlab::BackgroundMigration::DeleteInvalidProtectedTagCreateAccessLevels
402 when there are push access levels
403 deletes push access levels with groups that do not have project_group_links to the project
404# [RSpecRunTime] RSpec elapsed time: 11 minutes 22.11 seconds. Current RSS: ~1446M. Threads: 4. load average: 1.15 1.10 1.18 1/280 436
405.
406I, [2024-07-31T10:27:39.611590 #326] INFO -- : Database: 'main', Table: 'ci_job_token_group_scope_links': Lock Writes
407INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
408INFO: analyzing "public.ci_pipeline_variables"
409INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
410I, [2024-07-31T10:27:41.321399 #326] INFO -- : Database: 'main', Table: 'p_ci_pipeline_variables': Lock Writes
411I, [2024-07-31T10:27:41.322523 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
412I, [2024-07-31T10:27:41.323338 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
413INFO: analyzing "public.p_ci_pipeline_variables" inheritance tree
414INFO: analyzing "public.ci_pipeline_variables"
415INFO: "ci_pipeline_variables": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
416INFO: analyzing "public.p_ci_job_artifacts" inheritance tree
417INFO: analyzing "public.ci_job_artifacts"
418INFO: "ci_job_artifacts": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
419I, [2024-07-31T10:27:47.064892 #326] INFO -- : Database: 'main', Table: 'p_ci_job_artifacts': Lock Writes
420I, [2024-07-31T10:27:47.066092 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
421I, [2024-07-31T10:27:47.067955 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
422INFO: analyzing "public.p_ci_stages" inheritance tree
423INFO: analyzing "public.ci_stages"
424INFO: "ci_stages": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
425I, [2024-07-31T10:27:50.375069 #326] INFO -- : Database: 'main', Table: 'p_ci_stages': Lock Writes
426I, [2024-07-31T10:27:50.376171 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
427I, [2024-07-31T10:27:50.377034 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
428I, [2024-07-31T10:27:51.547647 #326] INFO -- : Database: 'main', Table: 'p_ci_build_names': Lock Writes
429I, [2024-07-31T10:27:57.581123 #326] INFO -- : Database: 'main', Table: 'p_ci_builds_execution_configs': Lock Writes
430I, [2024-07-31T10:28:10.524951 #326] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
431I, [2024-07-31T10:28:10.526553 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
432I, [2024-07-31T10:28:10.527318 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
433I, [2024-07-31T10:28:21.754489 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
434I, [2024-07-31T10:28:28.171437 #326] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
435# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/delete_invalid_protected_tag_create_access_levels_spec.rb. It took 1 minute 58.03 seconds. Expected to take 1 minute 0.26 second.
436# [RSpecRunTime] RSpec elapsed time: 12 minutes 23.53 seconds. Current RSS: ~1395M. Threads: 4. load average: 1.10 1.09 1.17 1/280 437
437.
438# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_approval_merge_request_rule_sources_project_id_spec.rb. Expected to take 49.45 seconds.
439Gitlab::BackgroundMigration::BackfillApprovalMergeRequestRuleSourcesProjectId
440 constructs a valid query
441 performs without error
442I, [2024-07-31T10:29:34.957358 #326] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
443I, [2024-07-31T10:29:34.958406 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
444I, [2024-07-31T10:29:34.959166 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
445I, [2024-07-31T10:29:45.692962 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
446I, [2024-07-31T10:29:52.043335 #326] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
447# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_approval_merge_request_rule_sources_project_id_spec.rb. It took 1 minute 23.65 seconds. Expected to take 49.45 seconds.
448# [RSpecRunTime] RSpec elapsed time: 13 minutes 47.24 seconds. Current RSS: ~1384M. Threads: 4. load average: 1.01 1.08 1.16 1/280 438
449.
450# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_has_remediations_of_vulnerability_reads_spec.rb. Expected to take 36.23 seconds.
451Gitlab::BackgroundMigration::BackfillHasRemediationsOfVulnerabilityReads
452 does not modify has_remediations of vulnerabilities which do not have remediations
453 when finding_remediation record exists
454 updates vulnerability_reads records which has remediations
455# [RSpecRunTime] RSpec elapsed time: 14 minutes 20.82 seconds. Current RSS: ~1446M. Threads: 4. load average: 1.16 1.10 1.17 3/283 439
456.
457I, [2024-07-31T10:30:40.829850 #326] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
458I, [2024-07-31T10:30:40.830991 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
459I, [2024-07-31T10:30:40.831831 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
460I, [2024-07-31T10:30:52.954847 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
461I, [2024-07-31T10:30:59.211610 #326] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
462# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_has_remediations_of_vulnerability_reads_spec.rb. It took 1 minute 7.16 seconds. Expected to take 36.23 seconds.
463# [RSpecRunTime] RSpec elapsed time: 14 minutes 54.47 seconds. Current RSS: ~1381M. Threads: 4. load average: 0.92 1.05 1.15 1/282 440
464.
465# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_audit_events_streaming_headers_group_id_spec.rb. Expected to take 31.57 seconds.
466Gitlab::BackgroundMigration::BackfillAuditEventsStreamingHeadersGroupId
467 performs without error
468 constructs a valid query
469I, [2024-07-31T10:31:40.282203 #326] INFO -- : Database: 'main', Table: 'p_ci_build_sources': Lock Writes
470I, [2024-07-31T10:31:40.283401 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Lock timeout is set", :current_iteration=>1, :lock_timeout_in_ms=>100}
471I, [2024-07-31T10:31:40.284207 #326] INFO -- : {:method=>"with_lock_retries", :class=>"gitlab:db:lock_writes", :message=>"Migration finished", :current_iteration=>1, :lock_timeout_in_ms=>100}
472I, [2024-07-31T10:31:50.830664 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
473I, [2024-07-31T10:31:57.160142 #326] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
474# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_audit_events_streaming_headers_group_id_spec.rb. It took 57.7 seconds. Expected to take 31.57 seconds.
475# [RSpecRunTime] RSpec elapsed time: 15 minutes 52.23 seconds. Current RSS: ~1379M. Threads: 4. load average: 0.99 1.05 1.14 1/282 441
476.
477# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_status_check_responses_project_id_spec.rb. Expected to take 30.89 seconds.
478Gitlab::BackgroundMigration::BackfillStatusCheckResponsesProjectId
479 performs without error
480 constructs a valid query
481I, [2024-07-31T10:32:46.025812 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
482I, [2024-07-31T10:32:52.411016 #326] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
483# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_status_check_responses_project_id_spec.rb. It took 55.24 seconds. Expected to take 30.89 seconds.
484# [RSpecRunTime] RSpec elapsed time: 16 minutes 47.53 seconds. Current RSS: ~1369M. Threads: 4. load average: 0.95 1.03 1.13 1/282 442
485.
486# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_dast_site_profile_secret_variables_project_id_spec.rb. Expected to take 30.19 seconds.
487Gitlab::BackgroundMigration::BackfillDastSiteProfileSecretVariablesProjectId
488 performs without error
489 constructs a valid query
490I, [2024-07-31T10:33:43.396270 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
491I, [2024-07-31T10:33:49.788308 #326] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
492# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_dast_site_profile_secret_variables_project_id_spec.rb. It took 57.24 seconds. Expected to take 30.19 seconds.
493# [RSpecRunTime] RSpec elapsed time: 17 minutes 44.83 seconds. Current RSS: ~1383M. Threads: 4. load average: 1.04 1.04 1.12 1/282 443
494.
495# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_merge_request_assignees_project_id_spec.rb. Expected to take 29.36 seconds.
496Gitlab::BackgroundMigration::BackfillMergeRequestAssigneesProjectId
497 constructs a valid query
498 performs without error
499I, [2024-07-31T10:34:41.026323 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
500I, [2024-07-31T10:34:47.417844 #326] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
501# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_merge_request_assignees_project_id_spec.rb. It took 57.5 seconds. Expected to take 29.36 seconds.
502# [RSpecRunTime] RSpec elapsed time: 18 minutes 42.39 seconds. Current RSS: ~1377M. Threads: 4. load average: 1.09 1.06 1.12 1/282 444
503.
504# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_vulnerability_findings_remediations_project_id_spec.rb. Expected to take 19.26 seconds.
505Gitlab::BackgroundMigration::BackfillVulnerabilityFindingsRemediationsProjectId
506 constructs a valid query
507 performs without error
508I, [2024-07-31T10:35:15.803530 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
509I, [2024-07-31T10:35:23.495634 #326] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
510# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_vulnerability_findings_remediations_project_id_spec.rb. It took 36.03 seconds. Expected to take 19.26 seconds.
511# [RSpecRunTime] RSpec elapsed time: 19 minutes 18.48 seconds. Current RSS: ~1386M. Threads: 4. load average: 1.04 1.05 1.11 1/282 445
512.
513# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_packages_maven_metadata_project_id_spec.rb. Expected to take 18.31 seconds.
514Gitlab::BackgroundMigration::BackfillPackagesMavenMetadataProjectId
515 constructs a valid query
516 performs without error
517I, [2024-07-31T10:35:51.504345 #326] INFO -- : Database: 'main', Table: 'p_ci_finished_pipeline_ch_sync_events': Lock Writes
518I, [2024-07-31T10:35:57.815410 #326] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
519# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_packages_maven_metadata_project_id_spec.rb. It took 34.42 seconds. Expected to take 18.31 seconds.
520# [RSpecRunTime] RSpec elapsed time: 19 minutes 52.96 seconds. Current RSS: ~1379M. Threads: 4. load average: 1.24 1.09 1.13 1/282 446
521.
522# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_partition_id_ci_pipeline_message_spec.rb. Expected to take 17.61 seconds.
523Gitlab::BackgroundMigration::BackfillPartitionIdCiPipelineMessage
524 #perform
525 when there are no invalid records
526 does not execute the migration
527# [RSpecRunTime] RSpec elapsed time: 20 minutes 5.86 seconds. Current RSS: ~1446M. Threads: 4. load average: 1.10 1.07 1.12 1/282 447
528.
529 when second partition exists
530 fixes invalid records in the wrong the partition
531# [RSpecRunTime] RSpec elapsed time: 20 minutes 9.84 seconds. Current RSS: ~1488M. Threads: 4. load average: 1.10 1.07 1.12 1/282 448
532.
533I, [2024-07-31T10:36:33.276508 #326] INFO -- : Database: 'main', Table: 'p_ci_build_tags': Lock Writes
534# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_partition_id_ci_pipeline_message_spec.rb. It took 35.35 seconds. Expected to take 17.61 seconds.
535# [RSpecRunTime] RSpec elapsed time: 20 minutes 28.37 seconds. Current RSS: ~1382M. Threads: 4. load average: 1.07 1.06 1.11 1/282 449
536.
537# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/remove_namespace_from_os_type_sbom_components_spec.rb. Expected to take 13.58 seconds.
538Gitlab::BackgroundMigration::RemoveNamespaceFromOsTypeSbomComponents
539 #perform
540 successfully removes the os namespace prefix
541 with existing record in regards to name, purl_type and component_type
542 rescues valid ActiveRecord::RecordNotUnique errors
543# [RSpecRunTime] RSpec elapsed time: 20 minutes 36.71 seconds. Current RSS: ~1477M. Threads: 4. load average: 1.22 1.09 1.12 1/282 450
544.
545 with unexpected ActiveRecord::RecordNotUnique error
546 raises unknown ActiveRecord::RecordNotUnique errors
547# [RSpecRunTime] RSpec elapsed time: 20 minutes 40.78 seconds. Current RSS: ~1508M. Threads: 4. load average: 1.12 1.08 1.12 1/282 451
548.
549# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/remove_namespace_from_os_type_sbom_components_spec.rb. It took 20.89 seconds. Expected to take 13.58 seconds.
550# [RSpecRunTime] RSpec elapsed time: 20 minutes 49.32 seconds. Current RSS: ~1421M. Threads: 4. load average: 1.11 1.07 1.12 1/282 452
551.
552# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/backfill_evidences_project_id_spec.rb. Expected to take 11.4 seconds.
553Gitlab::BackgroundMigration::BackfillEvidencesProjectId
554 constructs a valid query
555 performs without error
556# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/backfill_evidences_project_id_spec.rb. It took 21.17 seconds. Expected to take 11.4 seconds.
557# [RSpecRunTime] RSpec elapsed time: 21 minutes 10.55 seconds. Current RSS: ~1396M. Threads: 4. load average: 1.06 1.07 1.11 1/282 453
558.
559# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/create_jira_cloud_app_integration_for_jira_connect_subscription_spec.rb. Expected to take 6.32 seconds.
560Gitlab::BackgroundMigration::CreateJiraCloudAppIntegrationForJiraConnectSubscription
561 creates jira_cloud_app integration for the groups and descendant projects
562# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/create_jira_cloud_app_integration_for_jira_connect_subscription_spec.rb. It took 12.51 seconds. Expected to take 6.32 seconds.
563# [RSpecRunTime] RSpec elapsed time: 21 minutes 23.12 seconds. Current RSS: ~1421M. Threads: 4. load average: 1.05 1.06 1.11 1/282 454
564.
565# [RSpecRunTime] Starting example group spec/lib/gitlab/background_migration/update_jira_tracker_data_deployment_type_based_on_url_spec.rb. Expected to take 4.73 seconds.
566Gitlab::BackgroundMigration::UpdateJiraTrackerDataDeploymentTypeBasedOnUrl
567 changes unknown deployment_types based on URL
568# [RSpecRunTime] Finishing example group spec/lib/gitlab/background_migration/update_jira_tracker_data_deployment_type_based_on_url_spec.rb. It took 11.38 seconds. Expected to take 4.73 seconds.
569# [RSpecRunTime] RSpec elapsed time: 21 minutes 34.56 seconds. Current RSS: ~1421M. Threads: 4. load average: 1.12 1.08 1.11 1/282 455
570.
571auto_explain log contains 1071 entries for main, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-background-migration-pg14-9-10.326.main.ndjson.gz
572took 28.336202611
573auto_explain log contains 1072 entries for ci, writing to /builds/gitlab-org/gitlab/auto_explain/rspec-background-migration-pg14-9-10.326.ci.ndjson.gz
574took 26.886442013
575[TEST PROF INFO] EventProf results for sql.active_record
576Total time: 13:55.697 of 21:29.660 (64.8%)
577Total events: 678131
578Top 5 slowest suites (by time):
579Gitlab::Backg...ngCiCdSettings (./spec/lib/gitlab/background_migration/backfill_missing_ci_cd_settings_spec.rb:5) – 02:19.942 (96877 / 2) of 03:21.163 (69.57%)
580Gitlab::Backg...erabilityReads (./spec/lib/gitlab/background_migration/backfill_has_merge_request_of_vulnerability_reads_spec.rb:5) – 01:53.790 (88229 / 2) of 02:44.302 (69.26%)
581Gitlab::Backg...sTagsProjectId (./spec/lib/gitlab/background_migration/backfill_packages_tags_project_id_spec.rb:5) – 01:41.828 (79647 / 1) of 02:21.978 (71.72%)
582Gitlab::Backg...teAccessLevels (./spec/lib/gitlab/background_migration/delete_invalid_protected_tag_create_access_levels_spec.rb:5) – 01:24.992 (67698 / 1) of 01:58.098 (71.97%)
583Gitlab::Backg...urcesProjectId (./spec/lib/gitlab/background_migration/backfill_approval_merge_request_rule_sources_project_id_spec.rb:5) – 00:57.985 (48724 / 2) of 01:23.714 (69.27%)
584Knapsack report was generated. Preview:
585{
586 "spec/lib/gitlab/background_migration/backfill_missing_ci_cd_settings_spec.rb": 104.32912755699999,
587 "spec/lib/gitlab/background_migration/legacy_upload_mover_spec.rb": 104.72973517799983,
588 "spec/lib/gitlab/background_migration/backfill_has_merge_request_of_vulnerability_reads_spec.rb": 84.43927961400004,
589 "spec/lib/gitlab/background_migration/backfill_packages_tags_project_id_spec.rb": 69.92276588800087,
590 "spec/lib/gitlab/background_migration/delete_invalid_protected_tag_create_access_levels_spec.rb": 56.806458106999344,
591 "spec/lib/gitlab/background_migration/backfill_approval_merge_request_rule_sources_project_id_spec.rb": 43.20961361500122,
592 "spec/lib/gitlab/background_migration/backfill_has_remediations_of_vulnerability_reads_spec.rb": 33.73340022100092,
593 "spec/lib/gitlab/background_migration/backfill_audit_events_streaming_headers_group_id_spec.rb": 29.300894641000923,
594 "spec/lib/gitlab/background_migration/backfill_status_check_responses_project_id_spec.rb": 27.660169992999727,
595 "spec/lib/gitlab/background_migration/backfill_dast_site_profile_secret_variables_project_id_spec.rb": 28.118303462999393,
596 "spec/lib/gitlab/background_migration/backfill_merge_request_assignees_project_id_spec.rb": 28.417251237999153,
597 "spec/lib/gitlab/background_migration/backfill_vulnerability_findings_remediations_project_id_spec.rb": 17.004843868000535,
598 "spec/lib/gitlab/background_migration/backfill_packages_maven_metadata_project_id_spec.rb": 16.77731188799953,
599 "spec/lib/gitlab/background_migration/backfill_partition_id_ci_pipeline_message_spec.rb": 17.0087544779999,
600 "spec/lib/gitlab/background_migration/remove_namespace_from_os_type_sbom_components_spec.rb": 12.545744151999315,
601 "spec/lib/gitlab/background_migration/backfill_evidences_project_id_spec.rb": 10.662802364000527,
602 "spec/lib/gitlab/background_migration/create_jira_cloud_app_integration_for_jira_connect_subscription_spec.rb": 5.361725009999645,
603 "spec/lib/gitlab/background_migration/update_jira_tracker_data_deployment_type_based_on_url_spec.rb": 4.378676252999867
604}
605Knapsack global time execution for tests: 11m 34s
606Finished in 22 minutes 30 seconds (files took 1 minute 43.7 seconds to load)
60748 examples, 0 failures
608Randomized with seed 20557
609[TEST PROF INFO] Time spent in factories: 00:34.312 (2.46% of total time)
610RSpec exited with 0.
611No examples to retry, congrats!
612 Running after_script 00:10
613Running after script...
614$ source scripts/utils.sh
615$ bundle exec gem list gitlab_quality-test_tooling
616gitlab_quality-test_tooling (1.33.0)
617$ section_start "failed-test-issues" "Report test failures" # collapsed multi-line command
618 Report test failures 00:02
621$ section_start "flaky-test-issues" "Report test flakiness" # collapsed multi-line command
622 Report test flakiness 00:00
624$ section_start "slow-test-issues" "Report test slowness" # collapsed multi-line command
625 Report test slowness 00:02
628$ section_start "slow-test-merge-request-report-note" "Report test slowness in MR note" # collapsed multi-line command
629 Report test slowness in MR note 00:00
631$ section_start "knapsack-report-issues" "Report test files close to timing out" # collapsed multi-line command
632 Report test files close to timing out 00:02
635$ tooling/bin/push_job_metrics || true
636[job-metrics] Pushing job metrics file for the CI/CD job.
637[job-metrics] Pushed 4 CI job metric entries to InfluxDB.
638 Saving cache for successful job 00:01
639Not uploading cache ruby-gems-debian-bookworm-ruby-3.1.5-17 due to policy
640 Uploading artifacts for successful job 00:05
641Uploading artifacts...
642auto_explain/: found 3 matching artifact files and directories
643coverage/: found 5 matching artifact files and directories
644crystalball/: found 5 matching artifact files and directories
645WARNING: deprecations/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
646knapsack/: found 4 matching artifact files and directories
647rspec/: found 12 matching artifact files and directories
648WARNING: tmp/capybara/: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
649log/*.log: found 13 matching artifact files and directories
650WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/7471345492/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
651WARNING: Retrying... context=artifacts-uploader error=request redirected
652Uploading artifacts as "archive" to coordinator... 201 Created id=7471345492 responseStatus=201 Created token=glcbt-66
653Uploading artifacts...
654rspec/rspec-*.xml: found 1 matching artifact files and directories
655WARNING: Upload request redirected location=https://gitlab.com/api/v4/jobs/7471345492/artifacts?artifact_format=gzip&artifact_type=junit&expire_in=31d new-url=https://gitlab.com
656WARNING: Retrying... context=artifacts-uploader error=request redirected
657Uploading artifacts as "junit" to coordinator... 201 Created id=7471345492 responseStatus=201 Created token=glcbt-66
658 Cleaning up project directory and file based variables 00:00
659Job succeeded