Failure categories - Ensure we have the full job trace
Problem Statement
I noticed in https://app.snowflake.com/ys68254/gitlab/w1KmeJlOcxKa/chart that a lot of jobs that are supposed to have a failure category didn't have one:
We surely might miss some error categories, but I think the problem comes from the fact that the job trace isn't written completely, and so we only get a partial trace (1, 2)
A fix to explore would be to try to download the trace a few times with a waiting time (a few seconds waiting).
Problem Validation
In https://app.snowflake.com/ys68254/gitlab/w1oaUFxQaSYz, I gathered the latest 100 CI/CD jobs without a failure category:
See CSV
CREATED_AT,JOB_URL,CI_BUILD_NAME
2025-04-30T00:29:26.195478Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9873149119,graphql-verify
2025-04-30T00:29:26.04171Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9873149093,jest vue3 predictive 4/6
2025-04-30T00:29:26.016109Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9873149090,jest vue3 predictive 2/6
2025-04-30T00:29:25.953771Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9873149082,jest predictive 3/4
2025-04-30T00:29:25.943109Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9873149081,jest predictive 2/4
2025-04-30T00:29:25.931885Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9873149079,jest predictive 1/4
2025-04-29T23:25:04.599523Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872755788,danger-review
2025-04-29T23:22:00.728511Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872739447,build-gdk-image
2025-04-29T23:21:59.476607Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872739296,danger-review
2025-04-29T23:19:41.146917Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872723877,danger-review
2025-04-29T22:50:35.923869Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872512484,rspec:undercoverage
2025-04-29T22:45:01.29502Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872463889,docs-lint links
2025-04-29T22:42:16.317437Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872448194,cng-instance 9/9
2025-04-29T22:33:47.204265Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872393351,rails-production-server-boot-puma-cng
2025-04-29T22:27:11.908563Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872346520,docs-lint links
2025-04-29T22:17:30.238172Z,https://gitlab.com/gitlab-org/gitlab-foss/-/jobs/9872285490,jest-with-fixtures vue3 mr 1/1
2025-04-29T22:17:30.136211Z,https://gitlab.com/gitlab-org/gitlab-foss/-/jobs/9872285472,jest-with-fixtures 2/2
2025-04-29T22:17:00.016342Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872282179,untamper-my-lockfile
2025-04-29T22:15:20.40771Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872261488,untamper-my-lockfile
2025-04-29T22:15:19.865949Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872261408,jest-with-fixtures vue3 mr 1/1
2025-04-29T22:15:19.851406Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872261405,jest vue3 mr 6/6
2025-04-29T22:15:19.835627Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872261403,jest vue3 mr 5/6
2025-04-29T22:15:19.793135Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872261394,jest vue3 mr 2/6
2025-04-29T22:15:19.742272Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872261387,jest-with-fixtures 2/2
2025-04-29T22:15:19.655914Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872261374,jest 10/11
2025-04-29T22:15:19.400342Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872261323,jest 3/11
2025-04-29T22:13:25.777315Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872242766,compile-production-assets
2025-04-29T22:06:42.880973Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872195077,qa:rspec-internal
2025-04-29T21:59:38.096336Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872110780,compile-test-assets
2025-04-29T21:57:47.666415Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872098866,jest vue3 predictive 1/6
2025-04-29T21:57:47.389667Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872098848,jest predictive 1/4
2025-04-29T21:57:06.357992Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872094356,jest-integration
2025-04-29T21:51:57.373984Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9872057940,setup-test-env-fips
2025-04-29T21:33:15.540121Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871926479,clone-gitlab-repo
2025-04-29T21:29:01.361528Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871890048,danger-review
2025-04-29T21:28:57.826157Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871889745,build-qa-image
2025-04-29T21:27:41.720385Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871880875,build-qa-image
2025-04-29T21:26:00.862174Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871868252,gitlab_git_test
2025-04-29T21:25:50.95803Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871867099,graphql-verify
2025-04-29T21:25:50.224156Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871867013,jest-build-cache-vue3-ensure-compilable-sfcs
2025-04-29T21:25:50.215113Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871867011,jest-build-cache
2025-04-29T21:25:50.165166Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871867000,semgrep-appsec-custom-rules
2025-04-29T21:25:50.131974Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866997,feature-flags-usage
2025-04-29T21:25:50.073881Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866990,haml-lint
2025-04-29T21:25:50.046943Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866987,eslint-docs
2025-04-29T21:25:49.964938Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866978,static-verification-with-database
2025-04-29T21:25:49.956039Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866975,static-analysis 2/2
2025-04-29T21:25:49.947735Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866973,static-analysis 1/2
2025-04-29T21:25:49.917349Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866966,qa:selectors
2025-04-29T21:25:49.89135Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866964,graphql-schema-dump
2025-04-29T21:25:49.769701Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866945,build-qa-image
2025-04-29T21:25:49.739582Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866941,e2e-test-pipeline-generate
2025-04-29T21:25:49.728792Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866940,detect-previous-failed-tests
2025-04-29T21:25:49.717663Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866939,detect-tests
2025-04-29T21:25:49.69136Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866934,setup-test-env-fips
2025-04-29T21:25:49.679255Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866932,setup-test-env
2025-04-29T21:25:49.645853Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866925,retrieve-frontend-fixtures
2025-04-29T21:25:49.63673Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866924,gdk:compile-test-assets
2025-04-29T21:25:49.628412Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866920,compile-test-assets
2025-04-29T21:25:49.618156Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866919,compile-production-assets
2025-04-29T21:25:49.60955Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866918,db:setup pg16
2025-04-29T21:25:49.529748Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866910,prepare-as-if-foss-branch
2025-04-29T21:25:49.507646Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866908,danger-review dry-run
2025-04-29T21:25:49.495889Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866907,danger-review
2025-04-29T21:25:49.484998Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866906,verify-tests-yml
2025-04-29T21:25:49.459354Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866901,no-jh-check
2025-04-29T21:25:49.447631Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866899,ruby_syntax: [${RUBY_VERSION_NEXT}]
2025-04-29T21:25:49.437907Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866897,ruby_syntax: [${RUBY_VERSION_DEFAULT}]
2025-04-29T21:25:49.428765Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866895,rails-production-server-boot-puma-cng
2025-04-29T21:25:49.419671Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866894,rails-production-server-boot-puma-example
2025-04-29T21:25:49.4031Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871866892,clone-gitlab-repo
2025-04-29T21:17:10.42931Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871797836,gdk:compile-test-assets
2025-04-29T21:17:02.07592Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871796654,danger-review dry-run
2025-04-29T21:17:02.061408Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871796653,danger-review
2025-04-29T21:11:55.729955Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871745821,graphql-verify
2025-04-29T21:07:53.602908Z,https://gitlab.com/gitlab-org/gitlab-foss/-/jobs/9871709481,jest-with-fixtures vue3 predictive 1/1
2025-04-29T21:05:59.652343Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871691295,jest-with-fixtures vue3 predictive 1/1
2025-04-29T21:05:31.234316Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871687100,rspec:undercoverage
2025-04-29T21:03:31.423597Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871665681,build-gdk-image
2025-04-29T21:00:47.494487Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871626156,build-gdk-image
2025-04-29T20:52:50.597053Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871562177,docs hugo_build
2025-04-29T20:52:49.986349Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871562098,setup-test-env
2025-04-29T20:52:49.228117Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871561933,clone-gitlab-repo
2025-04-29T20:37:35.066425Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871424444,rspec-ee unit pg16 single-redis 39/39
2025-04-29T20:08:08.732164Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9871136218,danger-review dry-run
2025-04-29T19:53:41.230096Z,https://gitlab.com/gitlab-org/gitlab-foss/-/jobs/9870965910,rubocop
2025-04-29T19:46:21.558536Z,https://gitlab.com/gitlab-org/gitlab-foss/-/jobs/9870893394,jest vue3 predictive 2/6
2025-04-29T19:46:21.471677Z,https://gitlab.com/gitlab-org/gitlab-foss/-/jobs/9870893381,jest predictive 2/4
2025-04-29T19:46:06.831342Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9870890706,cng-qa-min-redis-version 1/1
2025-04-29T19:44:26.571364Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9870868556,jest vue3 predictive 3/6
2025-04-29T19:44:26.480755Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9870868536,jest vue3 predictive 2/6
2025-04-29T19:44:25.565549Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9870868366,jest predictive 2/4
2025-04-29T19:41:55.633865Z,https://gitlab.com/gitlab-org/gitlab-foss/-/jobs/9870840731,rubocop
2025-04-29T19:41:50.76054Z,https://gitlab.com/gitlab-org/gitlab-foss/-/jobs/9870839696,rspec unit pg16 single-redis 21/44
2025-04-29T19:41:04.720242Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9870831003,rspec unit pg16 21/44
2025-04-29T19:39:17.602131Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9870809522,rubocop
2025-04-29T19:37:48.596903Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9870793028,clone-gitlab-repo
2025-04-29T19:32:55.665493Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9870741921,danger-review
2025-04-29T19:30:28.397503Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9870713048,rspec unit pg16 single-db 39/44
2025-04-29T19:30:00.047568Z,https://gitlab.com/gitlab-org/gitlab/-/jobs/9870706652,clone-gitlab-repoRunning the failure category detection locally gave us a 99/100 match, going from 0% to 99%. This proves that the failure category script is working, and that we had partial data in CI when running the script
See script result
$ fca --csv ~/Desktop/last_100_jobs_without_a_failure_category.csv
[Local Batch Failure Analyzer] Job #9873149119 categorized as: graphql_lint (matching pattern: "GraphQL quer.+out of.+failed validation:")
[Local Batch Failure Analyzer] Job #9873149093 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9873149090 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9873149082 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9873149081 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9873149079 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9872755788 categorized as: danger (matching pattern: "If needed, you can retry the.+`danger-review` job")
[Local Batch Failure Analyzer] Job #9872739447 categorized as: build_gdk_image (matching pattern: "Building GDK image")
[Local Batch Failure Analyzer] Job #9872739296 categorized as: danger (matching pattern: "If needed, you can retry the.+`danger-review` job")
[Local Batch Failure Analyzer] Job #9872723877 categorized as: danger (matching pattern: "If needed, you can retry the.+`danger-review` job")
[Local Batch Failure Analyzer] Job #9872512484 categorized as: rspec_undercoverage (matching pattern: "some methods have no test coverage!")
[Local Batch Failure Analyzer] Job #9872463889 categorized as: docs_lint_failed (matching pattern: "Issues found in .+input.+Find details below.")
[Local Batch Failure Analyzer] Job #9872448194 categorized as: rspec_valid_rspec_errors_or_flaky_tests (matching pattern: "Failed examples:,Failure/Error:")
[Local Batch Failure Analyzer] Job #9872393351 categorized as: rails-production-server-boot (matching pattern: "curl: \(7\) Failed to connect to 127.0.0.1 port 8080 after")
[Local Batch Failure Analyzer] Job #9872346520 categorized as: docs_lint_failed (matching pattern: "Issues found in .+input.+Find details below.")
[Local Batch Failure Analyzer] Job #9872285490 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9872285472 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9872282179 categorized as: frontend_lockfile (matching pattern: "Found problems with the lockfile")
[Local Batch Failure Analyzer] Job #9872261488 categorized as: frontend_lockfile (matching pattern: "Found problems with the lockfile")
[Local Batch Failure Analyzer] Job #9872261408 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9872261405 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9872261403 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9872261394 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9872261387 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9872261374 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9872261323 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9872242766 categorized as: artifacts_upload_502 (matching pattern: "Uploading artifacts .+ 502 Bad Gateway")
[Local Batch Failure Analyzer] Job #9872195077 categorized as: rspec_valid_rspec_errors_or_flaky_tests (matching pattern: "Failed examples:,Failure/Error:")
[Local Batch Failure Analyzer] Job #9872110780 categorized as: artifacts_upload_502 (matching pattern: "Uploading artifacts .+ 502 Bad Gateway")
[Local Batch Failure Analyzer] Job #9872098866 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9872098848 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9872094356 categorized as: jest (matching pattern: "Ran all test suites,Command failed with exit code 1")
[Local Batch Failure Analyzer] Job #9872057940 categorized as: artifacts_upload_502 (matching pattern: "Uploading artifacts .+ 502 Bad Gateway")
[Local Batch Failure Analyzer] Job #9871926479 categorized as: artifacts_upload_502 (matching pattern: "Uploading artifacts .+ 502 Bad Gateway")
[Local Batch Failure Analyzer] Job #9871890048 categorized as: danger (matching pattern: "If needed, you can retry the.+`danger-review` job")
[Local Batch Failure Analyzer] Job #9871889745 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871880875 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871868252 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871867099 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871867013 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871867011 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871867000 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866997 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866990 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866987 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866978 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866975 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866973 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866966 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866964 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866945 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866941 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866940 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866939 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866934 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866932 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866925 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866924 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866920 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866919 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866918 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866910 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866908 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866907 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866906 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866901 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866899 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866897 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866895 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866894 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871866892 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9871797836 categorized as: artifacts_upload_502 (matching pattern: "Uploading artifacts .+ 502 Bad Gateway")
[Local Batch Failure Analyzer] Job #9871796654 categorized as: ruby_undefined_method_or_variable (matching pattern: "undefined method `")
[Local Batch Failure Analyzer] Job #9871796653 categorized as: ruby_undefined_method_or_variable (matching pattern: "undefined method `")
[Local Batch Failure Analyzer] Job #9871745821 categorized as: graphql_lint (matching pattern: "needs to be regenerated, please run:")
[Local Batch Failure Analyzer] Job #9871709481 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9871691295 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9871687100 categorized as: rspec_undercoverage (matching pattern: "some methods have no test coverage!")
[Local Batch Failure Analyzer] Job #9871665681 categorized as: build_gdk_image (matching pattern: "Building GDK image")
[Local Batch Failure Analyzer] Job #9871626156 categorized as: build_gdk_image (matching pattern: "Building GDK image")
[JobTraceToFailureCategory] Error: Could not find any failure category
Job trace we used:
2025-04-29T20:53:28.436195Z 00O Running with gitlab-runner 17.10.0~pre.41.g5c23fd8e (5c23fd8e)
2025-04-29T20:53:28.436203Z 00O on blue-1.private.runners-manager.gitlab.com/gitlab.com/gitlab-org 1zzGUpzq, system ID: s_fc31da7ae46e
2025-04-29T20:53:28.436214Z 00O feature flags: FF_NETWORK_PER_BUILD:true, FF_USE_FASTZIP:true, FF_TIMESTAMPS:true
2025-04-29T20:53:28.436234Z 00O Resolving secrets
2025-04-29T20:53:28.436450Z 00O section_start:1745960008:prepare_executor
2025-04-29T20:53:28.436452Z 00O+Preparing the "docker+machine" executor
2025-04-29T20:53:28.597931Z 00O Using Docker executor with image registry.gitlab.com/gitlab-org/technical-writing/docs-gitlab-com/docs-gitlab-com-builder:hugo-0.145.0 ...
2025-04-29T20:53:30.559735Z 00O Authenticating with credentials from job payload (GitLab Registry)
2025-04-29T20:53:30.559761Z 00O Pulling docker image registry.gitlab.com/gitlab-org/technical-writing/docs-gitlab-com/docs-gitlab-com-builder:hugo-0.145.0 ...
2025-04-29T20:53:40.888369Z 00O Using docker image sha256:3319e5b2c019396ec609a2abd6f6772959eb856f0a5cb94185c54c3a6a445afa for registry.gitlab.com/gitlab-org/technical-writing/docs-gitlab-com/docs-gitlab-com-builder:hugo-0.145.0 with digest registry.gitlab.com/gitlab-org/technical-writing/docs-gitlab-com/docs-gitlab-com-builder@sha256:bd98e379e41b4ca53df7a7f48e9e60d64a787af70847aa8c68c5539648f6acb2 ...
2025-04-29T20:53:40.888474Z 00O section_end:1745960020:prepare_executor
2025-04-29T20:53:40.888478Z 00O+section_start:1745960020:prepare_script
2025-04-29T20:53:40.888617Z 00O+Preparing environment
2025-04-29T20:53:45.946724Z 01O Running on runner-1zzgupzq-project-278964-concurrent-0 via runner-1zzgupzq-private-1745943320-03073346...
2025-04-29T20:53:46.735480Z 00O section_end:1745960026:prepare_script
2025-04-29T20:53:46.735540Z 00O+section_start:1745960026:get_sources
2025-04-29T20:53:46.752670Z 00O+Getting source from Git repository
2025-04-29T20:53:46.873515Z 01O Fetching changes with git depth set to 20...
2025-04-29T20:53:46.891019Z 01O Initialized empty Git repository in /builds/gitlab-org/gitlab/.git/
2025-04-29T20:53:46.924565Z 01O Created fresh repository.
remote: Enumerating objects: 212047, done. g objects: 49165
remote: Counting objects: 58% (122988/212047) ts: 0% (1/212047)
remote: Counting objects: 100% (212047/212047), done. % (125108/212047)
remote: Compressing objects: 65% (90100/138614) cts: 0% (1/138614)
remote: Compressing objects: 90% (124753/138614) ts: 66% (91486/138614)
remote: Compressing objects: 100% (138614/138614), done. % (126139/138614)
2025-04-29T20:53:48.162721Z 01E Receiving objects: 0% (1/212047)
2025-04-29T20:53:48.206592Z 01E+Receiving objects: 1% (2121/212047)
2025-04-29T20:53:48.451267Z 01E+Receiving objects: 2% (4241/212047)
2025-04-29T20:53:48.506911Z 01E+Receiving objects: 3% (6362/212047)
2025-04-29T20:53:48.562229Z 01E+Receiving objects: 4% (8482/212047)
2025-04-29T20:53:48.599086Z 01E+Receiving objects: 5% (10603/212047)
2025-04-29T20:53:48.654858Z 01E+Receiving objects: 6% (12723/212047)
2025-04-29T20:53:48.694115Z 01E+Receiving objects: 7% (14844/212047), 17.18 MiB | 34.41 MiB/s
2025-04-29T20:53:48.745157Z 01E+Receiving objects: 8% (16964/212047), 17.18 MiB | 34.41 MiB/s
2025-04-29T20:53:48.789206Z 01E+Receiving objects: 9% (19085/212047), 17.18 MiB | 34.41 MiB/s
2025-04-29T20:53:48.831360Z 01E+Receiving objects: 10% (21205/212047), 17.18 MiB | 34.41 MiB/s
2025-04-29T20:53:48.928112Z 01E+Receiving objects: 11% (23326/212047), 17.18 MiB | 34.41 MiB/s
2025-04-29T20:53:48.949410Z 01E+Receiving objects: 12% (25446/212047), 17.18 MiB | 34.41 MiB/s
2025-04-29T20:53:48.959877Z 01E+Receiving objects: 13% (27567/212047), 17.18 MiB | 34.41 MiB/s
2025-04-29T20:53:48.993812Z 01E+Receiving objects: 14% (29687/212047), 17.18 MiB | 34.41 MiB/s
2025-04-29T20:53:49.260940Z 01E+Receiving objects: 15% (31808/212047), 17.18 MiB | 34.41 MiB/s
2025-04-29T20:53:49.463140Z 01E+Receiving objects: 16% (33928/212047), 17.18 MiB | 34.41 MiB/s
2025-04-29T20:53:49.596510Z 01E+Receiving objects: 17% (36048/212047), 17.18 MiB | 34.41 MiB/s
2025-04-29T20:53:49.679460Z 01E+Receiving objects: 18% (38169/212047), 17.18 MiB | 34.41 MiB/s
2025-04-29T20:53:49.162672Z 01E+Receiving objects: 18% (39540/212047), 30.27 MiB | 30.30 MiB/s
2025-04-29T20:53:49.237561Z 01E+Receiving objects: 19% (40289/212047), 30.27 MiB | 30.30 MiB/s
2025-04-29T20:53:49.676843Z 01E+Receiving objects: 20% (42410/212047), 49.09 MiB | 32.74 MiB/s
2025-04-29T20:53:50.543070Z 01E+Receiving objects: 21% (44530/212047), 49.09 MiB | 32.74 MiB/s
2025-04-29T20:53:50.997840Z 01E+Receiving objects: 22% (46651/212047), 49.09 MiB | 32.74 MiB/s
2025-04-29T20:53:50.144845Z 01E+Receiving objects: 23% (48771/212047), 49.09 MiB | 32.74 MiB/s
2025-04-29T20:53:50.162645Z 01E+Receiving objects: 23% (49687/212047), 49.09 MiB | 32.74 MiB/s
2025-04-29T20:53:50.179613Z 01E+Receiving objects: 24% (50892/212047), 68.27 MiB | 34.15 MiB/s
2025-04-29T20:53:50.218245Z 01E+Receiving objects: 25% (53012/212047), 68.27 MiB | 34.15 MiB/s
2025-04-29T20:53:50.251997Z 01E+Receiving objects: 26% (55133/212047), 68.27 MiB | 34.15 MiB/s
2025-04-29T20:53:50.283125Z 01E+Receiving objects: 27% (57253/212047), 68.27 MiB | 34.15 MiB/s
2025-04-29T20:53:50.298564Z 01E+Receiving objects: 28% (59374/212047), 68.27 MiB | 34.15 MiB/s
2025-04-29T20:53:50.329954Z 01E+Receiving objects: 29% (61494/212047), 68.27 MiB | 34.15 MiB/s
2025-04-29T20:53:50.377116Z 01E+Receiving objects: 30% (63615/212047), 68.27 MiB | 34.15 MiB/s
2025-04-29T20:53:50.437829Z 01E+Receiving objects: 31% (65735/212047), 68.27 MiB | 34.15 MiB/s
2025-04-29T20:53:50.516400Z 01E+Receiving objects: 32% (67856/212047), 68.27 MiB | 34.15 MiB/s
2025-04-29T20:53:50.580448Z 01E+Receiving objects: 33% (69976/212047), 68.27 MiB | 34.15 MiB/s
2025-04-29T20:53:50.642042Z 01E+Receiving objects: 34% (72096/212047), 68.27 MiB | 34.15 MiB/s
2025-04-29T20:53:50.727699Z 01E+Receiving objects: 35% (74217/212047), 79.33 MiB | 31.74 MiB/s
2025-04-29T20:53:50.804915Z 01E+Receiving objects: 36% (76337/212047), 79.33 MiB | 31.74 MiB/s
2025-04-29T20:53:50.867307Z 01E+Receiving objects: 37% (78458/212047), 79.33 MiB | 31.74 MiB/s
2025-04-29T20:53:50.925602Z 01E+Receiving objects: 38% (80578/212047), 79.33 MiB | 31.74 MiB/s
2025-04-29T20:53:50.969697Z 01E+Receiving objects: 39% (82699/212047), 79.33 MiB | 31.74 MiB/s
2025-04-29T20:53:51.268340Z 01E+Receiving objects: 40% (84819/212047), 79.33 MiB | 31.74 MiB/s
2025-04-29T20:53:51.163039Z 01E+Receiving objects: 40% (85799/212047), 91.58 MiB | 30.54 MiB/s
2025-04-29T20:53:51.369917Z 01E+Receiving objects: 41% (86940/212047), 91.58 MiB | 30.54 MiB/s
2025-04-29T20:53:51.542134Z 01E+Receiving objects: 42% (89060/212047), 91.58 MiB | 30.54 MiB/s
2025-04-29T20:53:51.671899Z 01E+Receiving objects: 43% (91181/212047), 113.71 MiB | 32.50 MiB/s
2025-04-29T20:53:51.739814Z 01E+Receiving objects: 44% (93301/212047), 113.71 MiB | 32.50 MiB/s
2025-04-29T20:53:51.801542Z 01E+Receiving objects: 45% (95422/212047), 113.71 MiB | 32.50 MiB/s
2025-04-29T20:53:51.903240Z 01E+Receiving objects: 46% (97542/212047), 113.71 MiB | 32.50 MiB/s
2025-04-29T20:53:51.983206Z 01E+Receiving objects: 47% (99663/212047), 113.71 MiB | 32.50 MiB/s
2025-04-29T20:53:52.544610Z 01E+Receiving objects: 48% (101783/212047), 113.71 MiB | 32.50 MiB/s
2025-04-29T20:53:52.107525Z 01E+Receiving objects: 49% (103904/212047), 113.71 MiB | 32.50 MiB/s
2025-04-29T20:53:52.162681Z 01E+Receiving objects: 49% (105324/212047), 113.71 MiB | 32.50 MiB/s
2025-04-29T20:53:52.190585Z 01E+Receiving objects: 50% (106024/212047), 124.87 MiB | 31.22 MiB/s
2025-04-29T20:53:52.251141Z 01E+Receiving objects: 51% (108144/212047), 124.87 MiB | 31.22 MiB/s
2025-04-29T20:53:52.338659Z 01E+Receiving objects: 52% (110265/212047), 124.87 MiB | 31.22 MiB/s
2025-04-29T20:53:52.422798Z 01E+Receiving objects: 53% (112385/212047), 124.87 MiB | 31.22 MiB/s
2025-04-29T20:53:52.483734Z 01E+Receiving objects: 54% (114506/212047), 124.87 MiB | 31.22 MiB/s
2025-04-29T20:53:52.726617Z 01E+Receiving objects: 55% (116626/212047), 140.73 MiB | 31.28 MiB/s
2025-04-29T20:53:52.763022Z 01E+Receiving objects: 56% (118747/212047), 140.73 MiB | 31.28 MiB/s
2025-04-29T20:53:53.856600Z 01E+Receiving objects: 57% (120867/212047), 140.73 MiB | 31.28 MiB/s
2025-04-29T20:53:53.197840Z 01E+Receiving objects: 58% (122988/212047), 140.73 MiB | 31.28 MiB/s
2025-04-29T20:53:53.158408Z 01E+Receiving objects: 59% (125108/212047), 140.73 MiB | 31.28 MiB/s
2025-04-29T20:53:53.162684Z 01E+Receiving objects: 59% (125977/212047), 140.73 MiB | 31.28 MiB/s
2025-04-29T20:53:53.199423Z 01E+Receiving objects: 60% (127229/212047), 161.03 MiB | 31.97 MiB/s
2025-04-29T20:53:53.276448Z 01E+Receiving objects: 61% (129349/212047), 161.03 MiB | 31.97 MiB/s
2025-04-29T20:53:53.311213Z 01E+Receiving objects: 62% (131470/212047), 161.03 MiB | 31.97 MiB/s
2025-04-29T20:53:53.550364Z 01E+Receiving objects: 63% (133590/212047), 161.03 MiB | 31.97 MiB/s
2025-04-29T20:53:53.561124Z 01E+Receiving objects: 64% (135711/212047), 161.03 MiB | 31.97 MiB/s
2025-04-29T20:53:53.569426Z 01E+Receiving objects: 65% (137831/212047), 161.03 MiB | 31.97 MiB/s
2025-04-29T20:53:53.612465Z 01E+Receiving objects: 66% (139952/212047), 161.03 MiB | 31.97 MiB/s
2025-04-29T20:53:53.761686Z 01E+Receiving objects: 67% (142072/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:53.890669Z 01E+Receiving objects: 68% (144192/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:53.901854Z 01E+Receiving objects: 69% (146313/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:53.911030Z 01E+Receiving objects: 70% (148433/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:53.919701Z 01E+Receiving objects: 71% (150554/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:54.408970Z 01E+Receiving objects: 72% (152674/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:54.483400Z 01E+Receiving objects: 73% (154795/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:54.799090Z 01E+Receiving objects: 74% (156915/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:54.932600Z 01E+Receiving objects: 75% (159036/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:54.104631Z 01E+Receiving objects: 76% (161156/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:54.114551Z 01E+Receiving objects: 77% (163277/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:54.124309Z 01E+Receiving objects: 78% (165397/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:54.134478Z 01E+Receiving objects: 79% (167518/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:54.144864Z 01E+Receiving objects: 80% (169638/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:54.162940Z 01E+Receiving objects: 80% (171333/212047), 181.10 MiB | 33.52 MiB/s
2025-04-29T20:53:54.169037Z 01E+Receiving objects: 81% (171759/212047), 199.51 MiB | 33.44 MiB/s
2025-04-29T20:53:54.215109Z 01E+Receiving objects: 82% (173879/212047), 199.51 MiB | 33.44 MiB/s
2025-04-29T20:53:54.226442Z 01E+Receiving objects: 83% (176000/212047), 199.51 MiB | 33.44 MiB/s
2025-04-29T20:53:54.252579Z 01E+Receiving objects: 84% (178120/212047), 199.51 MiB | 33.44 MiB/s
2025-04-29T20:53:54.368955Z 01E+Receiving objects: 85% (180240/212047), 199.51 MiB | 33.44 MiB/s
2025-04-29T20:53:54.393404Z 01E+Receiving objects: 86% (182361/212047), 199.51 MiB | 33.44 MiB/s
2025-04-29T20:53:54.401458Z 01E+Receiving objects: 87% (184481/212047), 199.51 MiB | 33.44 MiB/s
2025-04-29T20:53:54.646968Z 01E+Receiving objects: 88% (186602/212047), 199.51 MiB | 33.44 MiB/s
2025-04-29T20:53:54.653988Z 01E+Receiving objects: 89% (188722/212047), 199.51 MiB | 33.44 MiB/s
2025-04-29T20:53:54.777584Z 01E+Receiving objects: 90% (190843/212047), 217.94 MiB | 33.27 MiB/s
2025-04-29T20:53:55.139530Z 01E+Receiving objects: 91% (192963/212047), 217.94 MiB | 33.27 MiB/s
2025-04-29T20:53:55.113878Z 01E+Receiving objects: 92% (195084/212047), 217.94 MiB | 33.27 MiB/s
2025-04-29T20:53:55.123759Z 01E+Receiving objects: 93% (197204/212047), 217.94 MiB | 33.27 MiB/s
2025-04-29T20:53:55.130845Z 01E+Receiving objects: 94% (199325/212047), 217.94 MiB | 33.27 MiB/s
2025-04-29T20:53:55.162649Z 01E+Receiving objects: 94% (201069/212047), 217.94 MiB | 33.27 MiB/s
2025-04-29T20:53:55.199856Z 01E+Receiving objects: 95% (201445/212047), 237.10 MiB | 35.08 MiB/s
2025-04-29T20:53:55.263560Z 01E+Receiving objects: 96% (203566/212047), 237.10 MiB | 35.08 MiB/s
2025-04-29T20:53:55.275981Z 01E+Receiving objects: 97% (205686/212047), 237.10 MiB | 35.08 MiB/s
2025-04-29T20:53:55.305927Z 01E+Receiving objects: 98% (207807/212047), 237.10 MiB | 35.08 MiB/s
2025-04-29T20:53:55.435498Z 01E+Receiving objects: 99% (209927/212047), 237.10 MiB | 35.08 MiB/s
2025-04-29T20:53:55.457700Z 01E+remote: Total 212047 (delta 102930), reused 146740 (delta 65233), pack-reused 0 (from 0)
Receiving objects: 100% (212047/212047), 246.99 MiB | 33.85 MiB/s, done. 237.10 MiB | 35.08 MiB/s
2025-04-29T20:53:55.501279Z 01E Resolving deltas: 0% (0/102930)
2025-04-29T20:53:55.545156Z 01E+Resolving deltas: 1% (1030/102930)
2025-04-29T20:53:55.811022Z 01E+Resolving deltas: 2% (2059/102930)
2025-04-29T20:53:55.842504Z 01E+Resolving deltas: 3% (3089/102930)
2025-04-29T20:53:55.875671Z 01E+Resolving deltas: 4% (4118/102930)
2025-04-29T20:53:55.915252Z 01E+Resolving deltas: 5% (5148/102930)
2025-04-29T20:53:55.944690Z 01E+Resolving deltas: 6% (6176/102930)
2025-04-29T20:53:55.975398Z 01E+Resolving deltas: 7% (7206/102930)
2025-04-29T20:53:56.857800Z 01E+Resolving deltas: 8% (8235/102930)
2025-04-29T20:53:56.479630Z 01E+Resolving deltas: 9% (9265/102930)
2025-04-29T20:53:56.772530Z 01E+Resolving deltas: 10% (10293/102930)
2025-04-29T20:53:56.112389Z 01E+Resolving deltas: 11% (11323/102930)
2025-04-29T20:53:56.165203Z 01E+Resolving deltas: 12% (12352/102930)
2025-04-29T20:53:56.210334Z 01E+Resolving deltas: 13% (13381/102930)
2025-04-29T20:53:56.242348Z 01E+Resolving deltas: 14% (14411/102930)
2025-04-29T20:53:56.266921Z 01E+Resolving deltas: 15% (15440/102930)
2025-04-29T20:53:56.306209Z 01E+Resolving deltas: 16% (16469/102930)
2025-04-29T20:53:56.325679Z 01E+Resolving deltas: 17% (17499/102930)
2025-04-29T20:53:56.351716Z 01E+Resolving deltas: 18% (18528/102930)
2025-04-29T20:53:56.363142Z 01E+Resolving deltas: 19% (19558/102930)
2025-04-29T20:53:56.375375Z 01E+Resolving deltas: 20% (20586/102930)
2025-04-29T20:53:56.388818Z 01E+Resolving deltas: 21% (21616/102930)
2025-04-29T20:53:56.408620Z 01E+Resolving deltas: 22% (22645/102930)
2025-04-29T20:53:56.439177Z 01E+Resolving deltas: 23% (23674/102930)
2025-04-29T20:53:56.473605Z 01E+Resolving deltas: 24% (24704/102930)
2025-04-29T20:53:56.501276Z 01E+Resolving deltas: 24% (25195/102930)
2025-04-29T20:53:57.463578Z 01E+Resolving deltas: 25% (25733/102930)
2025-04-29T20:53:57.480247Z 01E+Resolving deltas: 26% (26762/102930)
2025-04-29T20:53:57.501467Z 01E+Resolving deltas: 26% (26841/102930)
2025-04-29T20:53:57.605520Z 01E+Resolving deltas: 27% (27792/102930)
2025-04-29T20:53:57.741337Z 01E+Resolving deltas: 28% (28821/102930)
2025-04-29T20:53:57.821972Z 01E+Resolving deltas: 29% (29850/102930)
2025-04-29T20:53:58.507618Z 01E+Resolving deltas: 29% (30518/102930)
2025-04-29T20:53:59.477570Z 01E+Resolving deltas: 30% (30879/102930)
2025-04-29T20:53:59.127410Z 01E+Resolving deltas: 31% (31909/102930)
2025-04-29T20:53:59.204173Z 01E+Resolving deltas: 32% (32938/102930)
2025-04-29T20:53:59.280906Z 01E+Resolving deltas: 33% (33967/102930)
2025-04-29T20:53:59.395885Z 01E+Resolving deltas: 34% (34997/102930)
2025-04-29T20:53:59.450265Z 01E+Resolving deltas: 35% (36026/102930)
2025-04-29T20:53:59.501209Z 01E+Resolving deltas: 35% (36912/102930)
2025-04-29T20:53:59.509864Z 01E+Resolving deltas: 36% (37055/102930)
2025-04-29T20:53:59.546137Z 01E+Resolving deltas: 37% (38085/102930)
2025-04-29T20:53:59.580260Z 01E+Resolving deltas: 38% (39114/102930)
2025-04-29T20:53:59.610421Z 01E+Resolving deltas: 39% (40143/102930)
2025-04-29T20:53:59.643626Z 01E+Resolving deltas: 40% (41172/102930)
2025-04-29T20:53:59.665189Z 01E+Resolving deltas: 41% (42202/102930)
2025-04-29T20:53:59.690865Z 01E+Resolving deltas: 42% (43231/102930)
2025-04-29T20:53:59.724013Z 01E+Resolving deltas: 43% (44260/102930)
2025-04-29T20:53:59.757519Z 01E+Resolving deltas: 44% (45290/102930)
2025-04-29T20:53:59.782426Z 01E+Resolving deltas: 45% (46319/102930)
2025-04-29T20:53:59.807370Z 01E+Resolving deltas: 46% (47348/102930)
2025-04-29T20:53:59.826454Z 01E+Resolving deltas: 47% (48378/102930)
2025-04-29T20:53:59.843129Z 01E+Resolving deltas: 48% (49407/102930)
2025-04-29T20:53:59.861356Z 01E+Resolving deltas: 49% (50436/102930)
2025-04-29T20:53:59.894734Z 01E+Resolving deltas: 50% (51465/102930)
2025-04-29T20:53:59.923262Z 01E+Resolving deltas: 51% (52495/102930)
2025-04-29T20:53:59.947813Z 01E+Resolving deltas: 52% (53524/102930)
2025-04-29T20:53:59.979341Z 01E+Resolving deltas: 53% (54553/102930)
2025-04-29T20:54:00.219910Z 01E+Resolving deltas: 54% (55584/102930)
2025-04-29T20:54:00.721870Z 01E+Resolving deltas: 55% (56612/102930)
2025-04-29T20:54:00.117371Z 01E+Resolving deltas: 56% (57642/102930)
2025-04-29T20:54:00.166040Z 01E+Resolving deltas: 57% (58671/102930)
2025-04-29T20:54:00.190074Z 01E+Resolving deltas: 58% (59700/102930)
2025-04-29T20:54:00.227581Z 01E+Resolving deltas: 59% (60729/102930)
2025-04-29T20:54:00.267337Z 01E+Resolving deltas: 60% (61758/102930)
2025-04-29T20:54:00.361162Z 01E+Resolving deltas: 61% (62788/102930)
2025-04-29T20:54:00.417934Z 01E+Resolving deltas: 62% (63817/102930)
2025-04-29T20:54:00.489450Z 01E+Resolving deltas: 63% (64846/102930)
2025-04-29T20:54:00.501150Z 01E+Resolving deltas: 63% (65292/102930)
2025-04-29T20:54:00.533399Z 01E+Resolving deltas: 64% (65876/102930)
2025-04-29T20:54:00.564154Z 01E+Resolving deltas: 65% (66905/102930)
2025-04-29T20:54:00.607915Z 01E+Resolving deltas: 66% (67934/102930)
2025-04-29T20:54:00.641717Z 01E+Resolving deltas: 67% (68964/102930)
2025-04-29T20:54:00.678051Z 01E+Resolving deltas: 68% (69993/102930)
2025-04-29T20:54:00.716291Z 01E+Resolving deltas: 69% (71022/102930)
2025-04-29T20:54:01.505494Z 01E+Resolving deltas: 69% (71676/102930)
2025-04-29T20:54:02.502519Z 01E+Resolving deltas: 69% (71808/102930)
2025-04-29T20:54:03.505565Z 01E+Resolving deltas: 69% (71932/102930)
2025-04-29T20:54:04.188538Z 01E+Resolving deltas: 70% (72052/102930)
2025-04-29T20:54:04.507395Z 01E+Resolving deltas: 70% (72094/102930)
2025-04-29T20:54:04.818618Z 01E+Resolving deltas: 71% (73081/102930)
2025-04-29T20:54:05.508548Z 01E+Resolving deltas: 71% (73459/102930)
2025-04-29T20:54:05.871933Z 01E+Resolving deltas: 72% (74110/102930)
2025-04-29T20:54:05.911319Z 01E+Resolving deltas: 73% (75139/102930)
2025-04-29T20:54:05.953026Z 01E+Resolving deltas: 74% (76169/102930)
2025-04-29T20:54:05.989922Z 01E+Resolving deltas: 75% (77198/102930)
2025-04-29T20:54:06.360880Z 01E+Resolving deltas: 76% (78227/102930)
2025-04-29T20:54:06.762170Z 01E+Resolving deltas: 77% (79257/102930)
2025-04-29T20:54:06.115203Z 01E+Resolving deltas: 78% (80286/102930)
2025-04-29T20:54:06.153284Z 01E+Resolving deltas: 79% (81315/102930)
2025-04-29T20:54:06.205105Z 01E+Resolving deltas: 80% (82345/102930)
2025-04-29T20:54:06.270409Z 01E+Resolving deltas: 81% (83374/102930)
2025-04-29T20:54:06.353965Z 01E+Resolving deltas: 82% (84403/102930)
2025-04-29T20:54:06.408083Z 01E+Resolving deltas: 83% (85432/102930)
2025-04-29T20:54:06.453650Z 01E+Resolving deltas: 84% (86462/102930)
2025-04-29T20:54:06.501193Z 01E+Resolving deltas: 84% (87299/102930)
2025-04-29T20:54:06.509677Z 01E+Resolving deltas: 85% (87491/102930)
2025-04-29T20:54:06.670047Z 01E+Resolving deltas: 86% (88520/102930)
2025-04-29T20:54:06.684736Z 01E+Resolving deltas: 87% (89551/102930)
2025-04-29T20:54:06.706145Z 01E+Resolving deltas: 88% (90579/102930)
2025-04-29T20:54:06.728351Z 01E+Resolving deltas: 89% (91608/102930)
2025-04-29T20:54:06.744826Z 01E+Resolving deltas: 90% (92637/102930)
2025-04-29T20:54:06.758624Z 01E+Resolving deltas: 91% (93667/102930)
2025-04-29T20:54:06.774346Z 01E+Resolving deltas: 92% (94696/102930)
2025-04-29T20:54:06.801872Z 01E+Resolving deltas: 93% (95725/102930)
2025-04-29T20:54:07.188331Z 01E+Resolving deltas: 94% (96755/102930)
2025-04-29T20:54:07.499094Z 01E+Resolving deltas: 95% (97784/102930)
2025-04-29T20:54:07.501065Z 01E+Resolving deltas: 95% (97890/102930)
2025-04-29T20:54:07.518661Z 01E+Resolving deltas: 96% (98813/102930)
2025-04-29T20:54:07.558793Z 01E+Resolving deltas: 97% (99843/102930)
2025-04-29T20:54:07.580414Z 01E+Resolving deltas: 98% (100873/102930)
2025-04-29T20:54:07.600977Z 01E+Resolving deltas: 99% (101901/102930)
2025-04-29T20:54:07.635425Z 01E+Resolving deltas: 100% (102930/102930)
2025-04-29T20:54:07.635488Z 01E+Resolving deltas: 100% (102930/102930), done.
2025-04-29T20:54:08.976847Z 01E From https://us-east1-c.ci-gateway.int.gprd.gitlab.net:8989/gitlab-org/gitlab
2025-04-29T20:54:08.976855Z 01E * [new ref] refs/pipelines/1792939956 -> refs/pipelines/1792939956
2025-04-29T20:54:08.984039Z 01O Checking out 6adf0653 as detached HEAD (ref is refs/merge-requests/187609/merge)...
2025-04-29T20:54:18.643336Z 01O
2025-04-29T20:54:18.643341Z 01O Skipping Git submodules setup
2025-04-29T20:54:18.643343Z 01O $ git remote set-url origin "${CI_REPOSITORY_URL}" || echo 'Not a git repository; skipping'
2025-04-29T20:54:23.787831Z 00O section_end:1745960063:get_sources
2025-04-29T20:54:23.787836Z 00O+section_start:1745960063:step_script
2025-04-29T20:54:23.792272Z 00O+Executing "step_script" stage of the job script
2025-04-29T20:54:23.793848Z 00O Using docker image sha256:3319e5b2c019396ec609a2abd6f6772959eb856f0a5cb94185c54c3a6a445afa for registry.gitlab.com/gitlab-org/technical-writing/docs-gitlab-com/docs-gitlab-com-builder:hugo-0.145.0 with digest registry.gitlab.com/gitlab-org/technical-writing/docs-gitlab-com/docs-gitlab-com-builder@sha256:bd98e379e41b4ca53df7a7f48e9e60d64a787af70847aa8c68c5539648f6acb2 ...
2025-04-29T20:54:24.449866Z 01O $ git clone --depth 1 --filter=tree:0 https://gitlab.com/gitlab-org/technical-writing/docs-gitlab-com.git
2025-04-29T20:54:24.478021Z 01E Cloning into 'docs-gitlab-com'...
2025-04-29T20:54:26.779902Z 01O $ cd docs-gitlab-com
2025-04-29T20:54:26.779909Z 01O $ make add-latest-icons
2025-04-29T20:54:26.825318Z 01E INFO Adding latest icons...
2025-04-29T20:54:26.828681Z 01O Fetching latest GitLab SVGs...
2025-04-29T20:54:26.830185Z 01O Downloading latest package from npm...
2025-04-29T20:54:28.822130Z 01O gitlab-svgs-3.128.0.tgz
2025-04-29T20:54:28.139127Z 01O Extracting files...
2025-04-29T20:54:28.231331Z 01O Moving files to themes/gitlab-docs/static/gitlab_ui/svgs-latest...
2025-04-29T20:54:28.253436Z 01O Successfully updated SVGs
2025-04-29T20:54:28.254649Z 01O $ cp -r ../doc/* content/
2025-04-29T20:54:28.479346Z 01O $ hugo --gc --printPathWarnings --panicOnWarning
2025-04-29T20:54:28.573965Z 01O Start building sites …
2025-04-29T20:54:28.573973Z 01O hugo v0.145.0-666444f0a52132f9fec9f71cf25b441cc6a4f355+extended linux/amd64 BuildDate=2025-02-26T15:41:25Z VendorInfo=hugomods
2025-04-29T20:54:28.573976Z 01O
2025-04-29T20:54:44.162704Z 01E WARN template: partials/functions/release-dates.html:4:22: executing "partials/functions/release-dates.html" at <resources.GetRemote>: error calling GetRemote: Get "https://gitlab.com/gitlab-com/www-gitlab-com/-/raw/master/data/releases.yml": read tcp 192.168.224.2:46858->172.65.251.78:443: read: connection reset by peer
2025-04-29T20:54:47.961629Z 01O Total in 19417 ms
2025-04-29T20:54:47.961636Z 01O Error: error building site: render: failed to render pages: render of "/builds/gitlab-org/gitlab/docs-gitlab-com/content/update/deprecations.md" failed: "/builds/gitlab-org/gitlab/docs-gitlab-com/themes/gitlab-docs/layouts/_default/baseof.html:22:39": execute of template failed: template: _default/single.html:22:39: executing "_default/single.html" at <partial "functions/release-dates" .>: error calling partial: "/builds/gitlab-org/gitlab/docs-gitlab-com/themes/gitlab-docs/layouts/partials/functions/release-dates.html:6:7": execute of template failed: template: partials/functions/release-dates.html:6:7: executing "partials/functions/release-dates.html" at <warnf "%s" .>: error calling warnf: template: partials/functions/release-dates.html:4:22: executing "partials/functions/release-dates.html" at <resources.GetRemote>: error calling GetRemote: Get "https://gitlab.com/gitlab-com/www-gitlab-com/-/raw/master/data/releases.yml": read tcp 192.168.224.2:46858->172.65.251.78:443: read: connection reset by peer
2025-04-29T20:54:49.257572Z 00O section_end:1745960089:step_script
2025-04-29T20:54:49.257582Z 00O+section_start:1745960089:cleanup_file_variables
2025-04-29T20:54:49.260068Z 00O+Cleaning up project directory and file based variables
2025-04-29T20:54:49.789490Z 00O section_end:1745960089:cleanup_file_variables
2025-04-29T20:54:49.789495Z 00O+
2025-04-29T20:54:53.846829Z 00O ERROR: Job failed: exit code 1
2025-04-29T20:54:53.846832Z 00O
[Local Batch Failure Analyzer] Job #9871562098 categorized as: ruby_generic_failure (matching pattern: ":in `")
[Local Batch Failure Analyzer] Job #9871561933 categorized as: http (matching pattern: "400 Bad Request")
[Local Batch Failure Analyzer] Job #9871424444 categorized as: ruby_crash_core_dump (matching pattern: "Control frame information")
[Local Batch Failure Analyzer] Job #9871136218 categorized as: git_issues (matching pattern: "fatal: couldn't find remote ref")
[Local Batch Failure Analyzer] Job #9870965910 categorized as: rubocop (matching pattern: "offenses? detected")
[Local Batch Failure Analyzer] Job #9870893394 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9870893381 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9870890706 categorized as: cng (matching pattern: "=== block '.+' error ===")
[Local Batch Failure Analyzer] Job #9870868556 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9870868536 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9870868366 categorized as: jest (matching pattern: "Command .+ node_modules/.bin/jest.+ exited with status 1")
[Local Batch Failure Analyzer] Job #9870840731 categorized as: rubocop (matching pattern: "offenses? detected")
[Local Batch Failure Analyzer] Job #9870839696 categorized as: pg_query_canceled (matching pattern: "We have detected a PG::QueryCanceled error in the specs, so we're failing early.")
[Local Batch Failure Analyzer] Job #9870831003 categorized as: pg_query_canceled (matching pattern: "We have detected a PG::QueryCanceled error in the specs, so we're failing early.")
[Local Batch Failure Analyzer] Job #9870809522 categorized as: rubocop (matching pattern: "offenses? detected")
[Local Batch Failure Analyzer] Job #9870793028 categorized as: artifacts_upload_502 (matching pattern: "Uploading artifacts .+ 502 Bad Gateway")
[Local Batch Failure Analyzer] Job #9870741921 categorized as: danger (matching pattern: "If needed, you can retry the.+`danger-review` job")
[Local Batch Failure Analyzer] Job #9870713048 categorized as: artifacts_upload_502 (matching pattern: "Uploading artifacts .+ 502 Bad Gateway")
[Local Batch Failure Analyzer] Job #9870706652 categorized as: artifacts_upload_502 (matching pattern: "Uploading artifacts .+ 502 Bad Gateway")Goal
Try several times to download the job trace, until we're sure we have the full trace.
Is this a problem for performance?
At this stage, the CI/CD job already failed, so taking a minute to correctly analyze the failure feels like time well spent.
Edited by David Dieulivol