`gitlab-k8s-agent` build fail with `com.google.devtools.build.lib.rules.apple.DottedVersion$InvalidDottedVersionException` on Mac with CLT instead of Xcode.app

Overview

My gdk update today failed with com.google.devtools.build.lib.rules.apple.DottedVersion$InvalidDottedVersionException when making gitlab-k8s-agent/build/gdk/bin/kas_race.

$ gdk update
ℹ️  gdk update: before hook -> support/exec-cd gitlab bin/spring stop || true
Spring is not running

--------------------------------------------------------------------------------
Running self-update on GDK
--------------------------------------------------------------------------------
Already on 'main'
┌ ✔ Update your GDK
├── ✔ Install gems for GDK [209ms]
├── ✔ Platform update [16s]
├── ✔ Tool versions update [7s]
├── ✔ Preflight Update checks [3ms]
├── ✔ Update GitLab repository [25s]
├── ✔ Run `make gitlab/.git` [4s]
├── ✔ Run `make gitlab-config` [5s]
├── ✔ Run `make gitlab-asdf-install` [4s]
├── ✔ Run `make .gitlab-bundle` [18s]
├── ✔ Run `make .gitlab-lefthook` [4s]
├── ✔ Run `make .gitlab-yarn` [6s]
├── ✔ Run `make .gitlab-translations` [37s]
├── ✔ Run `make postgresql` [11s]
├── ✔ Preflight checks for dependencies [15s]
├── ✔ Run GitLab migrations [3m 1s]
├── ✔ Run `make gitaly-update` [39s]
├── ✔ Run `make gitlab-http-router-update` [35s]
├── ✔ Run `make gitlab-pages-update` [41s]
├── ✔ Run `make gitlab-translations-unlock` [5s]
├── ✔ Run `make gitlab-topology-service-update` [34s]
├── ⠦ Download GraphQL schema
├── ✔ Run `make gitlab-workhorse-update` [20s]
├── ✔ Run `make ensure-databases-setup` [16s]
├── ✔ Run `make gitlab-shell-update` [33s]
├── ✔ Run `make gitlab-k8s-agent-update` [17s]
└── ✔ Run `make unlock-dependency-installers` [2s]
┌ ✔ Reconfigure your GDK
├── ✔ Run `make postgresql` [6s]
├── ✔ Run `make nginx-setup` [5s]
├── ✔ Run `make runner-setup` [4s]
├── ✖ Run `make gitlab-k8s-agent-setup` [1m 1s]
├── ✔ Run `make gitlab-runner-setup` [3s]
├── ✔ Run `make gitlab-pages-setup` [28s]
├── ✔ Run `make gitlab-http-router-setup` [11s]
├── ✔ Run `make openssh-setup` [5s]
└── ✔ Run `make gitlab-topology-service-setup` [21s]
❌️ ERROR: Task reconfigure:make:gitlab-k8s-agent-setup failed:

  at com.google.devtools.build.lib.rules.apple.DottedVersion.fromStringUnchecked(DottedVersion.java:181)
  	at com.google.devtools.build.lib.exec.local.XcodeLocalEnvProvider.rewriteLocalEnv(XcodeLocalEnvProvider.java:95)
  	at com.google.devtools.build.lib.sandbox.DarwinSandboxedSpawnRunner.prepareSpawn(DarwinSandboxedSpawnRunner.java:219)
  	at com.google.devtools.build.lib.sandbox.AbstractSandboxSpawnRunner.exec(AbstractSandboxSpawnRunner.java:112)
  	at com.google.devtools.build.lib.sandbox.SandboxModule$SandboxFallbackSpawnRunner.exec(SandboxModule.java:479)
  	at com.google.devtools.build.lib.exec.AbstractSpawnStrategy.exec(AbstractSpawnStrategy.java:161)
  	at com.google.devtools.build.lib.exec.AbstractSpawnStrategy.exec(AbstractSpawnStrategy.java:121)
  	at com.google.devtools.build.lib.exec.SpawnStrategyResolver.exec(SpawnStrategyResolver.java:45)
  	at com.google.devtools.build.lib.analysis.actions.SpawnAction.execute(SpawnAction.java:253)
  	at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$ActionRunner.executeAction(SkyframeActionExecutor.java:1177)
  	at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$ActionRunner.run(SkyframeActionExecutor.java:1082)
  	at com.google.devtools.build.lib.skyframe.ActionExecutionState.runStateMachine(ActionExecutionState.java:166)
  	at com.google.devtools.build.lib.skyframe.ActionExecutionState.getResultOrDependOnFuture(ActionExecutionState.java:95)
  	at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor.executeAction(SkyframeActionExecutor.java:566)
  	at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.checkCacheAndExecuteIfNeeded(ActionExecutionFunction.java:946)
  	at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.computeInternal(ActionExecutionFunction.java:377)
  	at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.compute(ActionExecutionFunction.java:218)
  	at com.google.devtools.build.skyframe.AbstractParallelEvaluator$Evaluate.run(AbstractParallelEvaluator.java:467)
  	... 8 more
  Caused by: com.google.devtools.build.lib.rules.apple.DottedVersion$InvalidDottedVersionException: Dotted version components must all start with the form \d+([a-z0-9]*?)?(\d+)? but got 'None'
  	at com.google.devtools.build.lib.rules.apple.DottedVersion.fromString(DottedVersion.java:203)
  	at com.google.devtools.build.lib.rules.apple.DottedVersion.fromStringUnchecked(DottedVersion.java:179)
  	... 25 more
  make[1]: *** [gdk-install] Error 37
  make: *** [gitlab-k8s-agent/build/gdk/bin/kas_race] Error 2
  
  See /Users/zhouyuda/code/gitlab/gdk/log/gdk/rake-2025-05-03_13-16-46_491/reconfigure-make-gitlab-k8s-agent-setup.log for the full log.

Full log here 👀

$ cat /Users/zhouyuda/code/gitlab/gdk/log/gdk/rake-2025-05-03_13-16-46_491/reconfigure-make-gitlab-k8s-agent-setup.log

--------------------------------------------------------------------------------
Installing gitlab-org/cluster-integration/gitlab-agent
--------------------------------------------------------------------------------
Starting local Bazel server (8.2.1) and connecting to it...
Computing main repo mapping: 
Loading: 
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
    currently loading: cmd/kas
Analyzing: target //cmd/kas:extract_kas_race (1 packages loaded, 0 targets configured)
Analyzing: target //cmd/kas:extract_kas_race (1 packages loaded, 0 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (59 packages loaded, 9 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (66 packages loaded, 9 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (95 packages loaded, 356 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (100 packages loaded, 2693 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (105 packages loaded, 6445 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (125 packages loaded, 11273 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (220 packages loaded, 14368 targets configured)

DEBUG: /private/var/tmp/_bazel_zhouyuda/d9dad5ffb405fef3f7e1f0d3b5597246/external/gazelle+/internal/bzlmod/go_deps.bzl:607:40: 
Mismatch between versions requested for Go module cel.dev/expr:

  bazel_dep version (MODULE.bazel): 0.23.0 (as "cel-spec")
  Go module version (go.mod):       0.23.1
 
Either ensure that you have

  bazel_dep(module_name = "cel-spec", version = "0.23.1")

in your MODULE.bazel file or downgrade the Go module version via

  bazel run @rules_go//go -- get cel.dev/expr@v0.23.0

Analyzing: target //cmd/kas:extract_kas_race (220 packages loaded, 14368 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (221 packages loaded, 14447 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (221 packages loaded, 14447 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (221 packages loaded, 14447 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (221 packages loaded, 14447 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (237 packages loaded, 14597 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (279 packages loaded, 14953 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (309 packages loaded, 15173 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (382 packages loaded, 15445 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (448 packages loaded, 15856 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (527 packages loaded, 16545 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (644 packages loaded, 17111 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (685 packages loaded, 17360 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (720 packages loaded, 17698 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (722 packages loaded, 17701 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (722 packages loaded, 17701 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (751 packages loaded, 17799 targets configured)

INFO: Analyzed target //cmd/kas:extract_kas_race (799 packages loaded, 17970 targets configured).
FATAL: bazel crashed due to an internal error. Printing stack trace:
java.lang.RuntimeException: Unrecoverable error while evaluating node 'ActionLookupData0{actionLookupKey=ConfiguredTargetKey{label=@@apple_support+//crosstool:exec_wrapped_clang_pp.target_config, config=BuildConfigurationKey[73b23c9431e4a37662161672c6ba36d4c3ec702d993197ee9c011122d359f120]}, actionIndex=0}' (requested by nodes 'ArtifactNestedSetKey[4]@430767885')
	at com.google.devtools.build.skyframe.AbstractParallelEvaluator$Evaluate.run(AbstractParallelEvaluator.java:547)
	at com.google.devtools.build.lib.concurrent.AbstractQueueVisitor$WrappedRunnable.run(AbstractQueueVisitor.java:435)
	at java.base/java.util.concurrent.ForkJoinTask$RunnableExecuteAction.compute(Unknown Source)
	at java.base/java.util.concurrent.ForkJoinTask$RunnableExecuteAction.compute(Unknown Source)
	at java.base/java.util.concurrent.ForkJoinTask$InterruptibleTask.exec(Unknown Source)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(Unknown Source)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(Unknown Source)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(Unknown Source)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(Unknown Source)
Caused by: java.lang.IllegalArgumentException: com.google.devtools.build.lib.rules.apple.DottedVersion$InvalidDottedVersionException: Dotted version components must all start with the form \d+([a-z0-9]*?)?(\d+)? but got 'None'
	at com.google.devtools.build.lib.rules.apple.DottedVersion.fromStringUnchecked(DottedVersion.java:181)
	at com.google.devtools.build.lib.exec.local.XcodeLocalEnvProvider.rewriteLocalEnv(XcodeLocalEnvProvider.java:95)
	at com.google.devtools.build.lib.sandbox.DarwinSandboxedSpawnRunner.prepareSpawn(DarwinSandboxedSpawnRunner.java:219)
	at com.google.devtools.build.lib.sandbox.AbstractSandboxSpawnRunner.exec(AbstractSandboxSpawnRunner.java:112)
	at com.google.devtools.build.lib.sandbox.SandboxModule$SandboxFallbackSpawnRunner.exec(SandboxModule.java:479)
	at com.google.devtools.build.lib.exec.AbstractSpawnStrategy.exec(AbstractSpawnStrategy.java:161)
	at com.google.devtools.build.lib.exec.AbstractSpawnStrategy.exec(AbstractSpawnStrategy.java:121)
	at com.google.devtools.build.lib.exec.SpawnStrategyResolver.exec(SpawnStrategyResolver.java:45)
	at com.google.devtools.build.lib.analysis.actions.SpawnAction.execute(SpawnAction.java:253)
	at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$ActionRunner.executeAction(SkyframeActionExecutor.java:1177)
	at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$ActionRunner.run(SkyframeActionExecutor.java:1082)
	at com.google.devtools.build.lib.skyframe.ActionExecutionState.runStateMachine(ActionExecutionState.java:166)
	at com.google.devtools.build.lib.skyframe.ActionExecutionState.getResultOrDependOnFuture(ActionExecutionState.java:95)
	at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor.executeAction(SkyframeActionExecutor.java:566)
	at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.checkCacheAndExecuteIfNeeded(ActionExecutionFunction.java:946)
	at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.computeInternal(ActionExecutionFunction.java:377)
	at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.compute(ActionExecutionFunction.java:218)
	at com.google.devtools.build.skyframe.AbstractParallelEvaluator$Evaluate.run(AbstractParallelEvaluator.java:467)
	... 8 more
Caused by: com.google.devtools.build.lib.rules.apple.DottedVersion$InvalidDottedVersionException: Dotted version components must all start with the form \d+([a-z0-9]*?)?(\d+)? but got 'None'
	at com.google.devtools.build.lib.rules.apple.DottedVersion.fromString(DottedVersion.java:203)
	at com.google.devtools.build.lib.rules.apple.DottedVersion.fromStringUnchecked(DottedVersion.java:179)
	... 25 more
make[1]: *** [gdk-install] Error 37
make: *** [gitlab-k8s-agent/build/gdk/bin/kas_race] Error 2

Impacted categories

The following categories relate to this issue:

gdk-reliability - e.g. When a GDK action fails to complete.
gdk-usability - e.g. Improvements or suggestions around how the GDK functions.
gdk-performance - e.g. When a GDK action is slow or times out.

Steps to replicate and fix

I'm not familiar with Bazel, but from a quick search ¹², I learned that com.google.devtools.build.lib.rules.apple.DottedVersion$InvalidDottedVersionException might be related to Bazel's dependency on Xcode.app for Mac users.

While I already have the Xcode command line tools installed previously, I resolved the issue after downloading Xcode.app from App Store, accepting term sudo xcodebuild -license accept, and rebuild after bazel clean --expunge.

Before

$ xcode-select -p
/Library/Developer/CommandLineTools

$ echo $DEVELOPER_DIR

$ xcodebuild -version
xcode-select: error: tool 'xcodebuild' requires Xcode, but active developer directory '/Library/Developer/CommandLineTools' is a command line tools instance

$ which gmake
/opt/homebrew/bin/gmake

$ gmake gitlab-k8s-agent/build/gdk/bin/kas_race

--------------------------------------------------------------------------------
Installing gitlab-org/cluster-integration/gitlab-agent
--------------------------------------------------------------------------------
Starting local Bazel server (8.2.1) and connecting to it...
Computing main repo mapping: 
Loading: 
Loading: 0 packages loaded
Analyzing: target //cmd/kas:extract_kas_race (1 packages loaded, 0 targets configured)
Analyzing: target //cmd/kas:extract_kas_race (1 packages loaded, 0 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (105 packages loaded, 8603 targets configured)

DEBUG: /private/var/tmp/_bazel_zhouyuda/d9dad5ffb405fef3f7e1f0d3b5597246/external/gazelle+/internal/bzlmod/go_deps.bzl:607:40: 
Mismatch between versions requested for Go module cel.dev/expr:

  bazel_dep version (MODULE.bazel): 0.23.0 (as "cel-spec")
  Go module version (go.mod):       0.23.1
 
Either ensure that you have

  bazel_dep(module_name = "cel-spec", version = "0.23.1")

in your MODULE.bazel file or downgrade the Go module version via

  bazel run @rules_go//go -- get cel.dev/expr@v0.23.0

Analyzing: target //cmd/kas:extract_kas_race (798 packages loaded, 17244 targets configured)

INFO: Analyzed target //cmd/kas:extract_kas_race (799 packages loaded, 17970 targets configured).
FATAL: bazel crashed due to an internal error. Printing stack trace:
java.lang.RuntimeException: Unrecoverable error while evaluating node 'ActionLookupData0{actionLookupKey=ConfiguredTargetKey{label=@@apple_support+//crosstool:exec_wrapped_clang.target_config, config=BuildConfigurationKey[73b23c9431e4a37662161672c6ba36d4c3ec702d993197ee9c011122d359f120]}, actionIndex=0}' (requested by nodes 'ArtifactNestedSetKey[4]@1020114837')
	at com.google.devtools.build.skyframe.AbstractParallelEvaluator$Evaluate.run(AbstractParallelEvaluator.java:547)
	at com.google.devtools.build.lib.concurrent.AbstractQueueVisitor$WrappedRunnable.run(AbstractQueueVisitor.java:435)
	at java.base/java.util.concurrent.ForkJoinTask$RunnableExecuteAction.compute(Unknown Source)
	at java.base/java.util.concurrent.ForkJoinTask$RunnableExecuteAction.compute(Unknown Source)
	at java.base/java.util.concurrent.ForkJoinTask$InterruptibleTask.exec(Unknown Source)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(Unknown Source)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(Unknown Source)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(Unknown Source)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(Unknown Source)
Caused by: java.lang.IllegalArgumentException: com.google.devtools.build.lib.rules.apple.DottedVersion$InvalidDottedVersionException: Dotted version components must all start with the form \d+([a-z0-9]*?)?(\d+)? but got 'None'
	at com.google.devtools.build.lib.rules.apple.DottedVersion.fromStringUnchecked(DottedVersion.java:181)
	at com.google.devtools.build.lib.exec.local.XcodeLocalEnvProvider.rewriteLocalEnv(XcodeLocalEnvProvider.java:95)
	at com.google.devtools.build.lib.sandbox.DarwinSandboxedSpawnRunner.prepareSpawn(DarwinSandboxedSpawnRunner.java:219)
	at com.google.devtools.build.lib.sandbox.AbstractSandboxSpawnRunner.exec(AbstractSandboxSpawnRunner.java:112)
	at com.google.devtools.build.lib.sandbox.SandboxModule$SandboxFallbackSpawnRunner.exec(SandboxModule.java:479)
	at com.google.devtools.build.lib.exec.AbstractSpawnStrategy.exec(AbstractSpawnStrategy.java:161)
	at com.google.devtools.build.lib.exec.AbstractSpawnStrategy.exec(AbstractSpawnStrategy.java:121)
	at com.google.devtools.build.lib.exec.SpawnStrategyResolver.exec(SpawnStrategyResolver.java:45)
	at com.google.devtools.build.lib.analysis.actions.SpawnAction.execute(SpawnAction.java:253)
	at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$ActionRunner.executeAction(SkyframeActionExecutor.java:1177)
	at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$ActionRunner.run(SkyframeActionExecutor.java:1082)
	at com.google.devtools.build.lib.skyframe.ActionExecutionState.runStateMachine(ActionExecutionState.java:166)
	at com.google.devtools.build.lib.skyframe.ActionExecutionState.getResultOrDependOnFuture(ActionExecutionState.java:95)
	at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor.executeAction(SkyframeActionExecutor.java:566)
	at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.checkCacheAndExecuteIfNeeded(ActionExecutionFunction.java:946)
	at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.computeInternal(ActionExecutionFunction.java:377)
	at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.compute(ActionExecutionFunction.java:218)
	at com.google.devtools.build.skyframe.AbstractParallelEvaluator$Evaluate.run(AbstractParallelEvaluator.java:467)
	... 8 more
Caused by: com.google.devtools.build.lib.rules.apple.DottedVersion$InvalidDottedVersionException: Dotted version components must all start with the form \d+([a-z0-9]*?)?(\d+)? but got 'None'
	at com.google.devtools.build.lib.rules.apple.DottedVersion.fromString(DottedVersion.java:203)
	at com.google.devtools.build.lib.rules.apple.DottedVersion.fromStringUnchecked(DottedVersion.java:179)
	... 25 more
gmake[1]: *** [Makefile:230: gdk-install] Error 37
gmake: *** [support/makefiles/Makefile.gitlab-k8s.mk:50: gitlab-k8s-agent/build/gdk/bin/kas_race] Error 2

What I did

$ # Install Xcode.app from App Store

$ sudo xcodebuild -license
... (agree)

$ xcode-select --print-path
/Applications/Xcode.app/Contents/Developer

$ xcodebuild -version
Xcode 16.3
Build version 16E140

After

Clean bazel cache and rebuild successfully

$ cd path/to/gdk/gitlab-k8s-agent

$ mise ls bazel
Tool   Version  Source                                             Requested 
bazel  8.1.1   
bazel  8.2.1    ~/code/gitlab/gdk/gitlab-k8s-agent/.tool-versions  8.2.1

$ bazel clean --expunge
Starting local Bazel server (8.2.1) and connecting to it...
INFO: Starting clean (this may take a while). Use --async if the clean takes more than several minutes.

$ gmake gitlab-k8s-agent/build/gdk/bin/kas_race

--------------------------------------------------------------------------------
Installing gitlab-org/cluster-integration/gitlab-agent
--------------------------------------------------------------------------------
Starting local Bazel server (8.2.1) and connecting to it...
Computing main repo mapping: 
Loading: 
Loading: 0 packages loaded
Analyzing: target //cmd/kas:extract_kas_race (1 packages loaded)
Analyzing: target //cmd/kas:extract_kas_race (1 packages loaded, 0 targets configured)
Analyzing: target //cmd/kas:extract_kas_race (1 packages loaded, 0 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (99 packages loaded, 2693 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (99 packages loaded, 2693 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (99 packages loaded, 2693 targets configured)

DEBUG: /private/var/tmp/_bazel_zhouyuda/d9dad5ffb405fef3f7e1f0d3b5597246/external/gazelle+/internal/bzlmod/go_deps.bzl:607:40: 
Mismatch between versions requested for Go module cel.dev/expr:

  bazel_dep version (MODULE.bazel): 0.23.0 (as "cel-spec")
  Go module version (go.mod):       0.23.1
 
Either ensure that you have

  bazel_dep(module_name = "cel-spec", version = "0.23.1")

in your MODULE.bazel file or downgrade the Go module version via

  bazel run @rules_go//go -- get cel.dev/expr@v0.23.0

Analyzing: target //cmd/kas:extract_kas_race (212 packages loaded, 14313 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (212 packages loaded, 14313 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (220 packages loaded, 14368 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (221 packages loaded, 14453 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (221 packages loaded, 14453 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (281 packages loaded, 14839 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (390 packages loaded, 15511 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (613 packages loaded, 16898 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (722 packages loaded, 17707 targets configured)

Analyzing: target //cmd/kas:extract_kas_race (722 packages loaded, 17707 targets configured)

INFO: Analyzed target //cmd/kas:extract_kas_race (799 packages loaded, 17976 targets configured).
[10 / 664] Executing apple_genrule @@apple_support+//crosstool:exec_wrapped_clang.target_config [for tool]; 1s darwin-sandbox ... (7 actions running)
[14 / 664] Executing apple_genrule @@apple_support+//crosstool:exec_libtool.target_config [for tool]; 5s darwin-sandbox ... (3 actions running)
[16 / 664] GoToolchainBinaryBuild external/rules_go++go_sdk+main___download_0/builder [for tool]; 5s darwin-sandbox
[17 / 664] [Prepa] Creating symlink external/rules_go++go_sdk+main___download_0/builder_reset/builder [for tool] ... (3 actions, 0 running)
[20 / 664] GoStdlib external/rules_go+/stdlib_/pkg; 1s darwin-sandbox
[21 / 664] [Prepa] GoCompilePkg external/gazelle++go_deps+org_golang_x_time/rate/rate.a ... (4 actions, 0 running)
[69 / 664] GoCompilePkg external/gazelle++go_deps+com_github_gogo_protobuf/proto/proto.a; 0s darwin-sandbox ... (10 actions, 9 running)
[146 / 664] GoCompilePkg external/gazelle++go_deps+net_starlark_go/starlark/starlark.a; 0s darwin-sandbox ... (10 actions running)
[188 / 664] GoCompilePkg external/gazelle++go_deps+org_golang_x_net/http2/http2.a; 1s darwin-sandbox ... (10 actions, 9 running)
[238 / 664] GoCompilePkg external/gazelle++go_deps+com_github_redis_rueidis/internal/cmds/cmds.a; 2s darwin-sandbox ... (10 actions, 9 running)
[283 / 664] GoCompilePkg external/gazelle++go_deps+com_github_redis_rueidis/internal/cmds/cmds.a; 3s darwin-sandbox ... (10 actions, 9 running)
[332 / 664] GoCompilePkg external/gazelle++go_deps+com_github_redis_rueidis/internal/cmds/cmds.a; 4s darwin-sandbox ... (10 actions, 9 running)
[395 / 664] GoCompilePkg external/gazelle++go_deps+com_github_redis_rueidis/internal/cmds/cmds.a; 5s darwin-sandbox ... (8 actions, 7 running)
[430 / 664] GoCompilePkg external/gazelle++go_deps+com_github_redis_rueidis/internal/cmds/cmds.a; 6s darwin-sandbox ... (10 actions, 9 running)
[495 / 664] GoCompilePkg external/gazelle++go_deps+com_github_redis_rueidis/internal/cmds/cmds.a; 7s darwin-sandbox ... (10 actions, 9 running)
[525 / 664] GoCompilePkg external/gazelle++go_deps+com_github_redis_rueidis/internal/cmds/cmds.a; 8s darwin-sandbox ... (10 actions, 9 running)
[571 / 664] GoCompilePkg external/gazelle++go_deps+com_github_redis_rueidis/internal/cmds/cmds.a; 9s darwin-sandbox ... (10 actions, 9 running)
[602 / 664] GoCompilePkg external/gazelle++go_deps+com_github_redis_rueidis/internal/cmds/cmds.a; 10s darwin-sandbox ... (3 actions running)
[609 / 664] GoCompilePkg external/gazelle++go_deps+io_temporal_go_api/workflowservice/v1/workflowservice.a; 2s darwin-sandbox ... (2 actions running)
[633 / 664] GoCompilePkg external/gazelle++go_deps+io_temporal_go_sdk/internal/internal.a; 0s darwin-sandbox ... (10 actions running)
[651 / 664] GoCompilePkg external/gazelle++go_deps+io_temporal_go_sdk/internal/internal.a; 1s darwin-sandbox
[658 / 664] GoCompilePkg internal/module/autoflow/engine/engine.a; 0s darwin-sandbox ... (2 actions running)
[663 / 664] GoLink cmd/kas/kas_race_/kas_race; 0s darwin-sandbox
INFO: From GoLink cmd/kas/kas_race_/kas_race:
ld: warning: '/private/var/folders/j3/6s3szgbj1bvdh9nr2tk1kr600000gn/T/go-link-799482172/000013.o' has malformed LC_DYSYMTAB, expected 98 undefined symbols to start at index 1626, found 95 undefined symbols starting at index 1626
INFO: Found 1 target...
Target //cmd/kas:extract_kas_race up-to-date:
  /private/var/tmp/_bazel_zhouyuda/d9dad5ffb405fef3f7e1f0d3b5597246/execroot/_main/bazel-out/darwin_arm64-fastbuild/bin/cmd/kas/extract_kas_race_update.sh
INFO: Elapsed time: 58.403s, Critical Path: 31.47s
INFO: 664 processes: 11 internal, 653 darwin-sandbox.
INFO: Build completed successfully, 664 total actions
INFO: Running command line: /private/var/tmp/_bazel_zhouyuda/d9dad5ffb405fef3f7e1f0d3b5597246/execroot/_main/bazel-out/darwin_arm64-fastbuild/bin/cmd/kas/extract_kas_race_update.sh

and so does gdk update 🎉

$ gdk update
ℹ️  gdk update: before hook -> support/exec-cd gitlab bin/spring stop || true
Spring is not running

--------------------------------------------------------------------------------
Running self-update on GDK
--------------------------------------------------------------------------------
Already on 'main'
┌ ✔ Update your GDK
├── ✔ Install gems for GDK [208ms]
├── ✔ Platform update [16s]
├── ✔ Tool versions update [7s]
├── ✔ Preflight Update checks [3ms]
├── ✔ Update GitLab repository [13s]
├── ✔ Run `make gitlab/.git` [3s]
├── ✔ Run `make gitlab-config` [3s]
├── ✔ Run `make gitlab-asdf-install` [3s]
├── ✔ Run `make .gitlab-bundle` [4s]
├── ✔ Run `make .gitlab-lefthook` [1s]
├── ✔ Run `make .gitlab-yarn` [2s]
├── ✔ Run `make .gitlab-translations` [12s]
├── ✔ Run `make postgresql` [3s]
├── ✔ Preflight checks for dependencies [6s]
├── ✔ Run GitLab migrations [2m 4s]
├── ✔ Run `make gitaly-update` [12s]
├── ✔ Run `make gitlab-shell-update` [9s]
├── ✔ Run `make gitlab-pages-update` [16s]
├── ✔ Run `make gitlab-translations-unlock` [1s]
├── ✔ Run `make gitlab-topology-service-update` [14s]
├── ⠹ Download GraphQL schema
├── ✔ Run `make gitlab-k8s-agent-update` [5s]
├── ✔ Run `make gitlab-http-router-update` [16s]
├── ✔ Run `make gitlab-workhorse-update` [5s]
├── ✔ Run `make ensure-databases-setup` [4s]
└── ✔ Run `make unlock-dependency-installers` [2s]
┌ ✔ Reconfigure your GDK
├── ✔ Run `make postgresql` [7s]
├── ✔ Run `make openssh-setup` [4s]
├── ✔ Run `make gitlab-topology-service-setup` [21s]
├── ✔ Run `make gitlab-k8s-agent-setup` [11s]
├── ✔ Run `make gitlab-runner-setup` [3s]
├── ✔ Run `make gitlab-pages-setup` [27s]
├── ✔ Run `make nginx-setup` [5s]
├── ✔ Run `make runner-setup` [5s]
├── ✔ Run `make gitlab-http-router-setup` [13s]
└── ✔ Run `make gdk-reconfigure-task` [4s]
✅️ Successfully updated!

Here is a 🎥 of I reproducing the error by removing Xcode.app -> build fail -> reinstall Xcode.app -> clean bazel cache and build success gdk-issue-2606

Proposal (optional)

There was a recent change of switching from Homebrew installed Bazelisk to mise installed Bazel. From Bazel doc, the "Install Xcode command line tools" step is only part of the "Installing using the binary installer" option, but not part of the "Installing using Homebrew" option.

However, since the project is unlikely using any "ios_* rules", I'm not sure if having Xcode.app instead of Xcode Command Line Tools was the fix. Maybe my xcodebuild -version was missing for another issue? I tried checking DarwinSandboxedSpawnRunner.java and XcodeLocalEnvProvider.java but can't really tell.

Anyway, if it's true that Mac users now need Xcode.app instead of just Xcode Command Line Tools, we might want to mention that with the Bazel doc on doc/howto/kubernetes_agent.md, in addition to xcode-select install on doc/_index.md.

Environment (optional)

Operating system name: Darwin zhouyudas-MacBook-Pro.local 24.3.0 Darwin Kernel Version 24.3.0: Thu Jan 2 20:22:58 PST 2025; root:xnu-11215.81.4~3/RELEASE_ARM64_T8132 arm64
Architecture: arm64
Ruby version: ruby 3.3.7 (2025-01-15 revision be31f993d7) [arm64-darwin24] (via mise)
GDK version: 61b62367
The contents of your gdk.yml 👇

I have gitlab_kas_agent enabled and am using mise instead of asdf

---
asdf:
  opt_out: true
gitlab_k8s_agent:
  agent_listen_address: 172.16.123.1:8150
  enabled: true
  k8s_api_listen_address: 172.16.123.1:8154
gitlab_pages:
  enabled: true
  host: pages.gdk.test
  verbose: true
hostname: gdk.test
https:
  enabled: true
listen_address: 172.16.123.1
mise:
  enabled: true
nginx:
  enabled: true
  ssl:
    certificate: "/Users/zhouyuda/code/gitlab/gdk/gdk.test.pem"
    key: "/Users/zhouyuda/code/gitlab/gdk/gdk.test-key.pem"
port: 3443
runner:
  enabled: true
  executor: docker
  extra_hosts:
  - gdk.test:172.16.123.1
  - registry.test:172.16.123.1
  install_mode: docker
  token: glrt-YzoxCnQ6MQp1OjFihVD4qUE7Mpq6dnD53LZQEA.1210it39k
vite:
  enabled: true
webpack:
  enabled: false

Edited May 04, 2025 by Chou Yu Ta

gitlab-k8s-agent build fail with com.google.devtools.build.lib.rules.apple.DottedVersion$InvalidDottedVersionException on Mac with CLT instead of Xcode.app