metadata file name too long error - no jobs able to start since this morning
Running EC2 fargate executor and ECS tasks. The following error is now consistently being logged and all jobs failing:
INFO[2024-12-04T13:42:12Z] Persisting data that will be used by other commands PID=27993 command=prepare_exec taskARN="arn:aws:ecs:eu-west-2:xxxxxxxxxx:task/gitlab-cluster/xxxxxxxxxxxxxxxxxx" ERRO[2024-12-04T13:42:12Z] Error when persisting the task ARN. Will stop the task for cleanup PID=27993 command=prepare_exec error="persisting metadata: writing file "/opt/gitlab-runner/metadata/[MASKED]-xxxxxxxxxxxxxx.json": open /opt/gitlab-runner/metadata/[MASKED]-xxxxxxxxxxxxx.json: file name too long" taskARN="arn:aws:ecs:eu-west-2:xxxxxxxxxx:task/gitlab-cluster/xxxxxxxxxxxxxxxxxx"
This started around 2 hours ago and has been consistent. Our best guess is the gitlab CI job token has significantly increased in length, causing the total length of the file to exceed the linux 255 character maximum.
This is currently rendering the fargate executor unusable.