Make kubernetes API retries configurable

What does this MR do?

It allows to specify limit for Kubernetes API calls instead of hardcoded limit in const

Why was this MR needed?

We run our jobs in EKS Kuberentes and use Karpenter for scaling nodes.

When using default limit, our jobs often fail with prepare environment: setting up trapping scripts on emptyDir: error dialing backend: remote error: tls: internal error

When we bumped defaultTries to 35, issue disappeared. Therefore we made this limit configurable defaulting to old limit, not to enforce higher limit for everyone.

We're running this code on on production since 6.12.2023 and successfully processed more than 6000 jobs since then.

What's the best way to test this MR?

What are the relevant issue numbers?

.gitlab/ci/_common.gitlab-ci.yml

 variables:
-  # renovate: datasource=docker depName=golang allowedVersions=/1\.20\..+/
-  GO_VERSION: "1.20.10"
+  # renovate: datasource=docker depName=golang allowedVersions=/1\.21\..+/
+  GO_VERSION: "1.21.5"
   # Sometimes the FIPS repo lags behind the official releases
-  GO_FIPS_VERSION: "1.20.10"
-  CI_IMAGE: "registry.gitlab.com/gitlab-org/gitlab-runner/ci:$GO_VERSION-bullseye-1"
+  GO_FIPS_VERSION: "1.21.5"
+  GO_CI_IMAGE: "$GO_VERSION-bookworm"
+  CI_IMAGE: "registry.gitlab.com/gitlab-org/gitlab-runner/ci:$GO_CI_IMAGE-1"
   # Feature flags
   FF_SCRIPT_SECTIONS: "true"
   FF_USE_FASTZIP: "true"
@@ -30,14 +31,14 @@ variables:
   GO_FIPS_IMAGE: registry.gitlab.com/gitlab-org/gitlab-runner/go-fips:$GO_FIPS_VERSION
   # Leaving the Alpine and UBI versions defined here until the renovate pattern is changed
   # to recognize the definitions as a Go variable
-  # renovate: datasource=docker depName=alpine allowedVersions=/3\.15\..+/
-  ALPINE_315_VERSION: "3.15.8"
   # renovate: datasource=docker depName=alpine allowedVersions=/3\.16\..+/
-  ALPINE_316_VERSION: "3.16.5"
+  ALPINE_316_VERSION: "3.16.8"
   # renovate: datasource=docker depName=alpine allowedVersions=/3\.17\..+/
-  ALPINE_317_VERSION: "3.17.3"
+  ALPINE_317_VERSION: "3.17.6"
   # renovate: datasource=docker depName=alpine allowedVersions=/3\.18\..+/
-  ALPINE_318_VERSION: "3.18.2"
+  ALPINE_318_VERSION: "3.18.5"
+  # renovate: datasource=docker depName=alpine allowedVersions=/3\.19\..+/
+  ALPINE_319_VERSION: "3.19.0"
   # renovate: datasource=docker depName=ubuntu allowedVersions=/20\..+/
   UBUNTU_VERSION: "20.04"
   # renovate: datasource=docker depName=redhat/ubi8-minimal versioning=redhat allowedVersions=/8\.8-.+/