[CI] `pull_charts` job fails periodically when building from source

Summary

Context: #1073 (closed)

Workaround from !580 (merged) doesn't seem to work consistently:

• Job failed on .com: https://gitlab.com/gitlab-org/cloud-native/gitlab-operator/-/jobs/3815233582
• Same job passed on dev: https://dev.gitlab.org/gitlab/cloud-native/gitlab-operator/-/jobs/15245539

Acceptance criteria

• Root cause for problem is found
• Problem is addressed