Sporadic S3 Connectivity Issues Breaks CI / Builds

We continue to observe random broken jobs and other issues from S3 connectivity failing.

Opening an issue to determine how to track and ameliorate.

Recent examples:

• https://dev.gitlab.org/gitlab/omnibus-gitlab/pipelines/108988
• https://dev.gitlab.org/gitlab/omnibus-gitlab/-/jobs/4228970