Across a number of E2E tests in production we are intermittently seeing the following when a test fabricates a project runner: ``` Resource at https://gitlab.com/api/v4/runners/23017652?private_token=[MASKED] could not be found (403): `{"message":"403 Forbidden - No access granted"}`. ``` For example https://ops.gitlab.net/gitlab-org/quality/production/-/jobs/9906880 ``` Failure/Error: Resource::ProjectRunner.fabricate! do |runner| runner.project = project runner.name = runner_name runner.tags = [runner_name] runner.executor = :docker end QA::Resource::Errors::ResourceNotFoundError: Resource at https://gitlab.com/api/v4/runners/23017652?private_token=[MASKED] could not be found (403): `{"message":"403 Forbidden - No access granted"}`. ``` These are logged in Kibana but don't provide a lot of info eg. https://log.gprd.gitlab.net/app/discover#/?_a=%28index:%277092c4e2-4eb5-46f2-8305-a7da2edad090%27%2Cquery%3A%28language%3Akuery%2Cquery%3A%27json.correlation_id%20%3A%20c96bb1ed7ca804ed7edcc889e3603380%27%29%29&_g=%28time%3A%28from%3A%272023-04-27T12:00:36.056Z%27%2Cto%3A%272023-04-28T12:00:36.056Z%27%29%29 Related failures Substantial troubleshooting done in https://gitlab.com/gitlab-org/gitlab/-/issues/403174 https://gitlab.com/gitlab-org/gitlab/-/issues/409072 https://gitlab.com/gitlab-org/gitlab/-/issues/408953 https://gitlab.com/gitlab-org/gitlab/-/issues/408948 https://gitlab.com/gitlab-org/gitlab/-/issues/408947 https://gitlab.com/gitlab-org/gitlab/-/issues/408806 https://gitlab.com/gitlab-org/gitlab/-/issues/408781 https://gitlab.com/gitlab-org/gitlab/-/issues/408779 https://gitlab.com/gitlab-org/gitlab/-/issues/408734 https://gitlab.com/gitlab-org/gitlab/-/issues/408714 https://gitlab.com/gitlab-org/gitlab/-/issues/408713 https://gitlab.com/gitlab-org/gitlab/-/issues/408710 https://gitlab.com/gitlab-org/gitlab/-/issues/408709 https://gitlab.com/gitlab-org/gitlab/-/issues/408645 https://gitlab.com/gitlab-org/gitlab/-/issues/408638 https://gitlab.com/gitlab-org/gitlab/-/issues/408513 https://gitlab.com/gitlab-org/gitlab/-/issues/408512 https://gitlab.com/gitlab-org/gitlab/-/issues/408511 https://gitlab.com/gitlab-org/gitlab/-/issues/408510 https://gitlab.com/gitlab-org/gitlab/-/issues/408509 https://gitlab.com/gitlab-org/gitlab/-/issues/408498 https://gitlab.com/gitlab-org/gitlab/-/issues/408393 https://gitlab.com/gitlab-org/gitlab/-/issues/408331 https://gitlab.com/gitlab-org/gitlab/-/issues/408330 https://gitlab.com/gitlab-org/gitlab/-/issues/408319 https://gitlab.com/gitlab-org/gitlab/-/issues/408293 https://gitlab.com/gitlab-org/gitlab/-/issues/408291 https://gitlab.com/gitlab-org/gitlab/-/issues/408290 https://gitlab.com/gitlab-org/gitlab/-/issues/408287 https://gitlab.com/gitlab-org/gitlab/-/issues/408271 https://gitlab.com/gitlab-org/gitlab/-/issues/408270 https://gitlab.com/gitlab-org/gitlab/-/issues/408269 https://gitlab.com/gitlab-org/gitlab/-/issues/408240 https://gitlab.com/gitlab-org/gitlab/-/issues/408050 https://gitlab.com/gitlab-org/gitlab/-/issues/408049 https://gitlab.com/gitlab-org/gitlab/-/issues/408048 https://gitlab.com/gitlab-org/gitlab/-/issues/408047 among others...