This supports gitlab-qa!191 (merged).
Related to https://gitlab.com/gitlab-org/gitlab-ce/issues/47818 and https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/22521.