Paginate through all Staging projects for Git traffic
Noticed in https://staging.gitlab.com/gitlab-com/gl-infra/cmbr-staging-load-generator/-/jobs/43181827, that it seems like crawler doesn't run as much requests as it would be expected. From local testing it seems that it's due to the fact that it starts from https://staging.gitlab.com/api/v4/projects
which has 20 projects by default on the first page.
We need to guide crawler through all API pages for projects.
Related to #4 (closed)