Introduce Pages only crawling to CMBR
Based on analysis in gitlab-org/gitlab#351229 (comment 930320297), we need to introduce Pages-specific load.
Based on GitLab Pages default domain names, pages sites on Staging should look like <group_name>.staging.gitlab.io/<project_name>
, but this will only work for projects which have pages. So first we need to prepare a list of pages url and then configure crawler to walk through them.
Steps
-
Add more test pages by creating projects in https://staging.gitlab.com/groups/pages_test/ -
Target crawler against https://pages_test.staging.gitlab.io/
-
Add Pages load job similar to generate_load_api
orgenerate_load_web
, (target RPS = 200 based on this analysis) -
Add a follow up to documentation about crawler that to be able to run against Pages first test data should be created
Edited by Nailia Iskhakova