Update dir_path and use WebPageReplay in SiteSpeed
Closes performance#301 (closed) Relates performance#305 (closed) gitlab-org/gitlab#222685 (closed)
With SiteSpeed getting consistent frontend results is actually quite a challenge due to all of the possible areas of variance one can get when loading a web page from a server. The team have gone into some detail here in their latest guidance around this.
One of the recommendations is to use WebPageReplay, which records the web page's load once from the server and then tests it multiple time locally. This improves the stability of the results you can get and focuses on the frontend times.
MR switches the pipeline to use this with the config changes it requires to run as well as some others for reduced artifact size. In addition to this:
-
BackendTime
is now moot as it's the same for all pages so this has been removed. - Cyclomatic complexity has also be reduced
generate_test_results
- Path for
web_project_files
has been changed for performance#305 (closed) -
ENVIRONMENT_SKIP_WARMUP
has been added for CI for environments to skip warmup (Staging)
Edited by Grant Young