Skip to content

Allow URL Scan users to define their URLs in a file

Craig Smithrequested to merge
add_dast_paths_file_258825 into master

What does this MR do?

DAST users that wish to specify the URLs scanned by DAST currently must do so using the DAST_PATHS environment variable. Using an environment variable has the drawback that it is limited to approximately 130kb of paths.

This MR aims to surpass that limit by allowing users to add a list of URLs using a file.

To use this feature users must create a plain text file with one path per line. For example:

page1.html
/page2.html
category/shoes/page1.html

To scan the URLs in that file DAST_PATHS_FILE should be used

include:
  - template: DAST.gitlab-ci.yml

variables:
  DAST_PATHS_FILE: relative/path/to/file.txt

By default, DAST scans do not clone the project repository. If the file is checked in to the project it can be made available by setting GIT_STRATEGY to fetch.

include:
  - template: DAST.gitlab-ci.yml

variables:
  GIT_STRATEGY: fetch
  DAST_PATHS_FILE: relative/path/to/file.txt

This MR is documented in gitlab-org/gitlab!45114 (merged)

This MR relates to gitlab-org/gitlab#258825 (closed)

What are the relevant issue numbers?

Does this MR meet the acceptance criteria?

Edited by Craig Smith

Merge request reports