Skip to content

Add the /help page in robots.txt

Achilleas Pipinellis requested to merge robots-help into master

What does this MR do?

Exclude the /help page from being crawled. This change is two-fold:

  • Do not let search engines index the help page of every GitLab installation out there. Searching for gitlab help now yields many results from the help page of random instances.
  • The /help page mostly has links to internal docs, and we prefer to link to the external docs website instead.

What are the relevant issue numbers?

Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/44433

Edited by Achilleas Pipinellis

Merge request reports