Commit 71f707bf authored by Achilleas Pipinellis's avatar Achilleas Pipinellis 🚀

Add the /help page in robots.txt

The /help page has docs which we don't want to be crawled
as we prefer the docs website instead.

Related https://gitlab.com/gitlab-org/gitlab-ce/issues/44433
parent 5790caa7
Pipeline #19308939 passed with stages
in 28 minutes and 37 seconds
......@@ -20,6 +20,7 @@ Disallow: /projects/new
Disallow: /groups/new
Disallow: /groups/*/edit
Disallow: /users
Disallow: /help
# Global snippets
User-Agent: *
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment