The source project of this merge request has been removed.
Update robots.txt (#51167)
What does this MR do?
This adds Allow: /users/sign_in to the default robots.txt file to avoid showing up in search engine results but having no crawlable content for the homepage, which leads to:
Google Search shows "No Information is available for this page." due to default robots.txt disallowing /users and the instant redirection from / to /users/sign_in.
What are the relevant issue numbers?
Does this MR meet the acceptance criteria?
-
Changelog entry added, if necessary -
Documentation created/updated -
Tests added for this feature/bug -
Conforms to the code review guidelines -
Conforms to the merge request performance guidelines -
Conforms to the style guides -
Conforms to the database guides