Disallow profile route in Robots.txt
Attending to the urls some crawlers try to index, the route /-/profile
pops up. Obviously, for a non-authenticated user, this triggers a 302. We can just disallow the route in robots.txt
.
Attending to the urls some crawlers try to index, the route /-/profile
pops up. Obviously, for a non-authenticated user, this triggers a 302. We can just disallow the route in robots.txt
.