Commit 71f707bf authored by Achilleas Pipinellis's avatar Achilleas Pipinellis

Add the /help page in robots.txt

The /help page has docs which we don't want to be crawled
as we prefer the docs website instead.

Related https://gitlab.com/gitlab-org/gitlab-ce/issues/44433
parent 5790caa7
...@@ -20,6 +20,7 @@ Disallow: /projects/new ...@@ -20,6 +20,7 @@ Disallow: /projects/new
Disallow: /groups/new Disallow: /groups/new
Disallow: /groups/*/edit Disallow: /groups/*/edit
Disallow: /users Disallow: /users
Disallow: /help
# Global snippets # Global snippets
User-Agent: * User-Agent: *
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment