Commit abf18abb authored by Ben Bodenmiller's avatar Ben Bodenmiller

allow crawling of commit page but not patch/diffs

Commit page has valuable information that search engines should be allowed to crawl however the .patch and .diff pages have no new information that is not on commit page
parent 0de7c83a
...@@ -38,7 +38,8 @@ Disallow: /*/*/edit ...@@ -38,7 +38,8 @@ Disallow: /*/*/edit
Disallow: /*/*/raw Disallow: /*/*/raw
Disallow: /*/*/blame Disallow: /*/*/blame
Disallow: /*/*/commits/*/* Disallow: /*/*/commits/*/*
Disallow: /*/*/commit Disallow: /*/*/commit/*.patch
Disallow: /*/*/commit/*.diff
Disallow: /*/*/compare Disallow: /*/*/compare
Disallow: /*/*/branches/new Disallow: /*/*/branches/new
Disallow: /*/*/tags/new Disallow: /*/*/tags/new
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment