Commit 034a81f3 authored by Miguel Rincon's avatar Miguel Rincon

Merge branch 'allow-robots-api' into 'master'

Allow crawler access to api

See merge request gitlab-org/gitlab!39520
parents b07a1923 dcb0e1de
---
title: Allow crawler access to api
merge_request: 39520
author:
type: fixed
......@@ -15,7 +15,6 @@
User-Agent: *
Disallow: /autocomplete/users
Disallow: /search
Disallow: /api
Disallow: /admin
Disallow: /profile
Disallow: /dashboard
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment