“Go away! We don't want you!”

I'm having to do some work on SugarCRM [1], and I just now noticed that the default installation has a robots.txt [2] file:

>
```
User-agent: *
Disallow: /
```

As written, this will prevent the site from being indexed by the various search engines. I wonder how many people using SugarCRM are aware of this? Or even care? I couldn't find anything about it mentioned in the documentation, but I just did a cursory search.

[1] http://www.sugarcrm.com/crm/

[2] http://www.robotstxt.org/wc/exclusion.html

Gemini Mention this post

Contact the author