0

I would like to create a publicly accessible Google Apps site (i.e. users do not need to be authenticated to access the content) while maintaining a policy crawlers and bots exclusion with Robots.txt. Does anyone know how to do that?

3
  • 1
    I don't specifically know much about Google Apps - is it stopping you from simply serving out a robots.txt "as usual"?
    – Jakob Borg
    Jan 18, 2010 at 21:32
  • what are you trying to achieve as you cant make your apps site publicly accessible.
    – seanl
    Jan 19, 2010 at 11:55
  • seanl, it's very possible to make a google site publicly accessible, see sites.google.com/a/lokad.com/translate Jan 20, 2010 at 17:08

1 Answer 1

1

robots.txt doesn't prevent interactive browsers from using the site. It is only used by robots like crawlers, feedreaders, recursive download tools (though the latter will let the user override it).

2
  • Absolutely, but it does not matter in my case. I just want the results not to show up in Google. Jan 20, 2010 at 11:49
  • Yeah, but now it's obvious you can just write a two-line robots.txt that excludes everyone everywhere (/ and *).
    – Tobu
    Jan 20, 2010 at 22:17

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .