0

Google webmaster FAQs suggest that this will exclude all xml files from search:

User-agent: Googlebot
Disallow: /*.xml$

Is this legal for other bots as well?

User-agent: *
Disallow: /*.xml$

1 Answer 1

1

Yes, this is valid. Whether other bots actually understand and obey is completely up to them, though!

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .