Server Fault is a question and answer site for system and network administrators. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

We got Nginx webserver. And sitemaps that we generate every week or so ...

We migrated to multiple web-servers under single load-balancer lately, and keeping a sitemaps on every webserver seem kinda silly. As we are on AWS, is there a way to store sitemaps on, lets say, S3 and somehow redirect sitemaps to S3 link ? But to keep the full domain name with 'www'. I do not see the way to doing it with domain names, maybe with some NGINX rule ?

I did not find many resources on this. How do you solve this ?

share|improve this question

Yes, you just need to "prove" ownership of the domain by editing your robots.txt. You add the following to your robots.txt:


You can use any URL you want in the robots.txt file, it doesn't need to be the same URL as the site itself. This is documented in the Sitemaps & Cross Submits section on the protocol documentation

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.