Take the 2-minute tour ×
Server Fault is a question and answer site for system and network administrators. It's 100% free, no registration required.

We got Nginx webserver. And sitemaps that we generate every week or so ...

We migrated to multiple web-servers under single load-balancer lately, and keeping a sitemaps on every webserver seem kinda silly. As we are on AWS, is there a way to store sitemaps on, lets say, S3 and somehow redirect sitemaps to S3 link ? But to keep the full domain name with 'www'. I do not see the way to doing it with domain names, maybe with some NGINX rule ?

I did not find many resources on this. How do you solve this ?

share|improve this question

1 Answer 1

Yes, you just need to "prove" ownership of the domain by editing your robots.txt. You add the following to your robots.txt:

Sitemap: http://s3hostname.domain.com/sitemap.xml

You can use any URL you want in the robots.txt file, it doesn't need to be the same URL as the site itself. This is documented in the Sitemaps & Cross Submits section on the sitemaps.org protocol documentation

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.