There are 3000 entries inside sitemap.xml,but it turns out that Google just crawls 300 of them,what's the problem?

migrated from stackoverflow.com Oct 16 '09 at 11:12

This question came from our site for professional and enthusiast programmers.

  • because 3000 is a WOW amount. – Mauris Oct 16 '09 at 6:47
  • I don't think it's in the number of entries. According to this Wikipedia article you can point to 5000 * 1000 entries. en.wikipedia.org/wiki/Sitemaps#Sitemap_limits – Luke Oct 16 '09 at 6:52

I'd suggest taking a look into Google Webmaster Tools. There you see the number of submitted URLs and the number of indexed URLs. If URLs get indexed depends on links back to the page, so they might not get indexed even if they're crawled (note the difference). Furthermore, Webmaster Tools tells you if any crawling errors ocurred, which might be the case if only some of your URLs get crawled.


It can takes weeks for Google to fully index a site. The quality and perceived importance if the page (incoming links) is a contributing factor.

  1. Is Google just crawling the first 300, or some other set?

  2. How long have your waited for the crawl? I've seen Google wait a long time (>2 wk) before getting around to crawling everything on a sitemap.

  • This should have been a comment. – Shoban Oct 16 '09 at 7:26

Your Answer

By clicking "Post Your Answer", you agree to our terms of service, privacy policy and cookie policy