0

There are 3000 entries inside sitemap.xml,but it turns out that Google just crawls 300 of them,what's the problem?

2
  • because 3000 is a WOW amount.
    – Mauris
    Oct 16, 2009 at 6:47
  • I don't think it's in the number of entries. According to this Wikipedia article you can point to 5000 * 1000 entries. en.wikipedia.org/wiki/Sitemaps#Sitemap_limits
    – Luke
    Oct 16, 2009 at 6:52

3 Answers 3

2

I'd suggest taking a look into Google Webmaster Tools. There you see the number of submitted URLs and the number of indexed URLs. If URLs get indexed depends on links back to the page, so they might not get indexed even if they're crawled (note the difference). Furthermore, Webmaster Tools tells you if any crawling errors ocurred, which might be the case if only some of your URLs get crawled.

1
  • +1. Additionally, Webmaster Tools will parse sitemap.xml for you, and show you if there are errors. google.com/webmasters
    – user2874
    Oct 16, 2009 at 12:27
1

It can takes weeks for Google to fully index a site. The quality and perceived importance if the page (incoming links) is a contributing factor.

0
  1. Is Google just crawling the first 300, or some other set?

  2. How long have your waited for the crawl? I've seen Google wait a long time (>2 wk) before getting around to crawling everything on a sitemap.

1
  • This should have been a comment.
    – Shoban
    Oct 16, 2009 at 7:26

You must log in to answer this question.