Google crawlers appear to be visiting my site but it is not getting indexed, what am I doing wrong?
Yahoo has managed to find the mydomain.appspot.com and has indexed successfully (albeit on the apspot address and not my domain) so I assume that my HTML is OK.
1) I have set up CNAME records so that www.mydomain.co.uk points to mydomain.appspot.com. When I look at "fetch page as google bot" using web tools the HTML page is being displayed. The crawl stats show activity over the last couple of days.
2) I have web forwarded my mydomain.co.uk to www.mydomain.co.uk, this works a treat apart from when i go to "fetch page as googlebot" i get just the following rather than the HTML page
HTTP/1.1 302 Found Date: Tue, 29 Jun 2010 21:20:02 GMT Server: Microsoft-IIS/6.0 X-Powered-By: ASP.NET X-AspNet-Version: 2.0.50727 Location: http://www.mydomain.co.uk Cache-Control: private Content-Length: 0
Any suggestions appreciated,