Se we have an old google box running Google Mini 4.4.102.M.36. We wanted to use it to index a massive file share with documents. As a proof of concept I made an IIS entry that points to a folder with bunch of files and allowed directory browsing on it. Now the problem is that crawler seem to return Excluded: In "Do Not Crawl" URLs. for every file in the folder, even though most of them do not match any of the exclusion patterns. I even went as far as removing everything from the "Do Not Crawl URLs" box and I am still getting the same problem.

link|improve this question
feedback

Know someone who can answer? Share a link to this question via email, Google+, Twitter, or Facebook.

Your Answer

 
or
required, but never shown

Browse other questions tagged or ask your own question.