Se we have an old google box running Google Mini 4.4.102.M.36. We wanted to use it to index a massive file share with documents. As a proof of concept I made an IIS entry that points to a folder with bunch of files and allowed directory browsing on it.
Now the problem is that crawler seem to return Excluded: In "Do Not Crawl" URLs. for every file in the folder, even though most of them do not match any of the exclusion patterns. I even went as far as removing everything from the "Do Not Crawl URLs" box and I am still getting the same problem.
|
| |||
|
feedback
|