We have a W2K8R2 Server with installed Search Server Express 2010 which crawls data on a external Sharepoint Server without problems. We are also able to crawl data on a external dokuwiki, as long as the data there is available to all users. The problem is, that we are not able to crawl data, which requires authentication on the wiki server: Search Server just cannot login there! I have tried (via crawl rules) different accounts with the appropriate rights with no success. To "specify form credentials" dont work at all: the message I receive is "The remote server returned an error: (503) Server Unavailable". When I try to crawl all wiki pages, everything works great, except that the part which requires authentication, wont be crawled ...
Anyone has an idea where the problem is? Or this anyone who was able to use the "form credentials" of an external server within a crawl rule?