none
FAST ESP Error message in logs with SP crawler RRS feed

  • Question

  • Hi,

        We have a Fast Esp 5.3 set up and we are using FAST SharePoint Connector to crawl the WebAPP (http://mysite.###.###.com). While crawling this webApp we are getting below error message logged in our SP logs.

    Failed to download content from http://mysite.###.###.com/MySite/Person.aspx?guid=$$$$$$$.  This document will be added to the failed contents and will be retried later. Details: The remote server returned an error: (404) Not Found.  

    With further investigation I found out that we don't have any sitecollection present as MySite. So I have implemented a exclude rule as below.

    <parameter name="ExcludeWebUrls" type="string" separator=";">
          <description><![CDATA[Semicolon (;) separated list of regular expressions that will exclude sites (in the form of URLs) from being crawled.<br>
            For example: http://www.contoso.com/news/.* <br>
            As the connector traverses SharePoint, it will match the URL of each site against each of these filters and,
            if there is a hit, the site (and all its sub-sites) will NOT be crawled.]]></description>
          <value>
      http://mysite.###.###.com/MySite/.*
     
       </value>
        </parameter>

    But with a Full crawl I am able to see the error message again. Please help.

    With Regards,

    Santanu 


    Santanu Mishra

                   I have not able to find a resolution yet. Please suggest the work around. My doubt is when I am blocking MySite, how crawler crawls it again.
    • Edited by Mishra112 Friday, December 27, 2013 11:57 AM
    Friday, December 6, 2013 2:29 PM