Using Crawler to find Broken Links RRS feed

  • Question

  • Hi Guys,

    I've noticed that when using FAST Enterprise Crawler (crawleradmin), it stores http responses while crawling.

    You can see it when running crawleradmin -c

    At the end, you'll see "Protocol Response Codes:".

    I'm interested in finding the links that got http 404 not found - Which documents were not found, and which page pointed to it.

    I've read the crawleradmin and doclog reference and didn't seem to see/understand how to do so.


    Any ideas?




    Sunday, September 18, 2011 9:17 AM


All replies