none
How does SharePoint Incremental crawl works RRS feed

  • Question

  • Hi All,

    I am investigating a lot on how the incremental crawl works using FAST SharePoint 2010 connector.

    I know that it uses Change Log.

    But when it comes to Deletes, how does it work

    As i have observed, Change Log has only Top level delete event ie., If a List containing List Items has been deleted,

    Change Log has only SPChangeList event.

    How does FAST incremental crawl deletes all its children as there will be only dead reference to the List.

    Can someone please help me in understanding on how does this work?

     

    Thanks

    Carol

    Wednesday, October 27, 2010 6:33 PM

Answers

  • Without looking at the code, but using my own experience when I created a SharePoint crawler a few years back, I can assume they are doing it the same way.

    When doing a full crawl you build a database of all items indexed, and when you get a delete event for a list on the url http://host/site/Mylist, then you can delete all items starting with that base url. Basically send a delete to the search index on all items in the crawler database which matches http://host/site/Mylist*

    The same logic can be used when deleting a whole site as well.

    Regards,


    Search Enthusiast - MCTS SharePoint/WCF4/ASP.Net4
    http://techmikael.blogspot.com/ - http://www.comperiosearch.com/
    • Marked as answer by Carol K S Wednesday, October 27, 2010 8:07 PM
    Wednesday, October 27, 2010 7:02 PM

All replies

  • Without looking at the code, but using my own experience when I created a SharePoint crawler a few years back, I can assume they are doing it the same way.

    When doing a full crawl you build a database of all items indexed, and when you get a delete event for a list on the url http://host/site/Mylist, then you can delete all items starting with that base url. Basically send a delete to the search index on all items in the crawler database which matches http://host/site/Mylist*

    The same logic can be used when deleting a whole site as well.

    Regards,


    Search Enthusiast - MCTS SharePoint/WCF4/ASP.Net4
    http://techmikael.blogspot.com/ - http://www.comperiosearch.com/
    • Marked as answer by Carol K S Wednesday, October 27, 2010 8:07 PM
    Wednesday, October 27, 2010 7:02 PM
  • Thanks a bunch Mikael

    This is very helpful

     

    -Carol

    Wednesday, October 27, 2010 8:08 PM