none
Crawling Facebook and Twitter RRS feed

  • Question

  • Hello all,

    I've been given the task to crawl specific Facebook and Twitter pages with FAST for SharePoint Server 2010. So, I added a couple of content sources: 

    Facebook:

    http://apps.facebook.com/kuo_dashboard/?fb_source=search&ref=ts
    http://www.facebook.com

    and Twitter:

    http://twitter.com
    https://twitter.com/#!/search/kuo

    Start the full crawl and I get no errors whatsoever, yet the log maks 0 successes (and 0 errors and 0 warnings). 

    Does anybody know whether I have to do something very specific for these two content sources? All other sources to other websites (like NYT, WashingtonPost, etc.) work perfectly well...

    Any help will be really appreciated. Besst regards!



    Fernando A. Gómez F.
    fermasmas.wordpress.com
    Galería de ejemplos

    Wednesday, July 4, 2012 11:25 PM

Answers

  • I've given up with this. My best answer as to why FAST won't crawl anything is that both Facebook and Twitter content are generated dynamically using JavaScript. I ended up creating a pipeline that would perform searches using Facebook/Twitter API. 

    ¡Best regards!



    Fernando A. Gómez F.
    fermasmas.wordpress.com
    Galería de ejemplos

    Monday, August 27, 2012 10:08 PM

All replies