none
Custom pipeline not working RRS feed

  • Question

  • Hi,

    I tried to run the example custom pipeline provided by Thomas Svenson @ http://blogs.msdn.com/b/thomsven/archive/2010/09/23/debugging-and-tracing-fast-search-pipeline-extensibility-stages.aspx

    The pipelineextensibility.xml is as provided by the example.  I ran psctrl reset and recrawled a Sharepoint site but i don't see any outputs in the user home directory...\LocalLow.  The question is how can I tell if the pipeline was executed?  Is there a log item somewhere?  Thanks.. Kalvin

     

    <PipelineExtensibility>
      <Run command="HasContentTypeCheck.exe %(input)s %(output)s">
        <Input>
          <CrawledProperty propertySet="00130329-0000-0130-c000-000000131346" varType="31" propertyName="ows_ContentType"/>

          <!-- Included for debugging/traceability purposes -->
          <CrawledProperty propertySet="11280615-f653-448f-8ed8-2915008789f2" varType="31" propertyName="url"/>
        </Input>
        <Output>
          <CrawledProperty propertySet="d5cdd505-2e9c-101b-9397-08002b2cf9ae" varType="31" propertyName="mycontentcheck"/>
        </Output>
      </Run>
    </PipelineExtensibility>

    Kalvin
    Friday, October 21, 2011 4:17 PM

Answers

  • Hi Kalvin,

    First off you check your crawl log on the Content SSA. If there are no errors, then your code ran successfully (if you remembered to execute "psctrl reset" after changing the config to reload the configuration files).

    Second check the crawled properties category for your output guid, and see if you can locate "mycontentcheck", below it.

     

    Next there are other tricks around debugging:

    You can add a "spy" stage to your pipeline as per - http://techmikael.blogspot.com/2011/01/how-to-spy-raw-data-and-available.html.

    If you have Visual Studio on the same machine as you test, then you can attach your debugger as per http://techmikael.blogspot.com/2010/12/how-to-debug-and-log-fast-search.html.

    You can execute "doclog -a" to get the output from all stages during index.. particularly any errors. If you issue "psctrl doctrace on" and "psctrl debug on" before indexing you get an even more verbose output.

    Regards,
    Mikael Svenson 


    Search Enthusiast - SharePoint MVP/WCF4/ASP.Net4
    http://techmikael.blogspot.com/
    Friday, October 21, 2011 8:30 PM

All replies

  • Hi Kalvin,

    First off you check your crawl log on the Content SSA. If there are no errors, then your code ran successfully (if you remembered to execute "psctrl reset" after changing the config to reload the configuration files).

    Second check the crawled properties category for your output guid, and see if you can locate "mycontentcheck", below it.

     

    Next there are other tricks around debugging:

    You can add a "spy" stage to your pipeline as per - http://techmikael.blogspot.com/2011/01/how-to-spy-raw-data-and-available.html.

    If you have Visual Studio on the same machine as you test, then you can attach your debugger as per http://techmikael.blogspot.com/2010/12/how-to-debug-and-log-fast-search.html.

    You can execute "doclog -a" to get the output from all stages during index.. particularly any errors. If you issue "psctrl doctrace on" and "psctrl debug on" before indexing you get an even more verbose output.

    Regards,
    Mikael Svenson 


    Search Enthusiast - SharePoint MVP/WCF4/ASP.Net4
    http://techmikael.blogspot.com/
    Friday, October 21, 2011 8:30 PM
  • Thanks Mikael.  I checked the crawl log and I got this

    The FAST Search backend reported warnings when processing the item. ( Customer-supplied command failed: Process terminated abnormally: Unknown error (0x80131700) )

    I will see what the problem is.

     

    Kalvin


    Kalvin
    Friday, October 21, 2011 8:57 PM
  • Hi Kalvin,

    You should construct a test input file and run it with your module at command line or in Visual Studio, to see that you are reading the data correctly, and also handling items which don't have the data you expect.

    Regards,
    Mikael Svenson 


    Search Enthusiast - SharePoint MVP/WCF4/ASP.Net4
    http://techmikael.blogspot.com/
    Tuesday, October 25, 2011 4:37 PM
  • Mikael,

    All is good now.  Thanks for the help.

     


    Kalvin
    Tuesday, October 25, 2011 4:39 PM