locked
FAST ESP: logtransformer error RRS feed

  • Question

  • Hi,

    Following error log has started coming very frequently(400-500 times a day) in production environment:

    [2011-08-07 23:32:19] ERROR logtransformer <node> 38010 systemmsg Unable to persist the log entry to the datastore: 10.172.92.43 - - [07/Aug/2011:23:21:30 -0400] "GET /cgi-bin/view/flp/company?hits=3&sortby=%2Blntopcompanysort+%2Blntickersort+%2Blnhooversnosort+%2Blnheadquarterasc+%2Blncodosscompanynameasc+%2Blnenid&query=lnticker%3Astring%28%22GOOG%22%29+and+lncodossiencddisp%3A1&encoding=utf-8&language=en&offset=0&version=5.1.1.30 HTTP/1.1" 200 15540 "" "ESP Search API Java, v 5.1.1.30" 0.0436 0.0014 0.0410 1 [(webcluster: VIEW(company) QUERY(FQL, 178, <and><in><scope text="lnticker"/><string text="GOOG"><token text="goog"/></string></in><in><scope text="lncodossiencddisp"/><string text="1"><token text="1"/></string></in></and>) MANAGED(0, 0) STATS(0.0014, 0.0410, 1))] Caused by: java.io.IOException: Failed to open column segment file writer for /<node>/FastESP/components/logtransformer/data/datastore/querylog/crate0/identity.csf  .

    And

    [2011-08-06 17:05:01]   ERROR   logtransformer   <node>   38010   systemmsg   The lql job had problems running

     

    Not much of the information is avilable in Fast documentations. I could only get a hint that it had something to do with logging machanism in Fast as logtransformer is giving error.

     

    Unable to get the exact reason for this error. Please help me in getting to the root of this problem... 

    Thanks


    • Edited by Nitin D Monday, August 8, 2011 8:56 AM info added
    Monday, August 8, 2011 8:54 AM

Answers

  • Hi Nitin,

    This issue could be due to a corrupted datasources file. I would recommend that you try the following steps:

    1) Backup the file datasources.xml from %fastsearch/components/logtransformer/data/datastore.
    2) Stop the logtransformer process:
          nctrl stop logtransformer
    3) Delete the datasources.xml file from the above location (make sure you took a backup)
    4) Start the logtransformer process
          nctrl start logtransformer

    Let us know your results.

     

    Thanks!

    Rob Vazzana | Sr Support Escalation Engineer | Customer Service & Support

    http://support.microsoft.com

    • Proposed as answer by Rob Va - MSFT Wednesday, August 10, 2011 8:49 PM
    • Marked as answer by Rob Va - MSFT Wednesday, August 24, 2011 5:13 PM
    Wednesday, August 10, 2011 8:49 PM

All replies

  • Hi Nitin,

    This issue could be due to a corrupted datasources file. I would recommend that you try the following steps:

    1) Backup the file datasources.xml from %fastsearch/components/logtransformer/data/datastore.
    2) Stop the logtransformer process:
          nctrl stop logtransformer
    3) Delete the datasources.xml file from the above location (make sure you took a backup)
    4) Start the logtransformer process
          nctrl start logtransformer

    Let us know your results.

     

    Thanks!

    Rob Vazzana | Sr Support Escalation Engineer | Customer Service & Support

    http://support.microsoft.com

    • Proposed as answer by Rob Va - MSFT Wednesday, August 10, 2011 8:49 PM
    • Marked as answer by Rob Va - MSFT Wednesday, August 24, 2011 5:13 PM
    Wednesday, August 10, 2011 8:49 PM
  • Thanks Rob.

    Will let you know about the results soon.

    Wednesday, August 17, 2011 8:56 AM