none
SBC Reporting Fails RRS feed

  • General discussion

  • Hi,

    While generating the reports for SBC we see following error even for one hour report.

    Using lql file: /apps/esp/esp4j/etc/lqljobs/lqls.xml

    Using start date: Sat Dec 01 04:00:00 PST 2012
    Using end date: Sat Dec 01 04:59:59 PST 2012
    Using time out: 100
    Generating query report for Sat Dec 01 04:00:00 PST 2012..................................................Timed out waiting for reporting data to be generated. (timeout: 100 sec)
    Failed to generate query report for Sat Dec 01 04:00:00 PST 2012.

    We tried to increase the timeout value to even 5000 secs but the result is same .  Is there any faster way to generate the reports ?

    Regards

    Thursday, December 13, 2012 7:06 PM

All replies

  • Queryreportergenerator timeouts  indicates that the logtransformer does not pick the job file to process before queryreportgenerator times out. The reason for logtransformer not to pick the job file in time may be a busy state of the scheduler with some other scheduled jobs.

    You can try to use -T value to increase the timeout value.

    Also, could you verify:

    To narrow down the issue please follow following steps.
                    1. Pick a time period with no reports (dates you are trying to process)
                    2. Check and verify whether there is a valid query log entries for that time period. (in var/log/querylog)
                    3. Check and verify whether there are related query log files (.bak and META)in $FASTSEARCH/component/logtransformer/data/download/querylog
                    4. Execute Ilql and verify whether related logs appear in logtransformer datastore for example:
                         cd $FASTSEARCH/components/logtransformer/bin
                        ./launch.sh ilql

                       Count valid queries processed the current day/week:

                        -select count(*) from querylog for period current(day) to now() where original_query is not null;
                        -select count(*) from querylog for period current(week) to now() where original_query is not null;

                        List out queries has been processed today:

                        -select timestamp, view, original_query, query, hits from querylog for period current(day) to now() order by timestamp;
                    
                       Count  from querystatistics table after Dec 01

                       vespa=# select count(*) from querystatistics where startDate > '2012-12-01 00:00:00';
     You can as well try  to increase the frequency in $FASTSEARCH/esp4j/etc/lqljob/lqls.xml to 2 hours. By default query report generating is happens hourly. If your QPS rate are very high, then that might cause logtransformer to take longer time (> 1h) to execute one timer job. This might lead logtransformer to stay in busy state.

    Thursday, December 13, 2012 8:36 PM