none
Fast ESP : Understanding fast logs for delete operation RRS feed

  • Question

  • Hi,

    Following are some of the delete logs generated when we performed delete operation in a collection using filetraverser:

    1)

    [2011-07-26 07:10:59.092] INFO executivepp Documents processed unsuccessfully: 6 (2.7/s)
    : indexing::Document d41d8cd98f00b204e9800998ecf8427e_executivepp does not exist2-C71A-4B83-8A27-8F08EAFE2248

     

    2)

    [2011-07-27 01:46:07.725] WARNING executivepp Document failed for URI=E67DEA58-10CF-4374-83ED-30277DDAB88E: indexing::Document f6d4eff348d8c8a473ace92ad7c0afc7_executivepp does not exist

     

    3)

    [2011-07-26 07:10:59.094] INFO       executivepp Documents processed ok: 1751 (789.0/s)

     

    4)
    [2011-07-26 07:10:59.094] INFO       executivepp Documents processed unsuccessfully: 10 (4.5/s)

     

    5)
    [2011-07-26 07:10:59.094] INFO       executivepp All 1761 documents sent and all callbacks received, now exiting

     

    In the log snaps numbered(1 to 5) above, I have following understanding:

    Log 1: This type of log is generated when we try to delete an entity from fast that does not exist in a collection.

    Log 2: This type of log is generated when we try to delete an entity from fast that does not exist in a collection.

    Log 3: This log tell us about the successful delete count.

    Log 4: This tells us about non-existing and failed entity delete count.

    Log 5: This tells us about the number of entity's submitted for delete operation.

     

    Inference 1: If we add up the figure of successful delete and unsuccessful delete we arrieve at number of entity's submitted for delete operations.

     

    Inference 2: Log 1 and 2 tell us same thing in my view.

     

    Please help me in understanding following

     - whether my understanding about the logs is right...

     - why does two different kinds of logs been generated for same situation as in the case of Log1 and Log2?

     

    Thanks in anticipation:)

     


    Wednesday, July 27, 2011 6:40 AM

All replies

  • I think that log messages 3, 4 and 5 may relate to deletes, adds and updates. Depending on the connector, there may be other log messages that break down the document operations int add, delete and update, with success/failure counts for each.

    Messages 1 & 2 are logged at different warning levels. My guess would be that message 1 is some sort of "summary" information (logged at INFO level) while message 2 (at warning level) is what you actually should be looking for. It could also be that these messages are generated by different subsystems (e.g, filetraverser and indexer or document processor), but in this case, it looks more likely to be just messages from the filetraverser.

    Thursday, August 11, 2011 6:04 AM
  • I think that log messages 3, 4 and 5 may relate to deletes, adds and updates. Depending on the connector, there may be other log messages that break down the document operations int add, delete and update, with success/failure counts for each.


    I just noticed that you explicitly stated that the log messages were from a delete operation using the file traverser, so the paragraph above does not apply in this case.
    Friday, August 12, 2011 7:09 AM