none
UnwillingToPerformException: SQL Deadlock in Procedure DoDeleteCachedRequest. Requests stuck in PostProcessing. RRS feed

  • Question

  • Hi,

    We've previously (a couple of weeks ago) experienced SQL Deadlocks in a Production environment. 

    That time, cancelling requests and restarting the FIMService (both of them, clustered) seemed to resolve the issue.

    However, the same issue has re-emerged.

    Several Requests are stuck in "PostProcessing" (no, they do not contain notifications, they are stuck due to SQL killing the SQL Connections due to deadlocks). The parent request has status PostProcessingError, with a stacktrace.

    The following stacktrace is present on the requests:

    Microsoft.ResourceManagement.WebServices.Exceptions.UnwillingToPerformException: Other ---> System.Data.SqlClient.SqlException: Reraised Error 50000, Level 13, State 1, Procedure ReRaiseException, Line 37, Message: Reraised Error 50000, Level 13, State 1, Procedure ReRaiseException, Line 37, Message: Reraised Error 50000, Level 13, State 1, Procedure ReRaiseException, Line 37, Message: Reraised Error 1205, Level 13, State 56, Procedure DoDeleteCachedRequest, Line 47, Message: Transaction (Process ID 71) was deadlocked on lock resources with another process and has been chosen as the deadlock victim. Rerun the transaction.

    Transaction count after EXECUTE indicates a mismatching number of BEGIN and COMMIT statements. Previous count = 1, current count = 0.

       at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)

       at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)

       at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)

       at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)

       at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)

       at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)

       at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(DbAsyncResult result, String methodName, Boolean sendToPipe)

       at System.Data.SqlClient.SqlCommand.ExecuteNonQuery()

       at Microsoft.ResourceManagement.Data.DataAccess.UpdateRequest(RequestType request, IEnumerable`1 updates)

    Here are some facts:

    • FIM2010 R2 version 4.1.3634 (yes I know...., upgrading is in process)
    • The environment has been running for 2,5 years without any similar problems.
    • We've ensured there are no parallell MPRs triggered modifying the same attributes on objects
    • The same stored procedure was the problem last time: DoDeleteCachedRequest
    • The procedure seems to lock and clean a number of tables in the FIMService database.
    • The problem is random. That is: some requests are successful, and some fails with the above error (even for exactly the same MPR and Workflows triggered)

    Does anyone know what this procedure does? I can only find one (1) other post on the forum (and actually, on Google) regarding this, and there are no answers in that thread:

    https://social.technet.microsoft.com/Forums/en-US/3d9bba0c-0a85-42a1-8b46-1f4cff7d6613/fim-portal-request-getting-failed-after-completion-of-all-approvals?forum=ilm2

    Any suggestions?

    Thanks.

    Br,

    Leo


    Did my post help? Please use "Vote As Helpful", "Mark as answer" or "Propose as answer". Thank you!



    Friday, February 16, 2018 12:40 PM

Answers

  • Hi,

    I guess it's a call to Microsoft Premier Support then :)

    Thanks.

    Br,

    Leo


    Did my post help? Please use "Vote As Helpful", "Mark as answer" or "Propose as answer". Thank you!

    • Marked as answer by Leo Erlandsson Monday, November 12, 2018 1:30 PM
    Tuesday, February 20, 2018 2:17 PM