none
Export and DIDS is running very slowly in FIM portal MA RRS feed

  • Question

  • Hi all,

    I need to project 85000 disconnected objects into FIM by enabling projection in an SQL MA which has those dis-connectors.

    I enabled projection rule in SQL MA and have successfully projected by running FS on sql MA. (which also creates a resource in FIM)

    When I run export in FIM portal MA it is running slowly and took 8hrs to add 18000 objects and then it showed 5000 errors (all are common). I have attached the error below.

    

    Later I have stopped the export since it is stuck for more than 9 hrs and then ran DIDS which ran for 14hrs.

    This is totally frustrating. Can anyone please help me in improving the performance of my system.

    Regards,

    Rajesh


    Rajesh Kumar NSR, FIM administrator, Wipro Technologies. India.

    Wednesday, May 3, 2017 5:07 AM

All replies

  • 1- FIM 2010 (Not R2) it is known to be slow during exports.  R2 has addressed that issue.  It also depends on your system configuration.

    2- The errors indicate missing data, cant tell what without seeing the whole picture.  Because of the errors slowness increases drastically.  These are expensive operations for the SQL server.  You need to find out what data is missing, adjust MPRs for permissions, and export them. If you have these many errors, it is the data not the system. 

    Can you show the pending exports and the full error on Export to FIM MA.  Also, check the requests in FIM Portal for clues to these failures.

    3- What is DIDS? I assume Delta Import and Delta Synchronization? If that is the case, why don't you run them separately and see what the issues are, which will always be in the DS (Delta Synchronization part).

    You need to take one bite at the time and start slowly making sure the configuration is in order before you can open the full stream and let 1800 objects in, with most of them resulting in errors.


    Nosh Mernacaj, Identity Management Specialist


    Thursday, May 4, 2017 12:28 PM
  • Hi Nosh,

    I have projected 85000 objects into Metaverse and when I ran Export on FIM MA, the CPU utilization % on my FIM back-end database server  is too high (reached 100%), when I checked with my DBA admin, I could see that CPU memory is blocked by some process and it is in sleeping mode.

    below mentioned are the processes that were utilizing high CPU %, you could see duplicates in them too.

    select * from [mms_run_history] with(nolock)  WHERE (is_run_complete = 0 OR run_result ='in-progress' OR run_result ='completing-referential-updates' OR

    run_result ='completing-obsoletion') AND ma_id = '178216C7-5953-41C4-8D9E-1C96C148428D'

     

    FIMSynchronizationService.dbo.mms_getcsmvlinkforcs_nolock;1

     

    select * from [mms_run_history] with(nolock)  WHERE (is_run_complete = 0 OR run_result ='in-progress' OR run_result ='completing-referential-updates' OR

    run_result ='completing-obsoletion') AND ma_id = 'D9AF068F-846F-461F-BAA8-DF04FFBD3606'

     

    FIMSynchronizationService.dbo.mms_updatestepobjectdetails_stats;1

     

    select * from [mms_run_history] with(nolock)  WHERE (is_run_complete = 0 OR run_result ='in-progress' OR run_result ='completing-referential-updates' OR

    run_result ='completing-obsoletion') AND ma_id = 'D9AF068F-846F-461F-BAA8-DF04FFBD3606'

     

    select * from [mms_run_history] with(nolock)  WHERE (is_run_complete = 0 OR run_result ='in-progress' OR run_result ='completing-referential-updates' OR

    run_result ='completing-obsoletion') AND ma_id = '178216C7-5953-41C4-8D9E-1C96C148428D'

    I too heard from my DBA admin that there are lot of tables that needs to be de-fragmented.

    Could you please assist me.Also let me know if de-fragmenting the tables will increase the performance?

    Thanks,

    Rajesh


    Rajesh Kumar NSR, FIM administrator, Wipro Technologies. India.


    • Edited by Rajesh.NSR Thursday, May 4, 2017 2:57 PM
    Thursday, May 4, 2017 2:56 PM
  • Rajesh,

    These queries mean almost nothing. You need to fix your data before attempting to load 85K users.


    Nosh Mernacaj, Identity Management Specialist

    • Proposed as answer by Nosh Mernacaj Sunday, May 7, 2017 12:37 PM
    Friday, May 5, 2017 12:33 PM