none
User Profile Incremental Syncs taking a long time RRS feed

  • Question

  • I'm honestly not sure if this is a problem but in my gut I am thinking something is wrong..   We run an incremental profile sync daily at 1 am and it takes more then half a day to complete..   We are syncing to our active directory and its just one way (from ad to sharepoint).  Below is the output when I click on "synchronizing" on user profile services management ..   On a side note .. the sptimer recycle job is failing nightly at 6:40 pm with .. So I am not sure if this is normal .. I am thinking of scheduling the timer job for slightly later hoping at least that will allow it to recycle..  Thanks for any light you can shed on this subject for me!!

    The timer service was not recycled because the following jobs were still running: User Profile Service - System Job to Manage User Profile Synchronization

    xx.xx.xx.edu
    Stage Active directory import
    Additions 0
    Updates 19
    Unchanged 1
    .............................
    Successes 20
    Failures 0
    Start Time 12/12/2012 1:01:02 AM
    End Time 12/12/2012 1:01:28 AM

    -----------------------------------------------------------------


    227124a3-c411-42de-99fd-fd0150fca58a
    Stage SharePoint Server import
    Additions 203
    Updates 33025
    Unchanged 38808
    .............................
    Successes 72036
    Failures 0
    Start Time 12/12/2012 1:02:02 AM
    End Time 12/12/2012 8:51:13 AM

    -----------------------------------------------------------------


    xx.xx.xx.edu
    Stage Active directory synchronization
    Additions 2
    Updates 0
    Unchanged 0
    .............................
    Successes 2
    Failures 0
    Start Time 12/12/2012 8:52:03 AM
    End Time 12/12/2012 8:53:09 AM

    -----------------------------------------------------------------


    227124a3-c411-42de-99fd-fd0150fca58a
    Stage SharePoint Server export
    Additions 2
    Updates 51
    Unchanged 0
    .............................
    Successes 53
    Failures 0
    Start Time 12/12/2012 8:54:03 AM
    End Time 12/12/2012 8:54:48 AM

    -----------------------------------------------------------------


    227124a3-c411-42de-99fd-fd0150fca58a
    Stage SharePoint Server import
    Additions 199
    Updates 30461
    Unchanged 38577
    .............................
    Successes 69237
    Failures 0
    Start Time 12/12/2012 8:54:49 AM

    -----------------------------------------------------------------

    and here it is almost 3pm and this part is still running

    Wednesday, December 12, 2012 7:38 PM

Answers

  • Jason, I would strongly recommend that you evaluate the Feb 2012 CU.  There are significant performance improvements in the UPSS.  Also, the June 2011, August 2011, and October 2011 all have various issues with the UPA/UPSS (all first fixed in the Dec 2011 CU).

    Your number of users sound just fine, it is just that you're pulling a lot of them, which is okay, but again, the Feb 2012 CU sounds like the right fit to improve the performance of this process.


    SharePoint - Nauplius Applications
    Microsoft SharePoint Server MVP
    MCITP: SharePoint Administrator 2010

    Wednesday, December 12, 2012 8:55 PM
    Moderator

All replies

  • Have you applied the Feb 2012 CU or greater?  There were significant performance improvements in the Feb 2012 CU, especially for large organizations (which with 30K+ objects, I'd expect you'd fall under).

    SharePoint - Nauplius Applications
    Microsoft SharePoint Server MVP
    MCITP: SharePoint Administrator 2010

    Wednesday, December 12, 2012 8:08 PM
    Moderator
  • So it looks like the sync is working, and its pulling in a TON of data.  My guess is the profile sync is setup to pull too much data from AD.  Check this post: http://www.harbar.net/articles/sp2010ups.aspx

    Look under the section "Configure Connections and do a Sync (Import)", step 11. 

    What you don't want here is to have everything selected, just your users.  I would check that first, if you have everything selected you can eliminate a lot of work by just syncing users.


    Brandon Atkinson
    Blog: http://brandonatkinson.blogspot.com
    Twitter: http://twitter.com/tehremo

    Wednesday, December 12, 2012 8:11 PM
  • Thanks for the quick Response guys!

     

    @Trevor - No sadly .. we are actually in the process of validating sp1 and the june11 cu in development and will be stopping there for the foreseeable future.. but knowing about the aug12 possibly resolving some of those issue might get the ball rolling on the next cu..

     

    @Brandon - Thank you for that .. and looking at my screen shots from our install I would think we did select only users and that post is great and we followed that in our initial setup.. Once the sync is done I will check the connection and verify nothing has changed ..

     

    As far as that being a large number of objects

    Number of User Profiles:   14818

    Number of user Properties: 71

     

    Does that number of objects from above make sense for the number of user profiles sharepoint has? 

     

    And sorry to throw in something new .. but I just happened to be looking at which services were running where .. and on our app server we have the user profile service and the up sync service running .. and on one of our 2 wfe's we also have the user profile service running (not the sync)  I'm assuming someone set that up for fault tolerance .. but would that cause any issues having two of those same services running in the farm

    Wednesday, December 12, 2012 8:51 PM
  • Jason, I would strongly recommend that you evaluate the Feb 2012 CU.  There are significant performance improvements in the UPSS.  Also, the June 2011, August 2011, and October 2011 all have various issues with the UPA/UPSS (all first fixed in the Dec 2011 CU).

    Your number of users sound just fine, it is just that you're pulling a lot of them, which is okay, but again, the Feb 2012 CU sounds like the right fit to improve the performance of this process.


    SharePoint - Nauplius Applications
    Microsoft SharePoint Server MVP
    MCITP: SharePoint Administrator 2010

    Wednesday, December 12, 2012 8:55 PM
    Moderator
  • excellent .. I will forward the strong recommendation on to my team .. It certainly sounds worthy of attention...

    So I wanted to check the connection  file since that portion of the sync looked about to complete and it looks like another sync kicked off .. Is it supposed to run through this process multiple times on an incremental sync?

    227124a3-c411-42de-99fd-fd0150fca58a
    Stage SharePoint Server export
    Additions 205
    Updates 33076
    Unchanged 38808
    .............................
    Successes 72089
    Failures 0
    Start Time 12/12/2012 8:54:49 AM
    End Time 12/12/2012 3:40:32 PM

    -----------------------------------------------------------------


    227124a3-c411-42de-99fd-fd0150fca58a
    Stage SharePoint Server synchronization
    Additions 0
    Updates 0
    Unchanged 0
    .............................
    Successes 0
    Failures 0
    Start Time 12/12/2012 3:41:02 PM
    End Time 12/12/2012 3:42:08 PM

    -----------------------------------------------------------------


    xx.xx.xx.edu
    Stage Active directory export
    Additions 0
    Updates 0
    Unchanged 0
    .............................
    Successes 0
    Failures 0
    Start Time 12/12/2012 3:43:01 PM

    -----------------------------------------------------------------


    xx.xx.xx.edu
    Stage Active directory import
    Additions 10
    Updates 35
    Unchanged 2
    .............................
    Successes 47
    Failures 0
    Start Time 12/12/2012 3:44:01 PM
    End Time 12/12/2012 3:44:50 PM

    -----------------------------------------------------------------


    227124a3-c411-42de-99fd-fd0150fca58a
    Stage SharePoint Server export
    Additions 0
    Updates 0
    Unchanged 0
    .............................
    Successes 0
    Failures 0
    Start Time 12/12/2012 3:45:01 PM
    End Time 12/12/2012 3:45:06 PM

    -----------------------------------------------------------------


    227124a3-c411-42de-99fd-fd0150fca58a
    Stage SharePoint Server import
    Additions 14
    Updates 2699
    Unchanged 20125
    .............................
    Successes 22838
    Failures 0
    Start Time 12/12/2012 3:45:07 PM

    -----------------------------------------------------------------

    Wednesday, December 12, 2012 9:33 PM
  • It should only run once per day, if that is the way it is configured.  Under Configure Synchronization Timer Job, what is the incremental timer job configured for?

    SharePoint - Nauplius Applications
    Microsoft SharePoint Server MVP
    MCITP: SharePoint Administrator 2010

    Wednesday, December 12, 2012 9:46 PM
    Moderator
  • Daily at 1 am

    Synchronization Schedule (Incremental) Every day at 01:00 AM
       
    Wednesday, December 12, 2012 9:55 PM
  • Here is how a complete incremental sync looks (note this is post-Feb 2012 CU, so you'll see the History Cleanup, which you won't see on your build):

    Stage History Cleanup 
    ............................. 
    Start Time 12/12/2012 7:16:37 AM 
    End Time 12/12/2012 7:16:39 AM 
    
    ----------------------------------------------------------------- 
    
    
    MOSS 
    Stage SharePoint Server import 
    Additions 0 
    Updates 0 
    Unchanged 0 
    ............................. 
    Successes 0 
    Failures 0 
    Start Time 12/12/2012 7:16:39 AM 
    End Time 12/12/2012 7:17:18 AM 
    
    ----------------------------------------------------------------- 
    
    
    AD 
    Stage Active directory import 
    Additions 0 
    Updates 0 
    Unchanged 0 
    ............................. 
    Successes 0 
    Failures 0 
    Start Time 12/12/2012 7:16:39 AM 
    End Time 12/12/2012 7:16:47 AM 
    
    ----------------------------------------------------------------- 
    
    
    AD 
    Stage Active directory synchronization 
    Additions 2 
    Updates 0 
    Unchanged 0 
    ............................. 
    Successes 2 
    Failures 0 
    Start Time 12/12/2012 7:17:18 AM 
    End Time 12/12/2012 7:17:43 AM 
    
    ----------------------------------------------------------------- 
    
    
    MOSS 
    Stage SharePoint Server synchronization 
    Additions 0 
    Updates 0 
    Unchanged 0 
    ............................. 
    Successes 0 
    Failures 0 
    Start Time 12/12/2012 7:17:43 AM 
    End Time 12/12/2012 7:17:44 AM 
    
    ----------------------------------------------------------------- 
    
    
    MOSS 
    Stage SharePoint Server export 
    Additions 2 
    Updates 83 
    Unchanged 0 
    ............................. 
    Successes 85 
    Failures 0 
    Start Time 12/12/2012 7:17:44 AM 
    End Time 12/12/2012 7:18:25 AM 
    
    ----------------------------------------------------------------- 
    
    
    Stage Post-processing 
    ............................. 
    Start Time 12/12/2012 7:18:25 AM 
    End Time 12/12/2012 7:18:28 AM 
    
    ----------------------------------------------------------------- 
    


    SharePoint - Nauplius Applications
    Microsoft SharePoint Server MVP
    MCITP: SharePoint Administrator 2010

    Wednesday, December 12, 2012 9:58 PM
    Moderator
  • Thank you very much!  I have to say you guys are awesome and very helpful!  so .. while we checked our two development areas and verified we were just pulling users and assumed prod was the same way .. as we would never change anything in production without doing it in development first.......  when we finally decided to just stop the sync as it seemed like it was never going we checked to see what was there in the populate containers and it had a whole bunch of weird selection but also included groups.. we are revising that and going to try another sync tomorrow morning

    Thursday, December 13, 2012 2:38 PM