none
CSV serialization not working in DPM 2012 RRS feed

  • Question

  • Trying to solve a problem with my DPM reports I reinstalled DPM 2012. After that my CSV backup serialization stoped working and DPM tries to backup ALL VM's of ALL clusters at once. Obviously, most backup fails and the clusters have a hard time not loosing access to the disks. I have double checked every thing as explained here:

    http://technet.microsoft.com/en-us/library/ff634192.aspxRegards

    All settings are in place and they are exactly the same as it was before reinstalling.

    Has anyone had the same problem? Any clues?

    Thanks a lot!

    Wednesday, September 19, 2012 3:42 PM

Answers

  • Nice work, you pointed out a documentation problem, I will have it corrected.

    Should be as follows.

    Enabling Per CSV LUN Serialization

    This form of serialization limits the number of virtual machine backups happening on a single CSV LUN. This is done by creating a DataSourceGroups.xml file and placing it in the DPM server at one of the following locations.

    If you performed an upgrade from DPM 2010 -%PROGRAMFILES%\Microsoft DPM\DPM\Config.
    If you did a fresh installation of DPM 2012  -%PROGRAMFILES%\System Center 2012\DPM\DPM\Config.

    This file provides DPM with information about the CSV virtual machine deployment configuration/distribution on the various CSV LUN so as to serialize the backups that happen per CSV LUN.


    Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread. Regards, Mike J. [MSFT] This posting is provided "AS IS" with no warranties, and confers no rights.

    • Marked as answer by VRC VLM Monday, September 24, 2012 7:19 AM
    Friday, September 21, 2012 12:27 PM
    Moderator

All replies

  • Hi,

    Most customers forget to do step 4. If a protection group has already been created for the virtual machines, perform the steps in the Modify Protection Group Wizard. If a protection group has not been created, create a new protection group and the job serialization described above will take effect.

    Please got through the modify protection group wizard and see if future recovery point jobs run serially.

    Also, open the DataSourceGroups.xml on the DPM server using internet exlporer and make sure that is can be parsed without errors.


    Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread. Regards, Mike J. [MSFT] This posting is provided "AS IS" with no warranties, and confers no rights.

    Thursday, September 20, 2012 7:49 PM
    Moderator
  • Hello!

    I have done every step in the guide, including modifying the protection groups. In fact, I had this set up and working correctly until I had to do a reinstall trying to solve a different problem with DPM reports. Things I've tried so far:

    - Check DataSourceGroups.xml with IE both in the server and in my computer. Both IE and Firefox open it without showing any errors.

    - As I have two clusters with some CSV's and I'm using a merged DataSourceGroups.xml, I've generated a new XML file from one cluster, copied it to the DPM server and modified it's protection group. No luck, it still tries to backup all VM's at once.

    - Double check and repeat every step in the guide

    It looks to me that it's not even looking for my DataSourceGroups.xml ...  that gave an idea, I'm going to test something...

    Friday, September 21, 2012 9:29 AM
  • GOT IT! :)

    Here, the specified path for the DataSourceGroups.xml is %PROGRAMFILES%\Microsoft DPM\DPM\Config

    I have checked with Process Explorer and when I modify a protection group my DPM is looking for DataSourceGroups.xml in a different path: %PROGRAMFILES%\Microsoft System Center 2012\DPM\DPM\Config

    Then copied my XML to that "new" path, modified the protection group and my backups run serially again! Sooo good :)

    Maybe the documentation is wrong or maybe something strage happed with my setup, maybe someone at Microsoft may be able to check this steps:

    1- DPM2010 working flawlessly
    2- Migrate from DPM2010 to DPM2012. Everything ok, except the reports are throwing an error (explained here)
    3- Did a reinstallation of DPM2012 as explained here. Reports still don't work and now my CSV backups are run in parallel instead of serially.
    4- Copied the XML to the path stated above and solved the problem with the CSV backups.

    Hope this helps

    Friday, September 21, 2012 10:01 AM
  • Nice work, you pointed out a documentation problem, I will have it corrected.

    Should be as follows.

    Enabling Per CSV LUN Serialization

    This form of serialization limits the number of virtual machine backups happening on a single CSV LUN. This is done by creating a DataSourceGroups.xml file and placing it in the DPM server at one of the following locations.

    If you performed an upgrade from DPM 2010 -%PROGRAMFILES%\Microsoft DPM\DPM\Config.
    If you did a fresh installation of DPM 2012  -%PROGRAMFILES%\System Center 2012\DPM\DPM\Config.

    This file provides DPM with information about the CSV virtual machine deployment configuration/distribution on the various CSV LUN so as to serialize the backups that happen per CSV LUN.


    Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread. Regards, Mike J. [MSFT] This posting is provided "AS IS" with no warranties, and confers no rights.

    • Marked as answer by VRC VLM Monday, September 24, 2012 7:19 AM
    Friday, September 21, 2012 12:27 PM
    Moderator
  • Hi Mike,

    Having problems with the above, we are on a fresh install DPM2012 with a 2 Node Hyper V cluster.

    Steps taken to implement:

    1. Change registry key value to 1

    HKLM\Software\Microsoft\Microsoft Data Protection Manager\2.0\Configuration\MaxAllowedParallelBackups

    2. Produce DataSourceGroups.xml file with PowerShell script as per below:

    <?xml version="1.0" encoding="utf-16"?>
     <DatasourceGroup xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns="http://schemas.microsoft.com/2003/dls/GroupDatasourceByDisk.xsd">
    <Group GroupName="Volume1-CL1.networkintegration.local">
    <Datasource DatasourceName="79B4B22E-4221-4EE8-A6DD-26C45E99C18F" ProtectedServerName="SCVMM AC1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="DF4D3740-483A-445E-814C-F006B8693B85" ProtectedServerName="SCVMM CM1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="FB3A995E-04F7-4FAD-8BF6-C2EF8F2BED24" ProtectedServerName="SCVMM DA1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="7E12B6DA-C66F-44C8-9F2B-B72910CD7BA7" ProtectedServerName="SCVMM DC1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="6704B07C-F1E3-434F-97CE-429A983353FA" ProtectedServerName="SCVMM DC2 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="2C21F2E4-CA3A-40BD-AEAA-D98CFEBDB6B7" ProtectedServerName="SCVMM DMZ-DC1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="CFAD797A-DA83-405B-BEC2-FEECAB735226" ProtectedServerName="SCVMM DMZ-LYNCEDGE1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="145C8116-F858-4672-AFE5-02A11A4B18F0" ProtectedServerName="SCVMM DMZ-WEBSERVICES2 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="FC423303-4538-4373-84A6-2DAA177315F7" ProtectedServerName="SCVMM DPM1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="8EB499B4-3022-4A72-8AF4-9F2B82E2F302" ProtectedServerName="SCVMM FILE2 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="73C4C7F9-BD1C-45B4-B0B1-D88E79DBE5E6" ProtectedServerName="SCVMM LYNC1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="DE3CF585-A784-4F61-BB5B-BABB2A8719E2" ProtectedServerName="SCVMM MAIL2 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="4A553127-CAFA-4C11-B157-8AE7FE8C8B9F" ProtectedServerName="SCVMM OM1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="52707FDE-67E7-4952-9537-9ACC9D4FC49D" ProtectedServerName="SCVMM ORC1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="0B8545AD-EDF2-4C18-ABF7-AAEB610B16F7" ProtectedServerName="SCVMM RDS2 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="695AC7B9-0C5D-4D2B-B131-D69A624E59F2" ProtectedServerName="SCVMM SM1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="813BD366-46E9-477F-B15B-1757BA557AA9" ProtectedServerName="SCVMM SM2 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="FF781526-98E0-4E2D-88EA-B75063F59A59" ProtectedServerName="SCVMM SP1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="0ADBB612-CAA5-463A-9E4B-821DF8A2B4F6" ProtectedServerName="SCVMM SQL1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="FE5CD68A-8051-4A37-A6C3-874B1A43BB1A" ProtectedServerName="SCVMM SQL2 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="203158B5-C4C5-4B49-B4D7-84695778A15A" ProtectedServerName="SCVMM TMG1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="8492A115-DD8B-473F-A7FD-410C2037F5D2" ProtectedServerName="SCVMM UAG1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="193E82CF-87F1-43E7-9EA0-CF9CABD29A28" ProtectedServerName="SCVMM WEB2 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="e2cdf76a-bb04-406c-bb43-d0f08358c2ae" ProtectedServerName="SCVMM RDS1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    <Datasource DatasourceName="49786b9b-5ccc-4c7f-afd0-3333bed4e587" ProtectedServerName="SCVMM SC1 Resources.CL1.networkintegration.local" WriterId="66841cd4-6ded-4f4b-8f17-fd23f8ddc3de" />
    </Group>
    </DatasourceGroup>

    3. Placed the file in the following location: -%PROGRAMFILES%\System Center 2012\DPM\DPM\Config

    4. Created a protection group for my CSV.

    5. When backups run it would be happy until it started to backup a machine on our second node: eg SP1

    at this point all other backups will start failing with the following error:

    Failed to prepare a Cluster Shared Volume (CSV) for backup as another backup using the same CSV is in progress. (ID 32612 Details: Back up is in progress. Please wait for backup completion before trying this operation again (0x8007173D))

    Are you able to point me in the direction of something I can monitor or check to make sure DPM is reading the datasourcegroups.xml file etc.

    Thanks

    Tuesday, October 9, 2012 9:37 PM
  • Hi,

    Please run Process Explorer when modify a protection group and see if DPM has trouble reading the DataSourceGroups.xml.


    Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread. Regards, Mike J. [MSFT] This posting is provided "AS IS" with no warranties, and confers no rights.

    Tuesday, October 9, 2012 11:02 PM
    Moderator
  • Thanks Mike,

    Looks like it is trying to read from the d:\ which makes sense as the install directory was set to the D:

    Have updated this location with my current datasourcegroups.xml and will test again tonight

    Date & Time: 10/10/2012 12:33:12 PM
    Event Class: File System
    Operation: ReadFile
    Result: SUCCESS
    Path: D:\Microsoft System Center 2012\DPM\DPM\Config\DataSourceGroups.xml
    TID: 3084
    Duration: 0.0000155
    Offset: 0
    Length: 4,096
    Priority: Normal

    Wednesday, October 10, 2012 2:18 AM
  • Thanks Mike,

    Looks like it is trying to read from the d:\ which makes sense as the install directory was set to the D:

    Have updated this location with my current datasourcegroups.xml and will test again tonight

    Date & Time: 10/10/2012 12:33:12 PM
    Event Class: File System
    Operation: ReadFile
    Result: SUCCESS
    Path: D:\Microsoft System Center 2012\DPM\DPM\Config\DataSourceGroups.xml
    TID: 3084
    Duration: 0.0000155
    Offset: 0
    Length: 4,096
    Priority: Normal

    Still no luck.

    Backups are currently running and have started to fail with the same errors. So just to be clear today I produced a new datasourcegroups.xml file placed the file in d:\microsoft system center 2012\dpm\dpm\config\ folder and then updated the CSV protection group.

    Is there anywhere else I can check within DPM to ensure it is reading the file. As posted above, process monitor is displaying a successful read of the mentioned file. Please let me know of any other logs etc that may help in resolving this issue.

    Wednesday, October 10, 2012 12:08 PM
  • So I bit the bullet after the above and built a fresh DPM server (server 2008r2, DPM 2012) only modification to the install was that I used the default install path.

    I used the same datasourcesgroup.xml file previously created and set same registry settings as before.

    Backup of the CSV has completed successfully :D

    So is changing the install directory not supported?? or could there be something else playing up with the initial server. I still have the initial server running so I can perform further tests if required as we would like to understand this behavior better so when we deploy at customer sites we can make informed design decisions.

    Friday, October 12, 2012 12:03 PM