Announcement: 7

Data Protection Manager - Hyper-V and CSV Clusters announcement

  • Link
    Free ebook: Microsoft System Center Data Protection for the Hybrid Cloud
    giridharreddy

     Free ebook: Microsoft System Center Data Protection for the Hybrid Cloud

    If you are responsible for architecting and designing the backup strategy for your organization, especially if you're looking for ways to incorporate cloud backup into your business continuity scenarios, this book is for you. With the increasing trends in virtualization as well as the move to the pubic cloud, IT organizations are headed toward a world where data and applications run in on-premises private clouds as well as in the public cloud. This has key implications for data protection strategy, and it is important to choose the solution that provides the same level of data protection you have afforded so far while allowing you to harness the power of the public cloud.

  • Link
    DPM Host level backup of a VM fails with 0x800423F3 when hosting a SQL Always-on secondary db.
    Mike Jacquet

    DPM encountered a retryable VSS error. (ID 30112 Details: VssError:The writer experienced a transient error. If the backup process is retried, the error may not reoccur. (0x800423F3))"

    This is fixed in SQL Server 2012 SP2

    Bugs that are fixed in SQL Server 2012 Service Pack 2
    http://support.microsoft.com/kb/2958429

    -  DPM’s full backup on the server with AlwaysOn secondary will be converted to copy_only backup

    How to obtain the latest service pack for SQL Server 2012
    http://support.microsoft.com/kb/2755533

  • Link
    Application Log truncation does not occur after host level guest backups
    Mike Jacquet


    I would like make you aware of what seems to be change in behavior between Windows 2008 (R2)  / Windows 2012 and Windows 2012 R2 host level backups of guests.  It used to be that when a Guest was backed up by DPM when protecting Windows 2008 (R2) and Windows 2012 hosts - the Hyper-V writer would communicate with the integration components inside the guest and would consider a host level backup as being equivalent of guest level backup for application data like exchange and SQL.  This resulted in the application logs being truncated after every host level backup of the guest.  This was desirable so you didn't need two separate backups, one for the VM guest, and one for application backup to truncate the logs.  If you really wanted to prevent the logs from being truncated so you could perform separate application level backups, you needed to add a registry key to the guest and set it to a value of 1.  This is documented on the following Windows KB article.

    975925 A hotfix is available that addresses the issues that occur when you perform a host-level backup of a Hyper-V VM on a computer that is running Windows Server 2008
    http://support.microsoft.com/kb/975925/en-us


    It appears that the default behavior in Windows 2012 R2 is just the opposite and the logs do not get truncated by default when performing host level backups of guest VM's running applications like exchange and SQL.

    The solution is to add the following registry keys and value as needed inside the Guest and set it to 0 so the application logs do get truncated after host level backups.
    In Registry Editor, locate the following registry subkey:

    HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Virtualization\VssRequestor

    Create a registry entry of the REG_DWORD type.
    Set the name of the registry entry to BackupType.
    Set the value of the registry entry to 0.

  • Link
    DPM is performing "Backup Using Saved State" versus "Backup Using Child Partition" - WHY ?
    Mike Jacquet

    When DPM protects a Hyper-V guest using HOST level protection, the Hyper-V writer on the hyper-V host communicates with the integration components inside the guest and determines if child partition or saved state backup will be performed.  Once DPM adds the guest to a protection group, the description: "Backup using child partition" or "backup using saved state" will not change, even thought the condition that determines the state may change.

    To get a real-time view of how then next backup will be perfomed, you can run the following test.

    To list hyper-V writer captions for guests to see if online or saved state backups can be done:

    From an administrative command prompt:

    a. Type: copy con script.txt and press enter
     b. Type: list writers and press enter
     c. Press CTRL + Z (to save)
     d. Type: diskshadow /s script.txt | find /i "caption: backup using"

    Output will be displayed for each guest.


    Here are the general conditions that make a VM go into a saved state during backup.

    Protecting Hyper-V machines
    http://technet.microsoft.com/en-us/library/hh757866.aspx


    Conditions when DPM fails to back up Hyper-V virtual machines in an online state

    By default, System Center 2012 – Data Protection Manager (DPM) performs a backup of a Hyper-V Virtual Machine (VM) in an online state. However, DPM cannot back up a Hyper-V VM in an online state, if one or more of the following conditions are true:

    •Backup (Volume Snapshot) Integration Service is disabled or not installed.
    •The virtual machine has one or more dynamic disks.
    •The virtual machine has one or more non-NTFS based volumes.
    •The virtual machine Cluster Resource Group in a cluster setup is offline.
    •The virtual machine is not in a running state.
    •A ShadowStorage assignment of a volume inside the virtual machine is explicitly set to a different volume other than itself.
    •An App-V drive is installed on the virtual machine that creates a non-NTFS volume.

    These conditions are set by the Hyper-V writer. In such a case, the VM is put in a saved state before a snapshot of host volumes are taken (except when the VM is turned off) for a backup. The Hyper-V writer adds the VM in the following format:
    •For offline backups: Backup Using Saved State\<VMName>
    •For online backups: Backup Using Child Partition Snapshot\<VMName>

    Additional reason is if there is less than 300MB free space on a volume in the guest.


    If you are using DPM 2010/2012/2012 Sp1 to backup guests running on a Windows 2008 (R2) hyper-v server you may observe that Windows 2012 server / Windows 8 guest VM's only get the option "Backup using saved state". It is also reported that some Windows 2012 server guests transfer the whole VM during backups instead on block level changes. 

    The below resolves both of these issues.

    SOLUTION
    =======

    The Windows 8 or Windows server 2012 guest needs to have scoped VSS snapshots turned off in order to support online backups. This is a new feature apparently in Win8/2012 and the default is enabled.

    Implement this registry key on EACH Windows 8 or Windows 2012 guest to resolve the issue.  You must add a key called SystemRestore, then add a value called ScopeSnapshots as follows.

    HKLM\Software\Microsoft\Windows NT\CurrentVersion\SystemRestore
    REG_DWORD ScopeSnapshots 0x0

    See the additional info on scoped snapshots.

    http://msdn.microsoft.com/en-us/library/windows/desktop/aa378941(v=vs.85).aspx



  • Link
    Anouncement: System Center Data Protection Manager CSV Serialization Tool
    Mike Jacquet

    This tool will help serialize DPM backups across multiple Windows 2008 based hyper-v clusters in a unattended way.

    Download the tool from the below KB article.

    System Center Data Protection Manager CSV Serialization Tool
    http://www.microsoft.com/en-us/download/details.aspx?id=36524

    Overview

    With the current approach, if there are multiple clusters managed by DPM, the user needs to run DSConfig.ps1 on one node of each cluster and then XMLs of each cluster needs to be merged and replace the DataSources.xml in %ProgramFiles%\Microsoft System Center 2012\DPM\DPM\Config  directory of the DPM server. And moreover these steps need to be repeated each time any VM is added to the cluster.

    The XML merging/serialization tool will remove many of these manual steps. The tool needs to be run on the DPM server periodically (or scheduled). It will run DSconfig.ps1 on one node of each cluster, merge the XML and replace Datasources.xml in the DPM config directory. 

                                   

    System requirements

    Supported operating systems: Windows Server 2008, Windows Server 2008 R2, Windows Server 2008 R2 SP1

    For DPM: Supported operating systems: 

    • Windows Server 2008
    • Windows Server 2008 R2
    • Windows Server 2008 R2 SP1
    DPM Versions: DPM 2010 with  QFE 3 and above or  DPM 2012
    For CSV Cluster Nodes:
    Windows Server 20008 R2 & Windows Server 2008 R2 SP1
  • Link
    Windows Server 2012 R2 Hyper-V guests are placed in saved (offline) state during DPM backup.
    Mike Jacquet

    Please be aware of the following blog.

    Hyper-V Backup doesn’t interrupt running virtual machines (anymore)

    You are using DPM 2012 R2 to backup Windows Server 2012 R2 hyper-v guests and observe that some VM's only backup using "Offline" state but you want backups to be using "Online " state.

    SOLUTION
    =======
    Ensure the effected guests have a SCSI controller configured in the properties of the Hyper-V guest.   Windows Server 2012 R2 Hyper-V servers require a SCSI controller inside the guests so snapshots created as part of the backup process can be mounted.  IDE controller does not allow this hot-mount operation, so you must install a SCSI controller in the guest.


    The Windows 2012 R2 Hyper-V writer on the hyper-V host communicates with the integration components inside the guest and determines if online or offline backup will be performed.   Be sure the latest integration components are installed in each guest.

    To get a real-time view of how the next backup will be performed, you can run the following test.

    To list Windows 2012 R2 hyper-V writer captions for guests to see if online or offline state backups will be done:

    From an administrative command prompt on the Hyper-V server:

    a. Type: copy con script.txt and press enter
     b. Type: list writers and press enter
     c. Press CTRL + Z + enter (to save)
     d. Type: diskshadow /s script.txt | find /i "caption: O"


    Output will be displayed for each guest as follows.


    C:\temp>diskshadow /s script.txt | find /i "caption: O"
                            - Caption: Online\SQLSERVER
                            - Caption: Offline\WSS-V14

    The Windows 2012 R2 Hyper-V writer adds the VM in the following format:

     For offline backups: Offline\<VMName>
     For online  backups: Online\<VMName>

    NEW NOTE: Windows group just released “Linux Integration Services Version 3.5 for Hyper-V”. The document mentions that some versions of Red Hat and CentOS are now supported to do online backup.

    Live virtual machine backup support
    ======================
    RHEL/CentOS 6.0-6.3
    RHEL/CentOS 5.7-5.8
    RHEL/CentOS 5.5-5.6

    ADDTL NOTES: If there are open file handles during a live virtual machine backup operation, the backed-up virtual hard disks (VHDs) might have to undergo a file system consistency check (fsck) when restored.

    Live backup operations can fail silently if the virtual machine has an attached iSCSI device or a physical disk that is directly attached to a virtual machine (“pass-through disk”).

    NOTE: Anyone wanting online backups on RHEL/Centos 6.4/6.5 should check out Hyper-V Backup Essentials on the LIC GitHub.

    A customer reported this installed without problems and seems to work.


  • Link
    DPM 2012 support for Windows Server 2012
    Mike Jacquet

    System Center DPM 2012 (non-Sp1) is not supported running on Windows Server 2012.  We have had reports of DPM 2012 console crashes when navigating to the recovery tab if DPM 2012 is installed on Windows server 2012.  This issue is fixed in DPM 2012 SP1, so please upgrade to fix the problem.

    We also do not support protecting Windows Server 2012 using SCS DPM 2012 )non-Sp1)   Please do not expect any support for DPM 2012 (non-sp1) running on Windows Server 2012, or issues while protecting data sources in Windows Server 2012.  This includes Hyper-V protection.



Found 936 threads
Announcement: 7

Data Protection Manager - Hyper-V and CSV Clusters announcement

  • Link
    Free ebook: Microsoft System Center Data Protection for the Hybrid Cloud
    giridharreddy

     Free ebook: Microsoft System Center Data Protection for the Hybrid Cloud

    If you are responsible for architecting and designing the backup strategy for your organization, especially if you're looking for ways to incorporate cloud backup into your business continuity scenarios, this book is for you. With the increasing trends in virtualization as well as the move to the pubic cloud, IT organizations are headed toward a world where data and applications run in on-premises private clouds as well as in the public cloud. This has key implications for data protection strategy, and it is important to choose the solution that provides the same level of data protection you have afforded so far while allowing you to harness the power of the public cloud.

  • Link
    DPM Host level backup of a VM fails with 0x800423F3 when hosting a SQL Always-on secondary db.
    Mike Jacquet

    DPM encountered a retryable VSS error. (ID 30112 Details: VssError:The writer experienced a transient error. If the backup process is retried, the error may not reoccur. (0x800423F3))"

    This is fixed in SQL Server 2012 SP2

    Bugs that are fixed in SQL Server 2012 Service Pack 2
    http://support.microsoft.com/kb/2958429

    -  DPM’s full backup on the server with AlwaysOn secondary will be converted to copy_only backup

    How to obtain the latest service pack for SQL Server 2012
    http://support.microsoft.com/kb/2755533

  • Link
    Application Log truncation does not occur after host level guest backups
    Mike Jacquet


    I would like make you aware of what seems to be change in behavior between Windows 2008 (R2)  / Windows 2012 and Windows 2012 R2 host level backups of guests.  It used to be that when a Guest was backed up by DPM when protecting Windows 2008 (R2) and Windows 2012 hosts - the Hyper-V writer would communicate with the integration components inside the guest and would consider a host level backup as being equivalent of guest level backup for application data like exchange and SQL.  This resulted in the application logs being truncated after every host level backup of the guest.  This was desirable so you didn't need two separate backups, one for the VM guest, and one for application backup to truncate the logs.  If you really wanted to prevent the logs from being truncated so you could perform separate application level backups, you needed to add a registry key to the guest and set it to a value of 1.  This is documented on the following Windows KB article.

    975925 A hotfix is available that addresses the issues that occur when you perform a host-level backup of a Hyper-V VM on a computer that is running Windows Server 2008
    http://support.microsoft.com/kb/975925/en-us


    It appears that the default behavior in Windows 2012 R2 is just the opposite and the logs do not get truncated by default when performing host level backups of guest VM's running applications like exchange and SQL.

    The solution is to add the following registry keys and value as needed inside the Guest and set it to 0 so the application logs do get truncated after host level backups.
    In Registry Editor, locate the following registry subkey:

    HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Virtualization\VssRequestor

    Create a registry entry of the REG_DWORD type.
    Set the name of the registry entry to BackupType.
    Set the value of the registry entry to 0.

  • Link
    DPM is performing "Backup Using Saved State" versus "Backup Using Child Partition" - WHY ?
    Mike Jacquet

    When DPM protects a Hyper-V guest using HOST level protection, the Hyper-V writer on the hyper-V host communicates with the integration components inside the guest and determines if child partition or saved state backup will be performed.  Once DPM adds the guest to a protection group, the description: "Backup using child partition" or "backup using saved state" will not change, even thought the condition that determines the state may change.

    To get a real-time view of how then next backup will be perfomed, you can run the following test.

    To list hyper-V writer captions for guests to see if online or saved state backups can be done:

    From an administrative command prompt:

    a. Type: copy con script.txt and press enter
     b. Type: list writers and press enter
     c. Press CTRL + Z (to save)
     d. Type: diskshadow /s script.txt | find /i "caption: backup using"

    Output will be displayed for each guest.


    Here are the general conditions that make a VM go into a saved state during backup.

    Protecting Hyper-V machines
    http://technet.microsoft.com/en-us/library/hh757866.aspx


    Conditions when DPM fails to back up Hyper-V virtual machines in an online state

    By default, System Center 2012 – Data Protection Manager (DPM) performs a backup of a Hyper-V Virtual Machine (VM) in an online state. However, DPM cannot back up a Hyper-V VM in an online state, if one or more of the following conditions are true:

    •Backup (Volume Snapshot) Integration Service is disabled or not installed.
    •The virtual machine has one or more dynamic disks.
    •The virtual machine has one or more non-NTFS based volumes.
    •The virtual machine Cluster Resource Group in a cluster setup is offline.
    •The virtual machine is not in a running state.
    •A ShadowStorage assignment of a volume inside the virtual machine is explicitly set to a different volume other than itself.
    •An App-V drive is installed on the virtual machine that creates a non-NTFS volume.

    These conditions are set by the Hyper-V writer. In such a case, the VM is put in a saved state before a snapshot of host volumes are taken (except when the VM is turned off) for a backup. The Hyper-V writer adds the VM in the following format:
    •For offline backups: Backup Using Saved State\<VMName>
    •For online backups: Backup Using Child Partition Snapshot\<VMName>

    Additional reason is if there is less than 300MB free space on a volume in the guest.


    If you are using DPM 2010/2012/2012 Sp1 to backup guests running on a Windows 2008 (R2) hyper-v server you may observe that Windows 2012 server / Windows 8 guest VM's only get the option "Backup using saved state". It is also reported that some Windows 2012 server guests transfer the whole VM during backups instead on block level changes. 

    The below resolves both of these issues.

    SOLUTION
    =======

    The Windows 8 or Windows server 2012 guest needs to have scoped VSS snapshots turned off in order to support online backups. This is a new feature apparently in Win8/2012 and the default is enabled.

    Implement this registry key on EACH Windows 8 or Windows 2012 guest to resolve the issue.  You must add a key called SystemRestore, then add a value called ScopeSnapshots as follows.

    HKLM\Software\Microsoft\Windows NT\CurrentVersion\SystemRestore
    REG_DWORD ScopeSnapshots 0x0

    See the additional info on scoped snapshots.

    http://msdn.microsoft.com/en-us/library/windows/desktop/aa378941(v=vs.85).aspx



  • Link
    Anouncement: System Center Data Protection Manager CSV Serialization Tool
    Mike Jacquet

    This tool will help serialize DPM backups across multiple Windows 2008 based hyper-v clusters in a unattended way.

    Download the tool from the below KB article.

    System Center Data Protection Manager CSV Serialization Tool
    http://www.microsoft.com/en-us/download/details.aspx?id=36524

    Overview

    With the current approach, if there are multiple clusters managed by DPM, the user needs to run DSConfig.ps1 on one node of each cluster and then XMLs of each cluster needs to be merged and replace the DataSources.xml in %ProgramFiles%\Microsoft System Center 2012\DPM\DPM\Config  directory of the DPM server. And moreover these steps need to be repeated each time any VM is added to the cluster.

    The XML merging/serialization tool will remove many of these manual steps. The tool needs to be run on the DPM server periodically (or scheduled). It will run DSconfig.ps1 on one node of each cluster, merge the XML and replace Datasources.xml in the DPM config directory. 

                                   

    System requirements

    Supported operating systems: Windows Server 2008, Windows Server 2008 R2, Windows Server 2008 R2 SP1

    For DPM: Supported operating systems: 

    • Windows Server 2008
    • Windows Server 2008 R2
    • Windows Server 2008 R2 SP1
    DPM Versions: DPM 2010 with  QFE 3 and above or  DPM 2012
    For CSV Cluster Nodes:
    Windows Server 20008 R2 & Windows Server 2008 R2 SP1
  • Link
    Windows Server 2012 R2 Hyper-V guests are placed in saved (offline) state during DPM backup.
    Mike Jacquet

    Please be aware of the following blog.

    Hyper-V Backup doesn’t interrupt running virtual machines (anymore)

    You are using DPM 2012 R2 to backup Windows Server 2012 R2 hyper-v guests and observe that some VM's only backup using "Offline" state but you want backups to be using "Online " state.

    SOLUTION
    =======
    Ensure the effected guests have a SCSI controller configured in the properties of the Hyper-V guest.   Windows Server 2012 R2 Hyper-V servers require a SCSI controller inside the guests so snapshots created as part of the backup process can be mounted.  IDE controller does not allow this hot-mount operation, so you must install a SCSI controller in the guest.


    The Windows 2012 R2 Hyper-V writer on the hyper-V host communicates with the integration components inside the guest and determines if online or offline backup will be performed.   Be sure the latest integration components are installed in each guest.

    To get a real-time view of how the next backup will be performed, you can run the following test.

    To list Windows 2012 R2 hyper-V writer captions for guests to see if online or offline state backups will be done:

    From an administrative command prompt on the Hyper-V server:

    a. Type: copy con script.txt and press enter
     b. Type: list writers and press enter
     c. Press CTRL + Z + enter (to save)
     d. Type: diskshadow /s script.txt | find /i "caption: O"


    Output will be displayed for each guest as follows.


    C:\temp>diskshadow /s script.txt | find /i "caption: O"
                            - Caption: Online\SQLSERVER
                            - Caption: Offline\WSS-V14

    The Windows 2012 R2 Hyper-V writer adds the VM in the following format:

     For offline backups: Offline\<VMName>
     For online  backups: Online\<VMName>

    NEW NOTE: Windows group just released “Linux Integration Services Version 3.5 for Hyper-V”. The document mentions that some versions of Red Hat and CentOS are now supported to do online backup.

    Live virtual machine backup support
    ======================
    RHEL/CentOS 6.0-6.3
    RHEL/CentOS 5.7-5.8
    RHEL/CentOS 5.5-5.6

    ADDTL NOTES: If there are open file handles during a live virtual machine backup operation, the backed-up virtual hard disks (VHDs) might have to undergo a file system consistency check (fsck) when restored.

    Live backup operations can fail silently if the virtual machine has an attached iSCSI device or a physical disk that is directly attached to a virtual machine (“pass-through disk”).

    NOTE: Anyone wanting online backups on RHEL/Centos 6.4/6.5 should check out Hyper-V Backup Essentials on the LIC GitHub.

    A customer reported this installed without problems and seems to work.


  • Link
    DPM 2012 support for Windows Server 2012
    Mike Jacquet

    System Center DPM 2012 (non-Sp1) is not supported running on Windows Server 2012.  We have had reports of DPM 2012 console crashes when navigating to the recovery tab if DPM 2012 is installed on Windows server 2012.  This issue is fixed in DPM 2012 SP1, so please upgrade to fix the problem.

    We also do not support protecting Windows Server 2012 using SCS DPM 2012 )non-Sp1)   Please do not expect any support for DPM 2012 (non-sp1) running on Windows Server 2012, or issues while protecting data sources in Windows Server 2012.  This includes Hyper-V protection.