none
DPM2012:Can't backup SQL cluster RRS feed

  • Question

  • Hello

    I have three node SQL cluster (server 2008 r2 sp1, sql 2008 r2), when I try to make the protection group in DPM 2012 it take a long time to populate the inquiry screen. And after I had created protection group and start backup i've got this error: DPM failed to communicate with the protection agent on xxxx.xxx.local because the agent is not responding. (ID 43 Details: Internal error code: 0x8099090E)

    I can't backup not only SQL databases, I can't backup non cluster recourses (for example some folder on disk C:\) also.

    I'm try to reinstall agent manually, verify lan connection between dpm server and cluster (try to connect on port 5718, all work fine). Try to disable chimney offload. Nothing can't help me.

    In DPM error log i'm see this:

    2D40	17A8	04/26	07:38:10.511	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	Subtask failure, sending status response XML=[<?xml version="1.0"?>
    2D40	17A8	04/26	07:38:10.511	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	<Status xmlns="http://schemas.microsoft.com/2003/dls/StatusMessages.xsd" StatusCode="-2137454160" Reason="Error" CommandID="RACancelAllSubTasks" CommandInstanceID="ecc677a8-a2e2-4a29-a696-300edea156a5" GuidWorkItem="30180579-db6b-4963-a25a-b4f357bd2a9e" TETaskInstanceID="9bc7c5d0-5fcb-4b2b-8da3-4059ef6a5617"><ErrorInfo xmlns="http://schemas.microsoft.com/2003/dls/GenericAgentStatus.xsd" ErrorCode="536872913" DetailedCode="-2137454160" DetailedSource="2"><Parameter Name="AgentTargetServer" Value="uk-clu02-3.2gis.local"/></ErrorInfo></Status>
    2D40	17A8	04/26	07:38:10.511	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	]
    2D40	17A8	04/26	07:38:10.511	29	radefaultsubtask.cpp(382)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : CRADefaultSubTask: WorkitemID does not exist, {30180579-DB6B-4963-A25A-B4F357BD2A9E}
    2D40	17A8	04/26	07:38:10.511	05	defaultsubtask.cpp(546)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : Encountered Failure: : lVal : CommandReceivedSpecific(pCommand, pOvl)
    2D40	17A8	04/26	07:38:10.511	05	defaultsubtask.cpp(751)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : Encountered Failure: : lVal : CommandReceived(pAgentOvl)
    2D40	17A8	04/26	07:38:10.558	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	Subtask failure, sending status response XML=[<?xml version="1.0"?>
    2D40	17A8	04/26	07:38:10.558	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	<Status xmlns="http://schemas.microsoft.com/2003/dls/StatusMessages.xsd" StatusCode="-2137454160" Reason="Error" CommandID="RAPostBackup" CommandInstanceID="cb84ff14-e999-4c55-8a66-167026492408" GuidWorkItem="30180579-db6b-4963-a25a-b4f357bd2a9e" TETaskInstanceID="9bc7c5d0-5fcb-4b2b-8da3-4059ef6a5617"><ErrorInfo xmlns="http://schemas.microsoft.com/2003/dls/GenericAgentStatus.xsd" ErrorCode="536872913" DetailedCode="-2137454160" DetailedSource="2"><Parameter Name="AgentTargetServer" Value="uk-clu02-3.2gis.local"/></ErrorInfo></Status>
    2D40	17A8	04/26	07:38:10.558	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	]
    2D40	17A8	04/26	07:38:10.558	29	radefaultsubtask.cpp(382)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : CRADefaultSubTask: WorkitemID does not exist, {30180579-DB6B-4963-A25A-B4F357BD2A9E}
    2D40	17A8	04/26	07:38:10.558	05	defaultsubtask.cpp(546)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : Encountered Failure: : lVal : CommandReceivedSpecific(pCommand, pOvl)
    2D40	17A8	04/26	07:38:10.558	05	defaultsubtask.cpp(751)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : Encountered Failure: : lVal : CommandReceived(pAgentOvl)
    2D40	17A8	04/26	07:38:10.589	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	Subtask failure, sending status response XML=[<?xml version="1.0"?>
    2D40	17A8	04/26	07:38:10.589	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	<Status xmlns="http://schemas.microsoft.com/2003/dls/StatusMessages.xsd" StatusCode="-2137454160" Reason="Error" CommandID="RADeleteBitMap" CommandInstanceID="6b1643c2-b96f-437f-b718-ad67da01548d" GuidWorkItem="30180579-db6b-4963-a25a-b4f357bd2a9e" TETaskInstanceID="9bc7c5d0-5fcb-4b2b-8da3-4059ef6a5617"><ErrorInfo xmlns="http://schemas.microsoft.com/2003/dls/GenericAgentStatus.xsd" ErrorCode="536872913" DetailedCode="-2137454160" DetailedSource="2"><Parameter Name="AgentTargetServer" Value="uk-clu02-3.2gis.local"/></ErrorInfo></Status>
    2D40	17A8	04/26	07:38:10.589	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	]
    2D40	17A8	04/26	07:38:10.589	29	radefaultsubtask.cpp(382)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : CRADefaultSubTask: WorkitemID does not exist, {30180579-DB6B-4963-A25A-B4F357BD2A9E}
    2D40	17A8	04/26	07:38:10.589	05	defaultsubtask.cpp(546)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : Encountered Failure: : lVal : CommandReceivedSpecific(pCommand, pOvl)
    2D40	17A8	04/26	07:38:10.589	05	defaultsubtask.cpp(751)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : Encountered Failure: : lVal : CommandReceived(pAgentOvl)
    2D40	17A8	04/26	07:38:10.683	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	Subtask failure, sending status response XML=[<?xml version="1.0"?>
    2D40	17A8	04/26	07:38:10.683	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	<Status xmlns="http://schemas.microsoft.com/2003/dls/StatusMessages.xsd" StatusCode="-2137454160" Reason="Error" CommandID="RACancelAllSubTasks" CommandInstanceID="b7c68a0a-0235-4c47-a520-7caeea7323cd" GuidWorkItem="30180579-db6b-4963-a25a-b4f357bd2a9e" TETaskInstanceID="9bc7c5d0-5fcb-4b2b-8da3-4059ef6a5617"><ErrorInfo xmlns="http://schemas.microsoft.com/2003/dls/GenericAgentStatus.xsd" ErrorCode="536872913" DetailedCode="-2137454160" DetailedSource="2"><Parameter Name="AgentTargetServer" Value="uk-clu02-3.2gis.local"/></ErrorInfo></Status>
    2D40	17A8	04/26	07:38:10.683	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	]
    2D40	17A8	04/26	07:38:10.683	29	radefaultsubtask.cpp(382)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : CRADefaultSubTask: WorkitemID does not exist, {30180579-DB6B-4963-A25A-B4F357BD2A9E}
    2D40	17A8	04/26	07:38:10.683	05	defaultsubtask.cpp(546)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : Encountered Failure: : lVal : CommandReceivedSpecific(pCommand, pOvl)
    2D40	17A8	04/26	07:38:10.683	05	defaultsubtask.cpp(751)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : Encountered Failure: : lVal : CommandReceived(pAgentOvl)
    2D40	17A8	04/26	07:38:11.166	29	radefaultsubtask.cpp(270)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	CRADefaultSubTask: WorkitemID to delete does not exist, {30180579-DB6B-4963-A25A-B4F357BD2A9E}
    2D40	17A8	04/26	07:38:11.166	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	Subtask failure, sending status response XML=[<?xml version="1.0"?>
    2D40	17A8	04/26	07:38:11.166	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	<Status xmlns="http://schemas.microsoft.com/2003/dls/StatusMessages.xsd" StatusCode="-2137454160" Reason="Error" CommandID="RADeleteWorkItem" CommandInstanceID="2d9471ce-6b59-41cd-8aa2-c31d2c60981f" GuidWorkItem="30180579-db6b-4963-a25a-b4f357bd2a9e" TETaskInstanceID="9bc7c5d0-5fcb-4b2b-8da3-4059ef6a5617"><ErrorInfo xmlns="http://schemas.microsoft.com/2003/dls/GenericAgentStatus.xsd" ErrorCode="536872913" DetailedCode="-2137454160" DetailedSource="2"><Parameter Name="AgentTargetServer" Value="uk-clu02-3.2gis.local"/></ErrorInfo></Status>
    2D40	17A8	04/26	07:38:11.166	03	runtime.cpp(1389)	[000000000044C9E0]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	FATAL	]
    2D40	17A8	04/26	07:38:11.166	29	radefaultsubtask.cpp(271)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : Encountered Failure: : lVal : (HRESULT)0x809909B0
    2D40	17A8	04/26	07:38:11.166	05	defaultsubtask.cpp(546)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : Encountered Failure: : lVal : CommandReceivedSpecific(pCommand, pOvl)
    2D40	17A8	04/26	07:38:11.166	05	defaultsubtask.cpp(751)	[00000000017DE400]	9BC7C5D0-5FCB-4B2B-8DA3-4059EF6A5617	WARNING	Failed: Hr: = [0x809909b0] : Encountered Failure: : lVal : CommandReceived(pAgentOvl)
    2D40	3318	04/26	07:40:47.526	29	radefaultsubtask.cpp(363)	[00000000017DE400]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	ACTIVITY	CRADefaultSubTask::CommandReceivedSpecific => Command SetActiveOwner Received
    2D40	3318	04/26	07:40:47.573	03	workitem.cpp(86)	[000000000044AD00]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	ACTIVITY	Idle Timer created with timeout = 390000
    2D40	3318	04/26	07:40:47.620	31	vadatasourcestate.cpp(747)		B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x8007007e] GetModuleHandle failed for Library [FileWriterHelperPlugin], will try LoadLibrary
    0000	3318	04/26	07:40:47.620	00	fsutils.cpp(4576)		B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	NORMAL	CClientReadThrottler::InitializeWaitForClientRead Failed to read sleep time from registry [hr = 0x17da500]. Setting default [50 ms].
    2D40	3318	04/26	07:40:47.620	31	dllmain.cpp(36)		B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	NORMAL	FileWriterHelperPlugin: DLL_PROCESS_ATTACH
    2D40	3318	04/26	07:40:47.620	31	filterwrapper.cpp(48)	[000000000227F1C0]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	NORMAL	Loaded FilterWrapper.dll
    2D40	3318	04/26	07:40:47.666	31	vssbaserequestor.cpp(51)	[00000000017E75B0]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	NORMAL	CVssBaseRequestor: constructor [00000000017E75B0]
    2D40	3318	04/26	07:40:47.666	31	vsssnapshotrequestor.cpp(89)	[00000000017E75B0]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	NORMAL	CVssSnapshotRequestor::CVssSnapshotRequestor [00000000017E75B0]
    2D40	3318	04/26	07:40:47.666	31	vssbaserequestor.cpp(88)	[00000000017E75B0]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	NORMAL	CVssBaseRequestor::Initialize [00000000017E75B0]
    2D40	3318	04/26	07:40:47.666	31	vsssnapshotrequestor.cpp(183)	[00000000017E75B0]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	NORMAL	CVssSnapshotRequestor::InitializeSnapshotCreation [00000000017E75B0]
    2D40	3318	04/26	07:40:47.682	03	miscellaneousutils.cpp(668)		B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x80070002] Could not open HKEY_LOCAL_MACHINE\Software\Microsoft\Microsoft Data Protection Manager\Agent\2.0
    2D40	3318	04/26	07:40:47.682	31	vsssnapshotrequestor.cpp(389)	[00000000017E75B0]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	NORMAL	CVssSnapshotRequestor::AddVolumeForSnapshot [00000000017E75B0]
    2D40	3318	04/26	07:40:47.698	03	clusterutil.cpp(1760)		B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	ClusterResourceTypeOpenEnum failed for resource type Volume Manager Disk Group with windows error 5078
    2D40	3318	04/26	07:40:47.698	03	clusterutil.cpp(1760)		B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	ClusterResourceTypeOpenEnum failed for resource type GeoCluster Replicated Disk with windows error 5078
    2D40	3318	04/26	07:41:05.887	03	clusterutil.cpp(2699)	[000000000227EE00]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x80070002] GetVolumeNameForVolumeMountPoint failed for [J:\]
    2D40	3318	04/26	07:41:24.592	03	clusterutil.cpp(2699)	[000000000227EE00]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x80070002] GetVolumeNameForVolumeMountPoint failed for [K:\]
    2D40	3318	04/26	07:41:43.078	03	clusterutil.cpp(2699)	[000000000227EE00]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x80070002] GetVolumeNameForVolumeMountPoint failed for [N:\]
    2D40	3318	04/26	07:42:03.717	03	clusterutil.cpp(2699)	[000000000227EE00]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x80070002] GetVolumeNameForVolumeMountPoint failed for [G:\]
    2D40	3318	04/26	07:42:22.905	03	clusterutil.cpp(2699)	[000000000227EE00]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x80070002] GetVolumeNameForVolumeMountPoint failed for [O:\]
    2D40	3318	04/26	07:42:41.547	03	clusterutil.cpp(2699)	[000000000227EE00]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x80070002] GetVolumeNameForVolumeMountPoint failed for [L:\]
    2D40	3318	04/26	07:42:59.877	03	clusterutil.cpp(2699)	[000000000227EE00]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x80070002] GetVolumeNameForVolumeMountPoint failed for [T:\]
    2D40	3318	04/26	07:43:18.488	03	clusterutil.cpp(2699)	[000000000227EE00]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x80070002] GetVolumeNameForVolumeMountPoint failed for [H:\]
    2D40	3318	04/26	07:43:36.522	03	clusterutil.cpp(2699)	[000000000227EE00]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x80070002] GetVolumeNameForVolumeMountPoint failed for [Q:\]
    2D40	3318	04/26	07:43:36.522	03	clusterutil.cpp(2699)	[000000000227EE00]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x80070002] GetVolumeNameForVolumeMountPoint failed for [D:\]
    2D40	3318	04/26	07:43:54.571	03	clusterutil.cpp(2699)	[000000000227EE00]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x80070002] GetVolumeNameForVolumeMountPoint failed for [E:\]
    2D40	3318	04/26	07:43:54.571	03	clusterutil.cpp(2149)	[000000000227EE00]	B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	WARNING	Failed: Hr: = [0x8007001f] Either the volume \\?\Volume{8e0b7129-c74a-4069-ac22-595006dec460}\ is offline or the volume is not a clustered disk.
    2D40	3318	04/26	07:43:54.571	31	vsssnapshotrequestor.cpp(421)		B2E912B1-2FA5-4EE7-BD32-317DD1D8AA43	NORMAL	ssLocalVolumeGuid = [\\?\Volume{8e0b7129-c74a-4069-ac22-595006dec460}\], ssClusterVolGuid=[\\?\Volume{8e0b7129-c74a-4069-ac22-595006dec460}\]
    

    Thursday, April 26, 2012 8:49 AM

All replies

  • Hi there,

    Check the windows firewall on all cluster nodes and also verify if User Account Control is enabled. Although both of these will work fine with DPM, I'd temporarily disable them on all cluster nodes to see if either of them are causing the problem. If it works with them both disabled, then re-enable UAC first and try again. If the problem returns, then you know it's a UAC issue, if it doesn't, then re-enable WIndows Firewall and try again to try to isolate the issue.

    Once you know where to look for the problem, then it will be easier to resolve.

    Also, check out this post in relation to a strange issue with the SQL collation settings on your SQL cluster:

    http://social.technet.microsoft.com/Forums/en-US/dpmsqlbackup/thread/9a51c938-0bd0-4be0-b9e1-e016cbebc217

    Although it seems like a different issue to what you are experiencing, it's worth verifying too.

    Hope this helps,

    Kevin.

    Tuesday, May 1, 2012 11:17 AM
  • Thanks for your reply.
    As you wrote I try to disable UAC and check that Windows Firewall is off, but that didn't help me.
    Thursday, May 3, 2012 8:52 AM
  • Hi Ivan,

    From reading your error logs, it seems that the DPM server has an issue reading the cluster volumes on your SQL cluster. I know you have said that you tried to backup just the C drive on the cluster but it didn't work however, have you tried to create a new protection group with just the C drive or some files and folders from the C drive on one of the cluster nodes in it to see if that backs up? If it does backup a new protection group with only files or folders from a local disk on a cluster node, then it seems like it may be permissions on the cluster drives with the DPM server.

    Also, have another look at the link I provided previously. The guys on that thread were having a problem backing up an SQL cluster with DPM 2012 and it turns out it is a bug that needs a hotfix from Microsoft to resolve. You may well need to log a support case with them in case it's a bug.

    Here's the link again:

    http://social.technet.microsoft.com/Forums/en-US/dpmsqlbackup/thread/9a51c938-0bd0-4be0-b9e1-e016cbebc217

    Finally, as a last resort before you call Microsoft, make sure that all of your SQL servers are up to date with the latest service packs and rollups. This can certainly help with any bugs or incompatibility issues and would most likely be a request of Microsoft anyway before they will look at the issue themselves.

    Kevin.

    Thursday, May 3, 2012 12:32 PM