none
Using RDP to DPM server causes persistent VDS error RRS feed

  • Question

  • I am experiencing a repeatable error when using RDP to connect to my DPM 2010 server and perform activities via the DPM console. Here is the scenario:

    1) Connect to the DPM server using remote desktop

    2) Open the DPM management console on that server

    3) Select a member of a protection group

    4) From context menu, select “Stop protection of member”

    4) Select “Delete replica on disk” check box in dialog and click OK

    Rather than deleting the member entirely, it is moved to Inactive protection for previously protected data. Attempting to delete the replica from disk results in the following error:

    Removing G:\ failed:

    Error 360: The operation failed due to a virtual disk service error

    Error details: Server execution failed

    Recommended action: Retry the operation

    At this point any operation on the DPM server involving VDS will fail and DPM is hosed.  Reboot and log on locally to DPM server – the problem persists. Reinstall everything on the DPM server (DPM/SQL Server) recreate protection groups –everything fine. Perform the operation described at beginning of post -  hosed again.

    This reminds me of the joke, Patient: “Doctor, my arm hurts when I hold it over my head, what should I do? Doctor: “Don’t hold your arm over your head” .  Still,  I’m hoping there is another solution to this problem.

    The MSDPMCurr.errlog reports the following:

    NORMAL            OnStartAsync - Initializing MSDPM

    0538     0C88     02/01    17:22:35.207     09         servicemodule.cpp(426)                          NORMAL            CServiceModule::InitializeSecurity

    0538     0C88     02/01    17:22:35.326     09         servicemodule.cpp(340)                          NORMAL            CServiceModule::Initialize

    0538     0C88     02/01    17:22:35.540     09         servicemodule.cpp(150)                          NORMAL            CServiceModule::DoStartupValidation

    0538     0C88     02/01    17:22:35.785     12         NotificationManager.cs(180)                                NORMAL            InitializeServerSide: notifications are type=Warning, Critical, email='hzelizer@xxx.com'

    0538     0C88     02/01    17:22:36.132     16         jobmanagerservices.cpp(39)                               NORMAL            CJobManagerServices::Initialize(void)

    0538     0C88     02/01    17:22:36.134     16         JobManager.cs(302)                               NORMAL            JobManager::Init()

    0538     113C     02/01    17:22:36.150     16         JobManager.cs(159)                               NORMAL            Initializing job manager.

    0538     0C88     02/01    17:22:36.174     09         servicemodule.cpp(623)                          NORMAL            CoRegisterClassObject successful.

    0538     113C     02/01    17:22:36.205     28         MMHealthProvider.cs(66)                         NORMAL            MMHealthProvider: LibrarySharingModeCheckInterval = 1200000 ms

    0538     113C     02/01    17:22:36.206     16         JobManager.cs(189)                               NORMAL            Calling initialize on health provider: Microsoft.Internal.EnterpriseStorage.Dls.MM.LibraryTE.HealthProvider.MMHealthProvider,  Microsoft.EnterpriseStorage.Dls.MediaManager, Version=1.0.523.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35, Custom=null

    0538     113C     02/01    17:22:36.234     28         MMCatalog.cs(318)                                 NORMAL            Updating LibrarySharing Mode At Startup

    0538     113C     02/01    17:22:36.250     28         MMCatalog.cs(332)                                 NORMAL            Updating LibrarySharingMode At Startup done. LibrarySharingMode = None

    0538     113C     02/01    17:22:36.600     28         MMHealthProvider.cs(93)                         NORMAL            MMHealthProvider Initialize() Finished

    0538     113C     02/01    17:22:36.602     16         JobManager.cs(189)                               NORMAL            Calling initialize on health provider: Microsoft.EnterpriseStorage.Dls.HealthProvider.NewAlertHealthProvider.AlertHP,  AlertHealthProvider, Version=1.0.523.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35, Custom=null

    0538     113C     02/01    17:22:36.997     16         JobManager.cs(189)                               NORMAL            Calling initialize on health provider: Microsoft.Internal.EnterpriseStorage.Dls.Intent.IT.IntentHealthProvider, INTENTTRANSLATOR, Version=1.0.523.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35, Custom=null

    0538     06B0     02/01    17:22:37.000     17         IntentTranslator.cs(128)                         NORMAL            Starting Intent Restart

    0538     113C     02/01    17:22:37.054     16         AutoHealProxyUtil.cs(62)                         NORMAL            Calling DpmStarted() WCF API AutoHealService

    0538     11A0     02/01    17:22:37.084     09         coreservices.cpp(5453)                           NORMAL            CCoreServices::CheckForPendingReboot() entered

    0538     11A0     02/01    17:22:37.116     16         engineservices.cpp(185)                         NORMAL            CEngineServices::CheckForPendingReboot entered

    0538     11A0     02/01    17:22:37.119     16         engineservices.cpp(197)                         WARNING          Failed: Hr: = [0x80070002] : F: lVal : (UINT)RegOpenKeyExW((( HKEY ) (ULONG_PTR)((LONG)0x80000002) ), (LPCWSTR)rebootregkey, 0, ((((0x00020000L)) | (0x0001) | (0x0008) | (0x0010)) & (~(0x00100000L))), &key)

    0538     11A0     02/01    17:22:37.260     09         coreservices.cpp(7061)                           NORMAL            CCoreServices::AMStarted() entered

    0538     11A0     02/01    17:22:37.261     16         engineservices.cpp(371)                         NORMAL            CEngineServices::AMStarted entered

    0538     11A0     02/01    17:22:37.320     16         engineservices.cpp(377)                         NORMAL            CEngineServices::AMStarted returned

    0538     113C     02/01    17:22:37.339     16         JobDB.cs(317)                           NORMAL            JobDB::ProcessActiveJobs()

    0538     13F0     02/01    17:22:40.107     09         MsdpmService.cs(133)                            NORMAL            Finished startup processing for MSDPM service

    0538     06B0     02/01    17:24:58.870     11         spmexceptions.cpp(82)                           WARNING          Failed: Hr: = [0x80080005] CoCreateInstance failed due to Unknown error.

    0538     06B0     02/01    17:24:58.876     11         storagepoolmanager.cpp(2276)                           WARNING          Internal Refresh: VdsInitialize failed

    0538     06B0     02/01    17:24:58.894     13         ReplicaAreaSetManager.cs(1587)                         WARNING          Rhl Refresh: SPM Refresh failed

    0538     06B0     02/01    17:25:00.522     14         replicavssrequestor.cpp(1208)                             WARNING          Replica e7b3853e-d622-4039-8e27-7339d2aa1786 error: ShadowCopy association between \\?\Volume{894d3c77-2963-11e0-be8b-001fe25ccc8c}\ and \\?\Volume{894d3c7d-2963-11e0-be8b-001fe25ccc8c}\ volumes doesn't exist.

    0538     06B0     02/01    17:25:00.535     02         EventManager.cs(88)                              NORMAL            Publishing event from ShadowCopy.cs(428): ShadowCopyValidityChanged, [ShadowCopyId=00000000-0000-0000-0000-000000000000]

    0538     06B0     02/01    17:25:00.597     11         storagepoolmanager.cpp(744)                             NORMAL            DeallocateVolumes started [5ca295fb-4e76-43e2-b643-64f2d1c163c2]

    0538     06B0     02/01    17:27:28.975     11         spmexceptions.cpp(82)                           WARNING          Failed: Hr: = [0x80080005] CoCreateInstance failed due to Unknown error.

    0538     06B0     02/01    17:27:28.976     11         storagepoolmanager.cpp(2276)                           WARNING          Internal Refresh: VdsInitialize failed

    0538     06B0     02/01    17:27:29.008     08         DpmThreadPool.cs(121)                          WARNING          Caught unhandled exception : Microsoft.Internal.EnterpriseStorage.Dls.Utils.VdsException: Failed: Hr: = [0x80080005] CoCreateInstance failed due to Unknown error.

    0538     06B0     02/01    17:27:29.008     08         DpmThreadPool.cs(121)                          WARNING             at Microsoft.Internal.EnterpriseStorage.Dls.Rhl.ReplicaAreaSetManagerHelper.Deallocate(List`1 datasourcesOnReplica, Boolean deallocateInactiveReplicaOnly)

    0538     06B0     02/01    17:27:29.008     08         DpmThreadPool.cs(121)                          WARNING             at Microsoft.Internal.EnterpriseStorage.Dls.Rhl.ReplicaAreaSetManager.Deallocate(List`1 datasourcesOnReplica)

    0538     06B0     02/01    17:27:29.008     08         DpmThreadPool.cs(121)                          WARNING             at Microsoft.Internal.EnterpriseStorage.Dls.Intent.IT.IntentManager.RefreshForDeallocationScenario(IMCatalogDB imCatalog, DataSourceTranslationStatus dataSourceStatus)

    0538     06B0     02/01    17:27:29.008     08         DpmThreadPool.cs(121)                          WARNING             at Microsoft.Internal.EnterpriseStorage.Dls.Intent.IT.IntentManager.Refresh()

    0538     06B0     02/01    17:27:29.008     08         DpmThreadPool.cs(121)                          WARNING             at Microsoft.Internal.EnterpriseStorage.Dls.Intent.IT.IntentTranslator.IntentRestart()

    0538     06B0     02/01    17:27:29.008     08         DpmThreadPool.cs(121)                          WARNING             at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)

    0538     06B0     02/01    17:27:29.008     08         DpmThreadPool.cs(121)                          WARNING             at System.Threading.ThreadHelper.ThreadStart()

    0538     06B0     02/01    17:27:29.008     08         DpmThreadPool.cs(121)                          WARNING          *** Mojito error was: VdsError; -2146959355; WindowsAPI

    0538     06B0     02/01    17:27:29.017     08         DpmThreadPool.cs(149)                          WARNING          Attempting to write error to the event log Failed: Hr: = [0x80080005] CoCreateInstance failed due to Unknown error.

    0538     06B0     02/01    17:27:29.026     02         EventManager.cs(133)                            NORMAL            Logging event to NT log from DpmThreadPool.cs(163): FatalServiceError

    0538     06B0     02/01    17:27:29.173     08         DpmThreadPool.cs(170)                          WARNING          Attempting to invoke Watson

    0538     06B0     02/01    17:27:29.193     09         everettexception.cpp(761)                                  CRITICAL          Exception Message = Failed: Hr: = [0x80080005] CoCreateInstance failed due to Unknown error.

    0538     06B0     02/01    17:27:29.193     09         everettexception.cpp(761)                                  CRITICAL          of type Microsoft.Internal.EnterpriseStorage.Dls.Utils.VdsException, process will terminate after generating dump

    10E0     12A8     02/01    17:27:35.492     09         MsdpmService.cs(237)                            NORMAL            OnStartAsync - Initializing MSDPM

     

    Tuesday, February 1, 2011 6:25 PM

Answers

  • Howard,

    I recommend you contact Product Support and open up a support ticket. Someone is probably going to have to do some crashdump analysis to find out what is causing this. It is pretty unusual since so many customers use RDP access to their DPM servers and I have not heard of any other reports of this.

    Thanks,

    Marc

     

    • Marked as answer by hzelizer Friday, February 4, 2011 9:22 PM
    Friday, February 4, 2011 9:16 PM
    Moderator

All replies

  • I use RDP all the time with the DPM servers I manage. In fact it's the only way I interact with them.  I have no problems at all.
    Wednesday, February 2, 2011 6:21 PM
  • Yes, I have used RDP in the past with no problems. This problem first occurred 2 weeks ago.  I didn't make any configuration changes, so I'm at a loss to explain the cause of this unwelcome behavour.

    As I stated in the original post, the problem is persistent and can be replicated, even after uninstalling and reinstalling DPM. Not sure how to proceed from here, other than not using RDP to connect to the DPM server (very inconvenient).

    - Howard

    Wednesday, February 2, 2011 6:55 PM
  • Howard,

    I recommend you contact Product Support and open up a support ticket. Someone is probably going to have to do some crashdump analysis to find out what is causing this. It is pretty unusual since so many customers use RDP access to their DPM servers and I have not heard of any other reports of this.

    Thanks,

    Marc

     

    • Marked as answer by hzelizer Friday, February 4, 2011 9:22 PM
    Friday, February 4, 2011 9:16 PM
    Moderator
  • Howard,

     

    We are having the same problem, did you manage to get anywhere or find any solutions? It only happens on one of our DPM servers and not the other.

     

    CS

    Monday, February 7, 2011 11:48 PM
  • Hi,

    No, I haven't found a solution. I've been going through all the server logs trying to find the root cause. On the face of it, it looks like a permissions issue, the fact that it persists even when logging on locally leads me to believe the DPM DB ends up getting corrupted. I'll definitely post here if I find a way to correct the problem, hope you'll do the same.

    - Howard

    Tuesday, February 8, 2011 1:00 AM