none
DPM keeps failing, inconsistent RRS feed

  • Question

  • Hey guys,

    I'm having a problem with DPM which I cannot resolve somehow.

    Error message:

    Affected area: G:\
    Occurred since: 1/24/2012 4:46:52 PM
    Description: The replica of Volume G:\ on xxx.xxxx-x.xxx is inconsistent with the protected data source. All protection activities for data source will fail until the replica is synchronized with consistency check. You can recover data from existing recovery points, but new recovery points cannot be created until the replica is consistent.

    For SharePoint farm, recovery points will continue getting created with the databases that are consistent. To backup inconsistent databases, run a consistency check on the farm. (ID 3106)
     The operation failed because DPM failed to access the shadow copy on xxx.xxxx-x.xxx . This could be due to
    1) Cluster failover during backup or
    2) Inadequate disk space on the volume. (ID 33140 Details: Internal error code: 0x80990A59)
     More information
    Recommended action: If cluster failover has happened during backup, please retry the operation. Otherwise, increase the amount of free space on volume on the source server and then retry the operation.
     Synchronize with consistency check.
     Run a synchronization job with consistency check...
    Resolution: To dismiss the alert, click below
     Inactivate alert

    Its backup up a server which has 2 harddrives installed.

    Source:

    C: drive is being backed up OK

    G: drive 3.31TB Free of 5.39TB

    Destination (DPM)

    5.3 GB Allocated.

    So this shouldn't be a free space issue, but i'm not sure what the problem is. I've created Shadow Copies on the G drive manually just to check. Not helping either.

    Connection between DPM and Server is OK.

    Any tips are welcome!

    Modivion

    Wednesday, January 25, 2012 10:53 PM

Answers

  • Ok!! So you just started another CC after that?
    Thanks, Wilson Souza - MSFT This posting is provided "AS IS" with no warranties, and confers no rights
    • Marked as answer by Modivion Saturday, January 28, 2012 11:08 AM
    Thursday, January 26, 2012 10:19 AM
  • I'm sorry.

     

    Microsoft Windows [Version 6.1.7601]

    Copyright (c) 2009 Microsoft Corporation.  All rights reserved.

     

    C:\Users\xxxxx>vssadmin list shadowstorage

    vssadmin 1.1 - Volume Shadow Copy Service administrative command-line tool

    (C) Copyright 2001-2005 Microsoft Corp.

     

    Shadow Copy Storage association

       For volume: (\\?\Volume{2572ac4d-4514-11e1-935f-001b21c96aae}\)\\?\Volume{257

    2ac4d-4514-11e1-935f-001b21c96aae}\

       Shadow Copy Storage volume: (\\?\Volume{2572ac4d-4514-11e1-935f-001b21c96aae}

    \)\\?\Volume{2572ac4d-4514-11e1-935f-001b21c96aae}\

       Used Shadow Copy Storage space: 3.14 GB (1%)

       Allocated Shadow Copy Storage space: 6.065 GB (2%)

       Maximum Shadow Copy Storage space: UNBOUNDED (100%)

     

    Shadow Copy Storage association

       For volume: (\\?\Volume{d4b94094-30bd-11e1-8f05-001b21c96aae}\)\\?\Volume{d4b

    94094-30bd-11e1-8f05-001b21c96aae}\

       Shadow Copy Storage volume: (\\?\Volume{d4b94094-30bd-11e1-8f05-001b21c96aae}

    \)\\?\Volume{d4b94094-30bd-11e1-8f05-001b21c96aae}\

       Used Shadow Copy Storage space: 560 KB (0%)

       Allocated Shadow Copy Storage space: 32 MB (32%)

       Maximum Shadow Copy Storage space: 32 MB (32%)

     

    Shadow Copy Storage association

       For volume: (C:)\\?\Volume{d4b94095-30bd-11e1-8f05-001b21c96aae}\

       Shadow Copy Storage volume: (C:)\\?\Volume{d4b94095-30bd-11e1-8f05-001b21c96a

    ae}\

       Used Shadow Copy Storage space: 3.713 GB (6%)

       Allocated Shadow Copy Storage space: 4.024 GB (6%)

       Maximum Shadow Copy Storage space: 6 GB (10%)

     

    Shadow Copy Storage association

       For volume: (G:)\\?\Volume{2572ac15-4514-11e1-935f-001b21c96aae}\

       Shadow Copy Storage volume: (G:)\\?\Volume{2572ac15-4514-11e1-935f-001b21c96a

    ae}\

       Used Shadow Copy Storage space: 164.141 MB (0%)

       Allocated Shadow Copy Storage space: 3.005 GB (0%)

       Maximum Shadow Copy Storage space: UNBOUNDED (310725590%)

     

     

    I just configured the Shadow Copy on the G drive to not use a limit for testing purpose.

    • Marked as answer by Modivion Saturday, January 28, 2012 11:08 AM
    Thursday, January 26, 2012 10:16 AM

All replies

  • Can you post the failed job details that shows up under monitoring/jobs?
    Thanks, Wilson Souza - MSFT This posting is provided "AS IS" with no warranties, and confers no rights
    Wednesday, January 25, 2012 11:00 PM
  • There is nothing when the job failed. It is just empty.

    When I rerun the job it's showing this: 

     

    Type: Consistency check

    Status: In progress

    End time: -

    Start time: 1/26/2012 12:51:56 AM

    Time elapsed: 00:01:14

    Data transferred: 3.51 MB

    Cluster node -

    Source details: G:\

    Protection group members: 7

    Details

    Protection group: Servers

    Items scanned: 111

    Items fixed: 0

    Wednesday, January 25, 2012 11:53 PM
  • That one was still in progress (check the Status line). You need to wait it to complete...


    Thanks, Wilson Souza - MSFT This posting is provided "AS IS" with no warranties, and confers no rights
    Thursday, January 26, 2012 1:28 AM
  • Yes, that's because I ran the consistency check, which fails everytime.

     

    Type: Consistency check

    Status: Failed

    Description: The operation failed because DPM failed to access the shadow copy on xxx.xxxx-x.xxx. This could be due to

    1) Cluster failover during backup or

    2) Inadequate disk space on the volume. (ID 33140 Details: Internal error code: 0x80990A59)

     More information

    End time: 1/26/2012 10:53:40 AM

    Start time: 1/26/2012 10:26:02 AM

    Time elapsed: 00:27:38

    Data transferred: 41,024.20 MB

    Cluster node -

    Source details: G:\

    Protection group members: 7

     Details

    Protection group: Servers

    Items scanned: 700

    Items fixed: 10

    Thanks!

     


    • Edited by Modivion Thursday, January 26, 2012 10:02 AM
    Thursday, January 26, 2012 9:59 AM
  • At the time of the error can you check if there are errors in application/system log from that protected server?


    Thanks, Wilson Souza - MSFT This posting is provided "AS IS" with no warranties, and confers no rights
    Thursday, January 26, 2012 10:02 AM
  • Windows Logs - Application shows no errors at all.

    Under Administrative events I did found this: 

    The shadow copies of volume G: were aborted because the shadow copy storage could not grow due to a user imposed limit.

    Could this be the problem?

    Thursday, January 26, 2012 10:08 AM
  • Run this command on the protected server:

    vssadmin list shadowstorage


    Thanks, Wilson Souza - MSFT This posting is provided "AS IS" with no warranties, and confers no rights
    Thursday, January 26, 2012 10:10 AM
  • Microsoft Windows [Version 6.1.7601]
    Copyright (c) 2009 Microsoft Corporation.  All rights reserved.
    C:\Users\xxxx>vssadmin list shadowstorage
    vssadmin 1.1 - Volume Shadow Copy Service administrative command-line tool
    (C) Copyright 2001-2005 Microsoft Corp.
    Shadow Copy Storage association
       For volume: (C:\Program Files\Microsoft DPM\DPM\Volumes\Replica\File System\v
    ol_827abb16-9d8f-40b5-96f7-8f67d375244b\)\\?\Volume{4de5298a-4549-11e1-be73-441e
    a13b771a}\
       Shadow Copy Storage volume: (C:\Program Files\Microsoft DPM\DPM\Volumes\DiffA
    rea\File System\vol_827abb16-9d8f-40b5-96f7-8f67d375244b\)\\?\Volume{4de52990-45
    49-11e1-be73-441ea13b771a}\
       Used Shadow Copy Storage space: 45.813 MB (0%)
       Allocated Shadow Copy Storage space: 608 MB (11%)
       Maximum Shadow Copy Storage space: UNBOUNDED (100%)
    Shadow Copy Storage association
       For volume: (C:\Program Files\Microsoft DPM\DPM\Volumes\Replica\Non VSS Datas
    ource Writer\vol_3a7e2368-9f1a-4753-93b8-bdaba9f6c283\)\\?\Volume{4de52996-4549-
    11e1-be73-441ea13b771a}\
       Shadow Copy Storage volume: (C:\Program Files\Microsoft DPM\DPM\Volumes\DiffA
    rea\Non VSS Datasource Writer\vol_3a7e2368-9f1a-4753-93b8-bdaba9f6c283\)\\?\Volu
    me{4de5299c-4549-11e1-be73-441ea13b771a}\
       Used Shadow Copy Storage space: 544 KB (0%)
       Allocated Shadow Copy Storage space: 608 MB (9%)
       Maximum Shadow Copy Storage space: UNBOUNDED (100%)
    Shadow Copy Storage association
       For volume: (C:\Program Files\Microsoft DPM\DPM\Volumes\Replica\File System\v
    ol_25125b40-236d-4e37-bf54-e77760d78d22\)\\?\Volume{4de529a2-4549-11e1-be73-441e
    a13b771a}\
       Shadow Copy Storage volume: (C:\Program Files\Microsoft DPM\DPM\Volumes\DiffA
    rea\File System\vol_25125b40-236d-4e37-bf54-e77760d78d22\)\\?\Volume{4de529a8-45
    49-11e1-be73-441ea13b771a}\
       Used Shadow Copy Storage space: 0 B (0%)
       Allocated Shadow Copy Storage space: 0 B (0%)
       Maximum Shadow Copy Storage space: UNBOUNDED (100%)
    C:\Users\xxx>
    Thursday, January 26, 2012 10:11 AM
  • This output looks like it came from the DPM Server.

    Can you run it on the server you are protecting?


    Thanks, Wilson Souza - MSFT This posting is provided "AS IS" with no warranties, and confers no rights
    Thursday, January 26, 2012 10:13 AM
  • I'm sorry.

     

    Microsoft Windows [Version 6.1.7601]

    Copyright (c) 2009 Microsoft Corporation.  All rights reserved.

     

    C:\Users\xxxxx>vssadmin list shadowstorage

    vssadmin 1.1 - Volume Shadow Copy Service administrative command-line tool

    (C) Copyright 2001-2005 Microsoft Corp.

     

    Shadow Copy Storage association

       For volume: (\\?\Volume{2572ac4d-4514-11e1-935f-001b21c96aae}\)\\?\Volume{257

    2ac4d-4514-11e1-935f-001b21c96aae}\

       Shadow Copy Storage volume: (\\?\Volume{2572ac4d-4514-11e1-935f-001b21c96aae}

    \)\\?\Volume{2572ac4d-4514-11e1-935f-001b21c96aae}\

       Used Shadow Copy Storage space: 3.14 GB (1%)

       Allocated Shadow Copy Storage space: 6.065 GB (2%)

       Maximum Shadow Copy Storage space: UNBOUNDED (100%)

     

    Shadow Copy Storage association

       For volume: (\\?\Volume{d4b94094-30bd-11e1-8f05-001b21c96aae}\)\\?\Volume{d4b

    94094-30bd-11e1-8f05-001b21c96aae}\

       Shadow Copy Storage volume: (\\?\Volume{d4b94094-30bd-11e1-8f05-001b21c96aae}

    \)\\?\Volume{d4b94094-30bd-11e1-8f05-001b21c96aae}\

       Used Shadow Copy Storage space: 560 KB (0%)

       Allocated Shadow Copy Storage space: 32 MB (32%)

       Maximum Shadow Copy Storage space: 32 MB (32%)

     

    Shadow Copy Storage association

       For volume: (C:)\\?\Volume{d4b94095-30bd-11e1-8f05-001b21c96aae}\

       Shadow Copy Storage volume: (C:)\\?\Volume{d4b94095-30bd-11e1-8f05-001b21c96a

    ae}\

       Used Shadow Copy Storage space: 3.713 GB (6%)

       Allocated Shadow Copy Storage space: 4.024 GB (6%)

       Maximum Shadow Copy Storage space: 6 GB (10%)

     

    Shadow Copy Storage association

       For volume: (G:)\\?\Volume{2572ac15-4514-11e1-935f-001b21c96aae}\

       Shadow Copy Storage volume: (G:)\\?\Volume{2572ac15-4514-11e1-935f-001b21c96a

    ae}\

       Used Shadow Copy Storage space: 164.141 MB (0%)

       Allocated Shadow Copy Storage space: 3.005 GB (0%)

       Maximum Shadow Copy Storage space: UNBOUNDED (310725590%)

     

     

    I just configured the Shadow Copy on the G drive to not use a limit for testing purpose.

    • Marked as answer by Modivion Saturday, January 28, 2012 11:08 AM
    Thursday, January 26, 2012 10:16 AM
  • Ok!! So you just started another CC after that?
    Thanks, Wilson Souza - MSFT This posting is provided "AS IS" with no warranties, and confers no rights
    • Marked as answer by Modivion Saturday, January 28, 2012 11:08 AM
    Thursday, January 26, 2012 10:19 AM
  • Yes I did, so far it's still running.

    I'll keep you updated. Thanks for your help so far!

    Thursday, January 26, 2012 10:26 AM
  • It did the trick. Backups are now fine. Thanks alot!

    Saturday, January 28, 2012 11:08 AM