none
Diagnosing error ID 30111 aka 800423F4 RRS feed

  • Question

  • Hi,

     

    How can I diagnose a job failure with error ID 30111 and detailed error code 800423F4?  This is DPM 2010 against a Windows 2008 R2 Hyper-V cluster.

    thanks!

     

    Martin

    Tuesday, July 6, 2010 8:40 PM

Answers

  • Hi Martin,

    Run vssadmin list providers - and see if your hardware provider is listed.

    If the hardware provider is present but vetoed the request to make a hardware snapshot, then we fall back to using in-box software snapshots and that would lead to your problem.   Some hardware providers need activating, some require dedicated space be pre-configured on the SAN for snapshots.  I would look for any VSS errors in the application event log when doing a backup that you know will succeed.  See if you can create hardware snapshots manually using san vendor tools.


    Regards, Mike J [MSFT] This posting is provided "AS IS" with no warranties, and confers no rights.
    • Marked as answer by MartinBH Thursday, July 8, 2010 11:57 AM
    Wednesday, July 7, 2010 6:10 PM
    Moderator

All replies

  • HI Martin,

    That is a VSS Writer error.  If you are protecting guest VM's, then make sure the integration components are updated inside the guests.  Also look for VSS errors in the application event log inside the guest.


    Regards, Mike J [MSFT] This posting is provided "AS IS" with no warranties, and confers no rights.
    Tuesday, July 6, 2010 10:00 PM
    Moderator
  • Mike,

     

    I don't see any VSS errors in the guest application log, and I think the integration components are up to date.  I can post a bit of the logs from the DPM server if that would help.

     

    Could this be a serialization issue?  I have NOT set up software serialization because I am hoping that the SAN and its driver are capable of handling it, but I am not sure how to verify that.

     

    thanks

     

    Martin

    Tuesday, July 6, 2010 11:55 PM
  • Can you check the VSS writers by running vssadmin list writers on both the host and the guests that are failing?

    Cheers,

    Mike Resseler


    Visit System Center User Group Belgium @ http://scug.be and http://scug.be/blogs/scdpm
    Wednesday, July 7, 2010 6:34 AM
    Moderator
  • Mike Resseler,

    Within the failing host all the writers are stable/no error other than:

    Writer name: 'Microsoft Hyper-V VSS Writer'
       Writer Id: {66841cd4-6ded-4f4b-8f17-fd23f8ddc3de}
       Writer Instance Id: {7d1e0031-a0f1-4c5c-920b-0c3ae2e31319}
       State: [1] Stable
       Last error: Non-retryable error

    Within the failing VM all writers are stable/no error.

    thanks!

    Martin

    Wednesday, July 7, 2010 11:16 AM
  • Hey Martin,

    This is most of the time cause by the integration tools that are not up-to-date as Mike J. told.

    Please check if they are installed on the guest systems (check add/remove programs and check version number)

    Just my two cents,

    Cheers,

    Mike Resseler


    Visit System Center User Group Belgium @ http://scug.be and http://scug.be/blogs/scdpm
    Wednesday, July 7, 2010 12:01 PM
    Moderator
  • I did an integation components update and it stayed at the same version (6.1.7600.20542).

     

    I should provide more background - I first tried the backup with both VMs on the same CSV and running on the same node (which happens to be the node that owned the CSV) and the Express Full worked fine.  Then I moved one VM to the other node and tried Express Full on both concurrently; one failed and one completed. 

     

    Any suggestions?

     

    thanks!

    Martin

    Wednesday, July 7, 2010 3:14 PM
  • Hi Martin,

     

    Yes - under the senario just decribed - You will either need to setup up Hyper-V Serialization, or place each Guest in it's own PG and stager the times when the backups occur so guests that share a CSV do not have overlapping backup times.  Either one of those will resolve the problem, but you should also think about installing a VSS hardware provider so DPM can perform simultanious backups of guests located on the same CSV. 

     


    Regards, Mike J [MSFT] This posting is provided "AS IS" with no warranties, and confers no rights.
    Wednesday, July 7, 2010 3:45 PM
    Moderator
  • Mike J,

     

    That's the thing - I think I DID install the SAN hardware VSS provider.  So if this definitely looks like a serialization issue I want to go to the SAN vendor for assistance.  Is there anything to look for in logs to definitively show it's a serialization problem?

     

    thanks

     

    Martin

    Wednesday, July 7, 2010 4:29 PM
  • Hi Martin,

    Run vssadmin list providers - and see if your hardware provider is listed.

    If the hardware provider is present but vetoed the request to make a hardware snapshot, then we fall back to using in-box software snapshots and that would lead to your problem.   Some hardware providers need activating, some require dedicated space be pre-configured on the SAN for snapshots.  I would look for any VSS errors in the application event log when doing a backup that you know will succeed.  See if you can create hardware snapshots manually using san vendor tools.


    Regards, Mike J [MSFT] This posting is provided "AS IS" with no warranties, and confers no rights.
    • Marked as answer by MartinBH Thursday, July 8, 2010 11:57 AM
    Wednesday, July 7, 2010 6:10 PM
    Moderator
  • Just FYI, by looking at logs on the SAN (an EqualLogic) it appears the SAN snapshots are being made in  the case in which both VMs are running on the same node.  I will consult Dell/EqualLogic.

     

     

    thanks

     

    Martin

     

     

    Wednesday, July 7, 2010 8:13 PM
  • Hi Martin!

    I had a similar case with one of my customers. The company wanted to use VSS hardware providor with thier SAN but the seller forgot to inluce the VSS hardware Providor function in the licens. I ran in to some very odd errors but after adjusting the licens of the SAN everything worked fine.

     

    Check you licens that you relly have the VSS function included. Some SAN can make VSS anyhow but wont transfer the data untill the correct licens is installed.

    BR

    Robert Hedblom


    Check out my DPM blog http://robertanddpm.blogspot.com
    Thursday, July 8, 2010 7:27 AM
    Moderator
  • Hey Robert,

    Just out of curiousity.  Which SAN are we talking about.  In case I have an issue with one of those that I can think about it ;-)

    PS: love the blog, keep working on it

    Cheers,

    Mike


    Visit System Center User Group Belgium @ http://scug.be and http://scug.be/blogs/scdpm
    Thursday, July 8, 2010 8:18 AM
    Moderator
  • Mike J,

     

    It looks like the SAN VSS hardware provider is working as designed and just doesn't handle the serialization any smarter than the software provider.  If I follow the steps here:

     

    http://technet.microsoft.com/en-us/library/ff634192.aspx

     

    to set up serialization, do you think DPM will obey the serialization info even though the hardware provider is installed?

     

    thanks

    Martin

    Thursday, July 8, 2010 12:31 PM
  • Hi Martin,

     

    Yes, if you enable serialization as per the technet site, DPM will honor it regardless if vss hardware provider is installed or not.

    Concerning your findings about the EqualLogic VSS hardware provider, can you tell us how yours differs from the one showing support on the folloiwng site ?

    http://blogs.technet.com/b/dpm/archive/2010/02/05/tested-hardware-vss-provider-table.aspx


    Regards, Mike J [MSFT] This posting is provided "AS IS" with no warranties, and confers no rights.
    Thursday, July 8, 2010 4:31 PM
    Moderator

  • Well, I am using newer firmware and VSS hardware provider sw than mentioned in that posting.  And if all the VMs are on the same node and the same CSV it works fine - the logs show the hardware snapshot being made, etc.  But in the VM-from-different-nodes-sharing-a-single-CSV scenario, it has the same serialization problem as the default software VSS provider.

     

    thanks

     

    Martin 

    Thursday, July 8, 2010 6:30 PM
  • Hi Martin,

    I would like to recommend that you work with Dell to figure out what is going wrong, it could be an easy configuration change.

     

     


    Regards, Mike J [MSFT] This posting is provided "AS IS" with no warranties, and confers no rights.
    Thursday, July 8, 2010 7:57 PM
    Moderator
  • I've contacted Dell Support and they verified that their current VSS provider does not handle serialization.  If you get a different answer I'd love to hear about it :-)

    Thursday, July 8, 2010 8:11 PM
  • Hi Martin

    Here is one of my blogposts that explains how you enable the serialized backup.

    http://robertanddpm.blogspot.com/2010/07/enabling-serialized-backup-of-hyper-v.html

    BR

    Rober Hedblom


    Check out my DPM blog http://robertanddpm.blogspot.com
    Monday, July 19, 2010 9:56 PM
    Moderator
  • Hi Mike!

    IBM......


    Check out my DPM blog http://robertanddpm.blogspot.com
    Thursday, July 22, 2010 8:37 PM
    Moderator