none
exchange replica vss writer failed RRS feed

  • Question

  • I have a 3 member DAG, two of the members are each backed up by a separate DPM server (one full backup, one copy backup).  Recently the copy backup server started having VSS issues.  The DPM server reports:

    DPM encountered a retryable VSS error (ID 30112 Details: VssError: The writer experienced a transient error.  If the backup process is retried, the error may not reoccur (0x800423f3))

    It keeps happening, even after I reboot both dpm and exchange server.

    In the exchange server event log i get errors 2021 and 2112 for MSExchangeRepl saying the VSS writer failed with error code 80070015 when preparing for a backup.  I also get warning 8229 "A VSS writer has rejected an event with error 0x800423f3"

    Any ideas?  The servers are all ex 2010 sp1.

    Tuesday, October 26, 2010 6:47 PM

Answers

  • Turns out there was a disk failing on that one DAG member - all sorted now, thanks!
    • Marked as answer by Wes Wes Wes Wednesday, October 27, 2010 8:30 PM
    Wednesday, October 27, 2010 8:30 PM

All replies

  • Hi

    Your not running low on disk space on your Exchange servers? How much free space do you have? Look at this KB article maby it will be intressed? http://support.microsoft.com/kb/317249 

    BR

    Robert Hedblom



    Check out my DPM blog @ http://robertanddpm.blogspot.com

    Wednesday, October 27, 2010 7:49 PM
    Moderator
  • Turns out there was a disk failing on that one DAG member - all sorted now, thanks!
    • Marked as answer by Wes Wes Wes Wednesday, October 27, 2010 8:30 PM
    Wednesday, October 27, 2010 8:30 PM
  • OK would like to reopen this discussion because I'm getting same issue but I don't have disk failing on the DAG.  The interesting thing is then after these events at 8:05pm event logs show that a backup is occurring.  DPM is not throwing any errors when it starts it backup at 8pm.

    I backup 3 local DB and a copy of the DAG DB at 8pm once a day.

     

     

    Count

    Level

    Computer

    Log

    Date and Time

    Source

    Category

    Event

    User

    Notes

    1

    Warning

    name

    Application

    11/4/2010 8:03:47 PM

    VSS

     

    8229

       

    A VSS writer has rejected an event with error 0x800423f3, The writer experienced a transient error. If the backup process is retried,
    the error may not reoccur.
    . Changes that the writer made to the writer components while handling the event will not be available to the requester. Check the event log for related events from the application hosting the VSS writer.

    Operation:
    PrepareForSnapshot Event

    Context:
    Execution Context: Writer
    Writer Class Id: {76fe1ac4-15f7-4bcd-987e-8e1acb462fb7}
    Writer Name: Microsoft Exchange Writer
    Writer Instance Name: Exchange Information Store
    Writer Instance ID: {978e951f-879d-4b01-b006-9114d3df6760}
    Command Line: "D:\Program Files\Microsoft\Exchange Server\V14\bin\store.exe"
    Process ID: 3216

    1

    Error

    name

    Application

    11/4/2010 8:03:47 PM

    MSExchangeIS

    Exchange VSS Writer

    9609

       

    Exchange VSS Writer (instance 0d5fa411-71a7-4ed5-bedb-8af580259c0d:109) failed with error code -2403 when preparing for Snapshot.

    1

    Error

    name

    Application

    11/4/2010 8:03:47 PM

    ESE

    ShadowCopy

    2007

       

    Information Store (3216) Shadow copy instance 109 aborted.
    For more information, click http://www.microsoft.com/contentredirect.asp.

    1

    Error

    name

    Application

    11/4/2010 8:03:47 PM

    MSExchangeIS

    Exchange VSS Writer

    9814

       

    Exchange VSS Writer (instance 0d5fa411-71a7-4ed5-bedb-8af580259c0d:109) failed with error code -2403 when preparing the database engine for backup of database '6505Tier2'.

    1

    Error

    name

    Application

    11/4/2010 8:03:47 PM

    MSExchangeIS

    General

    9840

       

    An attempt to prepare the database 'name of DB' for backup failed because the database is already in the process of being backed up. The error code is -2403. (Note that if a backup was recently aborted, then it may take several minutes for the system to detect the aborted backup and initiate backup cleanup procedures, so this message may be generated if an attempt was made to backup a database before a previous backup attempt had fully terminated.)

    Friday, November 5, 2010 9:33 PM
  • David-JFC

    were you able to resolve the issue, i have the same as yours but i couldnt find a solution

    Saturday, February 25, 2012 7:57 PM
  • Hello,

    This article may be relevant to that error that you are seeing: http://support.microsoft.com/kb/981948

    You can  determine if the database has the "BackupInProgress" flag set to True by executing the command below on the Exchange DAG member via the Exchange Management Shell and looking in the output for the BackupInProgress property.

    "Get-MailboxDatabase 'DBName' -Status |fl"  

    does it show that there is already a backup in progress?

    Thanks
    Shane

    Saturday, February 25, 2012 9:49 PM
    Moderator
  • thanks for the quick reply

    first of all the TMG is not installed on the server which i have problem on, second the BackupInProgress shows nothing

    but what i have noticed is the vss service is triggered to start state before the schedule DPM Backup started, i thinks it fails becuase of this reason

    Saturday, February 25, 2012 10:05 PM
  • Hello,

    DPM does not take the backup of the exchange database nor does it truncate the logs.  DPM triggers the Exchange VSS writers, which in turn performs these functions. Once complete, the data is handed to the DPMRA service which transfers it to DPM.  If something else is triggering the Exchange VSS writers to take a snapshot before DPM makes an attempt OR if the exchange writers are having a issue, then this may be the cause of your problem.  It doesn't, however, sound like something else is triggering the exchange writers though as the BackupInProgress doesn't show anything.

    Another tshooting step is to do the following on the exchange server in question:

    A.) from a cmd prompt, type vssadmin list writers.  Does the Exchange VSS writer show up in a failed or hung state?
    B.) from a cmd prompt, type vssadmin list shadows.  Do you see a snapshot being taken?

    Thanks
    Shane

    Sunday, February 26, 2012 12:23 AM
    Moderator
  • 1- I dont think the BackupInProgress works as it should be, becuase even if I trigger the DPM to take a recoverypoint of the active database on the exchange server in question, and ran Get-MailboxDatabase 'DBName' -Status | Select BackupInProgress. it shows nothing

    2- when the DPM Schedule backup run the vss list admin shows

    Writer name: 'Microsoft Exchange Writer'
    Writer Id: {76fe1ac4-15f7-4bcd-987e-8e1acb462fb7}
    Writer Instance Id: {b3558724-ac8b-43d2-820e-5a508a970af5}
    State: [8] Failed
    Last error: Retryable error

    3- i didnt try the vss list admin

    4- i have the follwoing event in the Eventvwr

    A VSS writer has rejected an event with error 0x800423f3, The writer experienced a transient error. If the backup process is retried,

    the error may not reoccur.

    . Changes that the writer made to the writer components while handling the event will not be available to the requester. Check the event log for related events from the application hosting the VSS writer.

    Operation:

    PrepareForSnapshot Event

    Context:

    Execution Context: Writer

    Writer Class Id: {76fe1ac4-15f7-4bcd-987e-8e1acb462fb7}

    Writer Name: Microsoft Exchange Writer

    Writer Instance Name: Exchange Information Store

    Writer Instance ID: {b3558724-ac8b-43d2-820e-5a508a970af5}

    Command Line: "C:\Program Files\Microsoft\Exchange Server\V14\bin\store.exe"

    Process ID: 4972


    Sunday, February 26, 2012 6:36 AM
  • Hello,

    If the exchange writer is having an issue then DPM is just a victim.

    I suggest to restart the information store or better yet, reboot the exchange server. If you still get the Exchange VSS writer error then I'd suggest you make a post on the Exchange forum for advice on how to best troubleshoot that component.

    Thanks
    Shane

    Sunday, February 26, 2012 3:51 PM
    Moderator
  • Log Name:      Application
    Source:        MSExchangeIS
    Date:          3/6/2014 1:48:32 PM
    Event ID:      9814
    Task Category: Exchange VSS Writer
    Level:         Error
    Keywords:      Classic
    User:          N/A
    Computer:      mbxserver.mydomain.com
    Description:
    Exchange VSS Writer (instance 797ed959-2fcc-4368-9e57-16f8fb39c907:2750) failed with error code -2403 when preparing the database engine for backup of database 'DAL_DB4_I-L'. 
    Event Xml:
    <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
      <System>
        <Provider Name="MSExchangeIS" />
        <EventID Qualifiers="49193">9814</EventID>
        <Level>2</Level>
        <Task>41</Task>
        <Keywords>0x80000000000000</Keywords>
        <TimeCreated SystemTime="2014-03-06T19:48:32.000000000Z" />
        <EventRecordID>192215</EventRecordID>
        <Channel>Application</Channel>
        <Computer>mbxserver.mydomain.com</Computer>
        <Security />
      </System>
      <EventData>
        <Data>797ed959-2fcc-4368-9e57-16f8fb39c907:2750</Data>
        <Data>-2403</Data>
        <Data>DAL_DB4_I-L</Data>
        <Binary>4356737349457863685772697465723A3A4563507265706172654A696E73744261636B75703A204661696C656420707265706172696E6720736E617073686F7420696E7374616E636520626563617573652061206261636B757020697320616C726561647920696E2070726F67726573732E00</Binary>
      </EventData>
    </Event>

    This is what I am getting on one of my mbxservers. As soon as I mounted the DB to a different MBXserver, the backup completed successfully. By the way, i have 6 other DBs mounted to this same MBXserver, and this DB is the only one that failed. 

    Friday, March 7, 2014 4:59 PM