none
Exchange 2013 Database Index failed for a single database RRS feed

  • Question

  • Dear Microsoft Support,

    I ask for help in the forum because I have tried all the method in Google.

    I have Exchange 2013 CU8 DAG with 4 members. Each Exchange server has 4 databases running. The Cxo_db database has index failure on the 3 passive members but on the active member everything is OK. Just to high light on the same server on other three database replication and index are working.


    The error is below:


    [PS] C:\Windows\system32>Get-MailboxDatabaseCopyStatus | FL Name,*Index*


    Name                         : CxO_db\BOTEUSAPPP1007
    ContentIndexState            : Failed
    ContentIndexErrorMessage     : The database has been dismounted.
    ContentIndexErrorCode        : 4

    Log Name:      Application
    Source:        MSExchangeFastSearch
    Date:          4/2/2016 11:46:59 PM
    Event ID:      1009
    Task Category: General
    Level:         Warning
    Keywords:      Classic
    User:          N/A
    Computer:      BOTEUSAPPP1007.oml.com
    Description:
    The indexing of mailbox database CxO_db encountered an unexpected exception. Error details: Microsoft.Exchange.Search.Core.Abstraction.OperationFailedException: The component operation has failed. ---> Microsoft.Exchange.Search.Core.Abstraction.ComponentFailedPermanentException: Failed to read notifications, MDB: ec0bea7e-5431-4db2-b6b0-3746cc2506c7. ---> Microsoft.Mapi.MapiExceptionMdbOffline: MapiExceptionMdbOffline: Unable to read the last event. (hr=0x80004005, ec=1142)
    Diagnostic context:
        ......
        Lid: 11672   dwParam: 0x0 Msg: EEInfo: NumberOfParameters: 3
        Lid: 12952   dwParam: 0x0 Msg: EEInfo: prm[0]: Long val: 6666
        Lid: 15000   dwParam: 0x0 Msg: EEInfo: prm[1]: Pointer val: 0x0              
        Lid: 15000   dwParam: 0x0 Msg: EEInfo: prm[2]: Pointer val: 0x2547370A00000000
        Lid: 62184 
        Lid: 16280   dwParam: 0x0 Msg: EEInfo: ComputerName: n/a
        Lid: 8600    dwParam: 0x0 Msg: EEInfo: ProcessID: 10652
        Lid: 12696   dwParam: 0x0 Msg: EEInfo: Generation Time: 0416-04-02T17:16:59.1720000Z
        Lid: 10648   dwParam: 0x0 Msg: EEInfo: Generating component: 18
        Lid: 14744   dwParam: 0x0 Msg: EEInfo: Status: 10013
        Lid: 9624    dwParam: 0x0 Msg: EEInfo: Detection location: 318
        Lid: 13720   dwParam: 0x0 Msg: EEInfo: Flags: 0
        Lid: 11672   dwParam: 0x0 Msg: EEInfo: NumberOfParameters: 0
        Lid: 12514   Win32Error: 0x5
        Lid: 62184 
        Lid: 16280   dwParam: 0x0 Msg: EEInfo: ComputerName: n/a
        Lid: 8600    dwParam: 0x0 Msg: EEInfo: ProcessID: 10652
        Lid: 12696   dwParam: 0x0 Msg: EEInfo: Generation Time: 0416-04-02T17:16:59.1740000Z
        Lid: 10648   dwParam: 0x0 Msg: EEInfo: Generating component: 18
        Lid: 14744   dwParam: 0x0 Msg: EEInfo: Status: 5
        Lid: 9624    dwParam: 0x0 Msg: EEInfo: Detection location: 313
        Lid: 13720   dwParam: 0x0 Msg: EEInfo: Flags: 0
        Lid: 11672   dwParam: 0x0 Msg: EEInfo: NumberOfParameters: 0
        Lid: 62184 
        Lid: 16280   dwParam: 0x0 Msg: EEInfo: ComputerName: n/a
        Lid: 8600    dwParam: 0x0 Msg: EEInfo: ProcessID: 10652
        Lid: 12696   dwParam: 0x0 Msg: EEInfo: Generation Time: 0416-04-02T17:16:59.1740000Z
        Lid: 10648   dwParam: 0x0 Msg: EEInfo: Generating component: 18
        Lid: 14744   dwParam: 0x0 Msg: EEInfo: Status: 10013
        Lid: 9624    dwParam: 0x0 Msg: EEInfo: Detection location: 311
        Lid: 13720   dwParam: 0x0 Msg: EEInfo: Flags: 0
        Lid: 11672   dwParam: 0x0 Msg: EEInfo: NumberOfParameters: 3
        Lid: 12952   dwParam: 0x0 Msg: EEInfo: prm[0]: Long val: 6666
        Lid: 15000   dwParam: 0x0 Msg: EEInfo: prm[1]: Pointer val: 0x0              
        Lid: 15000   dwParam: 0x0 Msg: EEInfo: prm[2]: Pointer val: 0x2547370A00000000
        Lid: 62184 
        Lid: 16280   dwParam: 0x0 Msg: EEInfo: ComputerName: n/a
        Lid: 8600    dwParam: 0x0 Msg: EEInfo: ProcessID: 10652
        Lid: 12696   dwParam: 0x0 Msg: EEInfo: Generation Time: 0416-04-02T17:16:59.1740000Z
        Lid: 10648   dwParam: 0x0 Msg: EEInfo: Generating component: 18
        Lid: 14744   dwParam: 0x0 Msg: EEInfo: Status: 10013
        Lid: 9624    dwParam: 0x0 Msg: EEInfo: Detection location: 318
        Lid: 13720   dwParam: 0x0 Msg: EEInfo: Flags: 0
        Lid: 11672   dwParam: 0x0 Msg: EEInfo: NumberOfParameters: 0
        Lid: 57064 
        Lid: 16354   StoreEc: 0x476    
        Lid: 38985   StoreEc: 0x476    
        Lid: 20098 
        Lid: 20585   StoreEc: 0x476    
       at Microsoft.Mapi.MapiExceptionHelper.InternalThrowIfErrorOrWarning(String message, Int32 hresult, Boolean allowWarnings, Int32 ec, DiagnosticContext diagCtx, Exception innerException)
       at Microsoft.Mapi.MapiExceptionHelper.ThrowIfError(String message, Int32 hresult, IExInterface iUnknown, Exception innerException)
       at Microsoft.Mapi.MapiEventManager.ReadLastEvent(Boolean includeSid)
       at Microsoft.Exchange.Search.Mdb.MapiUtil.<>c__DisplayClass1`1.<TranslateMapiExceptionsWithReturnValue>b__0()
       at Microsoft.Exchange.Search.Mdb.MapiUtil.TranslateMapiExceptions(IDiagnosticsSession tracer, LocalizedString errorString, Action mapiCall)
       --- End of inner exception stack trace ---
       at Microsoft.Exchange.Search.Mdb.MapiUtil.TranslateMapiExceptions(IDiagnosticsSession tracer, LocalizedString errorString, Action mapiCall)
       at Microsoft.Exchange.Search.Mdb.MapiUtil.TranslateMapiExceptionsWithReturnValue[TReturnValue](IDiagnosticsSession tracer, LocalizedString errorString, Func`1 mapiCall)
       at Microsoft.Exchange.Search.Mdb.NotificationsEventSource.ReadLastEvent()
       at Microsoft.Exchange.Search.Mdb.NotificationsEventSource.GetNetworkLatency(Int32 samples)
       at Microsoft.Exchange.Search.Engine.SearchFeedingController.CalculateNumberOfFeederSessions()
       at Microsoft.Exchange.Search.Engine.SearchFeedingController.InitializeFastFeederAndWatermarkStorage()
       at Microsoft.Exchange.Search.Engine.SearchFeedingController.InternalExecutionStart()
       at Microsoft.Exchange.Search.Core.Common.Executable.InternalExecutionStart(Object state)
       --- End of inner exception stack trace ---
       at Microsoft.Exchange.Search.Core.Common.Executable.EndExecute(IAsyncResult asyncResult)
       at Microsoft.Exchange.Search.Engine.SearchRootController.ExecuteComplete(IAsyncResult asyncResult)
    Event Xml:
    <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
      <System>
        <Provider Name="MSExchangeFastSearch" />
        <EventID Qualifiers="32772">1009</EventID>
        <Level>3</Level>
        <Task>1</Task>
        <Keywords>0x80000000000000</Keywords>
        <TimeCreated SystemTime="2016-04-02T17:16:59.000000000Z" />
        <EventRecordID>8405313</EventRecordID>
        <Channel>Application</Channel>
        <Computer>BOTEUSAPPP1007.oml.com</Computer>
        <Security />
      </System>
      <EventData>
        <Data>CxO_db</Data>
        <Data>Microsoft.Exchange.Search.Core.Abstraction.OperationFailedException: The component operation has failed. ---&gt; Microsoft.Exchange.Search.Core.Abstraction.ComponentFailedPermanentException: Failed to read notifications, MDB: ec0bea7e-5431-4db2-b6b0-3746cc2506c7. ---&gt; Microsoft.Mapi.MapiExceptionMdbOffline: MapiExceptionMdbOffline: Unable to read the last event. (hr=0x80004005, ec=1142)
    Diagnostic context:
        ......
        Lid: 11672   dwParam: 0x0 Msg: EEInfo: NumberOfParameters: 3
        Lid: 12952   dwParam: 0x0 Msg: EEInfo: prm[0]: Long val: 6666
        Lid: 15000   dwParam: 0x0 Msg: EEInfo: prm[1]: Pointer val: 0x0              
        Lid: 15000   dwParam: 0x0 Msg: EEInfo: prm[2]: Pointer val: 0x2547370A00000000
        Lid: 62184 
        Lid: 16280   dwParam: 0x0 Msg: EEInfo: ComputerName: n/a
        Lid: 8600    dwParam: 0x0 Msg: EEInfo: ProcessID: 10652
        Lid: 12696   dwParam: 0x0 Msg: EEInfo: Generation Time: 0416-04-02T17:16:59.1720000Z
        Lid: 10648   dwParam: 0x0 Msg: EEInfo: Generating component: 18
        Lid: 14744   dwParam: 0x0 Msg: EEInfo: Status: 10013
        Lid: 9624    dwParam: 0x0 Msg: EEInfo: Detection location: 318
        Lid: 13720   dwParam: 0x0 Msg: EEInfo: Flags: 0
        Lid: 11672   dwParam: 0x0 Msg: EEInfo: NumberOfParameters: 0
        Lid: 12514   Win32Error: 0x5
        Lid: 62184 
        Lid: 16280   dwParam: 0x0 Msg: EEInfo: ComputerName: n/a
        Lid: 8600    dwParam: 0x0 Msg: EEInfo: ProcessID: 10652
        Lid: 12696   dwParam: 0x0 Msg: EEInfo: Generation Time: 0416-04-02T17:16:59.1740000Z
        Lid: 10648   dwParam: 0x0 Msg: EEInfo: Generating component: 18
        Lid: 14744   dwParam: 0x0 Msg: EEInfo: Status: 5
        Lid: 9624    dwParam: 0x0 Msg: EEInfo: Detection location: 313
        Lid: 13720   dwParam: 0x0 Msg: EEInfo: Flags: 0
        Lid: 11672   dwParam: 0x0 Msg: EEInfo: NumberOfParameters: 0
        Lid: 62184 
        Lid: 16280   dwParam: 0x0 Msg: EEInfo: ComputerName: n/a
        Lid: 8600    dwParam: 0x0 Msg: EEInfo: ProcessID: 10652
        Lid: 12696   dwParam: 0x0 Msg: EEInfo: Generation Time: 0416-04-02T17:16:59.1740000Z
        Lid: 10648   dwParam: 0x0 Msg: EEInfo: Generating component: 18
        Lid: 14744   dwParam: 0x0 Msg: EEInfo: Status: 10013
        Lid: 9624    dwParam: 0x0 Msg: EEInfo: Detection location: 311
        Lid: 13720   dwParam: 0x0 Msg: EEInfo: Flags: 0
        Lid: 11672   dwParam: 0x0 Msg: EEInfo: NumberOfParameters: 3
        Lid: 12952   dwParam: 0x0 Msg: EEInfo: prm[0]: Long val: 6666
        Lid: 15000   dwParam: 0x0 Msg: EEInfo: prm[1]: Pointer val: 0x0              
        Lid: 15000   dwParam: 0x0 Msg: EEInfo: prm[2]: Pointer val: 0x2547370A00000000
        Lid: 62184 
        Lid: 16280   dwParam: 0x0 Msg: EEInfo: ComputerName: n/a
        Lid: 8600    dwParam: 0x0 Msg: EEInfo: ProcessID: 10652
        Lid: 12696   dwParam: 0x0 Msg: EEInfo: Generation Time: 0416-04-02T17:16:59.1740000Z
        Lid: 10648   dwParam: 0x0 Msg: EEInfo: Generating component: 18
        Lid: 14744   dwParam: 0x0 Msg: EEInfo: Status: 10013
        Lid: 9624    dwParam: 0x0 Msg: EEInfo: Detection location: 318
        Lid: 13720   dwParam: 0x0 Msg: EEInfo: Flags: 0
        Lid: 11672   dwParam: 0x0 Msg: EEInfo: NumberOfParameters: 0
        Lid: 57064 
        Lid: 16354   StoreEc: 0x476    
        Lid: 38985   StoreEc: 0x476    
        Lid: 20098 
        Lid: 20585   StoreEc: 0x476    
       at Microsoft.Mapi.MapiExceptionHelper.InternalThrowIfErrorOrWarning(String message, Int32 hresult, Boolean allowWarnings, Int32 ec, DiagnosticContext diagCtx, Exception innerException)
       at Microsoft.Mapi.MapiExceptionHelper.ThrowIfError(String message, Int32 hresult, IExInterface iUnknown, Exception innerException)
       at Microsoft.Mapi.MapiEventManager.ReadLastEvent(Boolean includeSid)
       at Microsoft.Exchange.Search.Mdb.MapiUtil.&lt;&gt;c__DisplayClass1`1.&lt;TranslateMapiExceptionsWithReturnValue&gt;b__0()
       at Microsoft.Exchange.Search.Mdb.MapiUtil.TranslateMapiExceptions(IDiagnosticsSession tracer, LocalizedString errorString, Action mapiCall)
       --- End of inner exception stack trace ---
       at Microsoft.Exchange.Search.Mdb.MapiUtil.TranslateMapiExceptions(IDiagnosticsSession tracer, LocalizedString errorString, Action mapiCall)
       at Microsoft.Exchange.Search.Mdb.MapiUtil.TranslateMapiExceptionsWithReturnValue[TReturnValue](IDiagnosticsSession tracer, LocalizedString errorString, Func`1 mapiCall)
       at Microsoft.Exchange.Search.Mdb.NotificationsEventSource.ReadLastEvent()
       at Microsoft.Exchange.Search.Mdb.NotificationsEventSource.GetNetworkLatency(Int32 samples)
       at Microsoft.Exchange.Search.Engine.SearchFeedingController.CalculateNumberOfFeederSessions()
       at Microsoft.Exchange.Search.Engine.SearchFeedingController.InitializeFastFeederAndWatermarkStorage()
       at Microsoft.Exchange.Search.Engine.SearchFeedingController.InternalExecutionStart()
       at Microsoft.Exchange.Search.Core.Common.Executable.InternalExecutionStart(Object state)
       --- End of inner exception stack trace ---
       at Microsoft.Exchange.Search.Core.Common.Executable.EndExecute(IAsyncResult asyncResult)
       at Microsoft.Exchange.Search.Engine.SearchRootController.ExecuteComplete(IAsyncResult asyncResult)</Data>
      </EventData>
    </Event>


    Best regards,

    Robert Li
    Partner Online Technical Community
    -----------------------------------------------------------------------------------------
    We hope you get value from our new forums platform! Tell us what you think:
    http://social.microsoft.com/Forums/en-US/partnerfdbk/threads
    ------------------------------------------------------------------------------------------
    This posting is provided "AS IS" with no warranties, and confers no rights.

    Saturday, April 2, 2016 5:37 PM

Answers

  • the issue has been resolved itself after I failover the db on another DAG member.

    Best regards,<br/><br/><strong>Robert Li<br/></strong>Partner Online Technical Community<br/>-----------------------------------------------------------------------------------------<br/>We hope you get value from our new forums platform! Tell us what you think:<br/><a href="http://social.microsoft.com/Forums/en-US/partnerfdbk/threads"><span style="color:#0033cc">http://social.microsoft.com/Forums/en-US/partnerfdbk/threads<br/></span></a>------------------------------------------------------------------------------------------<br/>This posting is provided &quot;AS IS&quot; with no warranties, and confers no rights.

    • Marked as answer by Robert Li Monday, April 4, 2016 3:01 AM
    Monday, April 4, 2016 3:01 AM

All replies

  • Below are the steps we have tried.

    1. Create ContentSubmitter per KB: 2807668

    Add-ADPermission -Id ContentSubmitters -User “Network Service” -AccessRights GenericAll
    Add-ADPermission -Id ContentSubmitters -User “Administrators” -AccessRights GenericAll

    2. Deleted the mailbox guid folder and restart Exchange search and Exchange search host management service.

    3. Try to reseed Update-MailboxDatabaseCopy -identity CxO_DB\BOTEUSAPPP1007 -CatalogOnly

    4. Recreate the FAST service configuration file as in https://social.technet.microsoft.com/Forums/exchange/en-US/6eebdbdc-5d03-4b2d-88e5-52b3a6e2781b/exchange-2013-content-index-failed-service-search-host-controller-doesnt-start?forum=exchangesvradmin

    This issue happened after the monthy patch work and the transistion login can't be trucated after full backup.

    Any suggestions will be high appriated.


    Best regards,

    Robert Li
    Partner Online Technical Community
    -----------------------------------------------------------------------------------------
    We hope you get value from our new forums platform! Tell us what you think:
    http://social.microsoft.com/Forums/en-US/partnerfdbk/threads
    ------------------------------------------------------------------------------------------
    This posting is provided "AS IS" with no warranties, and confers no rights.

    • Proposed as answer by Michael Vi Monday, April 4, 2016 1:51 AM
    Saturday, April 2, 2016 5:38 PM
  • the issue has been resolved itself after I failover the db on another DAG member.

    Best regards,<br/><br/><strong>Robert Li<br/></strong>Partner Online Technical Community<br/>-----------------------------------------------------------------------------------------<br/>We hope you get value from our new forums platform! Tell us what you think:<br/><a href="http://social.microsoft.com/Forums/en-US/partnerfdbk/threads"><span style="color:#0033cc">http://social.microsoft.com/Forums/en-US/partnerfdbk/threads<br/></span></a>------------------------------------------------------------------------------------------<br/>This posting is provided &quot;AS IS&quot; with no warranties, and confers no rights.

    • Marked as answer by Robert Li Monday, April 4, 2016 3:01 AM
    Monday, April 4, 2016 3:01 AM