none
Reduce Crawl Time RRS feed

  • Question

  • We have almost 14 million documents spread over 8 content databases, each about 200 GB. Only the 8th DB receives new documents.  When it grows to about 200 GB, a 9th will be started. The documents are read only and retrieved based on five custom managed properties.  An index reset and full crawl takes over 2 weeks, and we avoid doing that at all costs.  MaxDownLoadSize is currently set to zero.  The thought has been discussed of deleting all managed properties to speed up the crawl.  What impact do you think this would have on crawls?  Actually, any suggestions to reduce the time are welcome.
    Wednesday, January 17, 2018 9:26 PM

Answers

  • Hi,

    Please check the following things to narrow down this issue:

    1. Monitor the OS performance(CPU, Memory) during crawl process, see if you need to improve it.

    2. Check for the crawl log history to see if there is any error message.

    3. See that whenever there are security updates & security errors, it took more time to complete the crawl.

    Best Regards,

    Dean Wang


    Please remember to mark the replies as answers if they helped. If you have feedback for TechNet Subscriber Support, contact tnsf@microsoft.com.


    Click here to learn more. Visit the dedicated forum to share, explore and talk to experts about Microsoft Teams.

    Thursday, January 18, 2018 11:18 AM
    Moderator

All replies

  • archive old files, which means reduce the content source size.

    Justin Liu Office Servers and Services MVP, MCSE
    Senior Software Engineer
    Please Vote and Mark as Answer if it helps you.


    Thursday, January 18, 2018 9:07 AM
  • Hi,

    Please check the following things to narrow down this issue:

    1. Monitor the OS performance(CPU, Memory) during crawl process, see if you need to improve it.

    2. Check for the crawl log history to see if there is any error message.

    3. See that whenever there are security updates & security errors, it took more time to complete the crawl.

    Best Regards,

    Dean Wang


    Please remember to mark the replies as answers if they helped. If you have feedback for TechNet Subscriber Support, contact tnsf@microsoft.com.


    Click here to learn more. Visit the dedicated forum to share, explore and talk to experts about Microsoft Teams.

    Thursday, January 18, 2018 11:18 AM
    Moderator