none
When is Security Timming Applied to a Crawl?

    Question

  • We have a SharePoint 2013 farm with Enterprise Search and along with other content sources, we are crawling a file share. The file share contains several million documents and takes around 22 hours to run.

    The problem is that while the crawl is running, users searching for files on the file share see results that are not security trimmed. This may apply to all files and not just those that have changed. Although they are not able to open the files, they can see enough information for this to be a serious security issue.

    When the crawl completes, the search servers continue at high cpu for some time and we suspect that this is when security trimming is re-applied.

    Can anyone confirm that this is expected behaviour?

    Thanks.

    Tuesday, June 05, 2018 8:56 AM

Answers

  • Existing security trimming based on previous crawls will stay in effect during a new crawl.  But if you change permissions on a file, then the crawl needs to complete before those permissions are reflected in the Index.  Crawling content is a multi step process.  The content needs to be crawled (this is simply reading the files) and then processed to make it part of the index.  Its the processing piece that I expect you are seeing after the crawl completes.  Content and security trimming will not be in place until the full process is complete. This is the expected process.

    But as mentioned above this would only apply to a scenario where permissions have been modified on existing content that had already been crawled.  New content won't appear at all in Search results until the crawl completes and existing content (without changed permissions) will still have the existing security trimming applied.


    Paul Stork SharePoint Server MVP
    Owner/Principal Architect: Don't Pa..Panic Consulting
    Blog: http://dontpapanic.com/blog
    Twitter: Follow @pstork
    Please remember to mark your question as 'answered' if this solves your problem.

    Tuesday, June 05, 2018 12:10 PM

All replies

  • Existing security trimming based on previous crawls will stay in effect during a new crawl.  But if you change permissions on a file, then the crawl needs to complete before those permissions are reflected in the Index.  Crawling content is a multi step process.  The content needs to be crawled (this is simply reading the files) and then processed to make it part of the index.  Its the processing piece that I expect you are seeing after the crawl completes.  Content and security trimming will not be in place until the full process is complete. This is the expected process.

    But as mentioned above this would only apply to a scenario where permissions have been modified on existing content that had already been crawled.  New content won't appear at all in Search results until the crawl completes and existing content (without changed permissions) will still have the existing security trimming applied.


    Paul Stork SharePoint Server MVP
    Owner/Principal Architect: Don't Pa..Panic Consulting
    Blog: http://dontpapanic.com/blog
    Twitter: Follow @pstork
    Please remember to mark your question as 'answered' if this solves your problem.

    Tuesday, June 05, 2018 12:10 PM
  • Many thanks for your help.
    Tuesday, June 05, 2018 1:29 PM