When I add a new exclusion rule to exclude all the urls with /Forms/ in them, I see that the full crawl is missing a lot of items that don't have /Forms/ in their urls. For instance, the following urls are skipped:
https://stagehelp.xyz.com/searchuat/Pages/Andreas.aspx
https://stagehelp.xyz.com/searchuat/Documents/Recommended%20file%20types%20in%20CMA.doc
My exclude rule is as follows: https://*.xyz.com/*/Forms/*
Not sure what is going on here. Could it be because the AllItems.aspx page for the doc libs these documents belong to is under /Pages/Forms/? Maybe, when I cut the link to the
AllItems.aspx, it can't crawl the items in those doc libs?
This is an SP 2010 crawl from one SP farm to another SP farm.
Thanks!
Erkan