How often should I schedule crawls for Local SharePoint Sites?

Tevon2.0 1,106 Reputation points
2023-06-21T12:34:43.4433333+00:00

I'm using SharePoint server 2019 and have been seeing the 500 server internal error on my SharePoint sites. Thus I would like to ensure that I start running crawls for my content sources. What is the recommended schedule for crawls and should I use incremental crawls or continuous?

SharePoint Server
SharePoint Server
A family of Microsoft on-premises document management and storage systems.
2,340 questions
Windows 10
Windows 10
A Microsoft operating system that runs on personal computers and tablets.
11,575 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
13,786 questions
SharePoint Server Development
SharePoint Server Development
SharePoint Server: A family of Microsoft on-premises document management and storage systems.Development: The process of researching, productizing, and refining new or existing technologies.
1,608 questions
Windows Server Storage
Windows Server Storage
Windows Server: A family of Microsoft server operating systems that support enterprise-level management, data storage, applications, and communications.Storage: The hardware and software system used to retain data for subsequent retrieval.
650 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Yanli Jiang - MSFT 26,016 Reputation points Microsoft Vendor
    2023-06-22T06:04:10.6333333+00:00

    Hi Tevon ,

    The decision to use incremental crawls or continuous crawls depends on your specific needs and requirements.

    Incremental crawls are used to update the index with changes made since the last crawl. This is useful when you have a large amount of content that changes frequently, but you don't want to perform a full crawl every time.

    Parallel Incremental Crawl Not possible.

    Incremental Crawl can be stopped or Paused in between the crawl process is running.

    Please note that continuous crawl doesn’t fix any errors – therefore, we still need incremental crawl run on the content source (every 4 hours, by default) even if we use continuous crawl.

    Continuous crawls, on the other hand, are used to keep the index up-to-date in real-time. This is useful when you have content that changes frequently and you need the search results to be as up-to-date as possible.

    The default interval is every 15 minutes, but you can set continuous crawls to occur at shorter intervals by using Microsoft PowerShell.

    Multiple continuous crawls can perform simultaneously.

    Once the continuous crawl is enabled, you cannot stop or pause it, you can only disable the crawl.

    Continuous crawls increase the load on the crawler and on crawl targets. Make sure that you plan and scale out accordingly for this increased consumption of resources.

    For more details, please see:

    https://video2.skills-academy.com/en-us/sharepoint/search/start-pause-resume-or-stop-a-crawl

    https://video2.skills-academy.com/en-us/sharepoint/search/best-practices-for-crawling

    https://video2.skills-academy.com/en-us/sharepoint/search/manage-continuous-crawls


    If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".

    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.