In this article we will see how to make expertrec search crawl your website faster.

How to increase search crawler speed in expertrec

A prerequisite is that you have created a custom search engine using expertrec from https://cse.expertrec.com/?platform=cse

How to increase crawler speed in expertrec control panel-

  1. Go to https://cse.expertrec.com
  2. Go to crawl-> Advanced -> Crawl speed -> Crawl speedHow to increase search crawler speed in expertrec
  3. Under crawl speed you have 4 crawl speed options by moving the slider-
    1. Slow crawl
    2. Polite crawl
    3. Fast crawl
    4. Aggressive crawl.
  4. By default the slow crawl option is set, you can choose any one of the above options depending upon your crawl speed requirements.
  5. You can reduce the page load delay timeĀ  to a smaller value for faster crawling.How to increase search crawler speed in expertrec

muthali ganesh

Muthali loves writing about emerging technologies and easy solutions for complex tech issues. You can reach out to him through chat or by raising a support ticket on the left hand side of the page.