How to increase search crawler speed in expertrec

In this article we will see how to make expertrec search crawl your website faster.

A prerequisite is that you have created a custom search engine using expertrec from https://cse.expertrec.com/?platform=cse

How to increase crawler speed in expertrec control panel-

1. Go to https://cse.expertrec.com
2. Go to crawl-> Advanced -> Crawl speed -> Crawl speed
3. Under crawl speed you have 4 crawl speed options by moving the slider-
   1. Slow crawl
   2. Polite crawl
   3. Fast crawl
   4. Aggressive crawl.
4. By default the slow crawl option is set, you can choose any one of the above options depending upon your crawl speed requirements.
5. You can reduce the page load delay time  to a smaller value for faster crawling.