how to crawl faster with expertrec search engine

How to increase search crawler speed in expertrec

Rate this article

Share this article

In this article we will see how to make expertrec search crawl your website faster.

How to increase search crawler speed in expertrec

A prerequisite is that you have created a custom search engine using expertrec from https://cse.expertrec.com/?platform=cse

How to increase crawler speed in expertrec control panel-

  1. Go to https://cse.expertrec.com
  2. Go to crawl-> Advanced -> Crawl speed -> Crawl speedHow to increase search crawler speed in expertrec
  3. Under crawl speed you have 4 crawl speed options by moving the slider-
    1. Slow crawl
    2. Polite crawl
    3. Fast crawl
    4. Aggressive crawl.
  4. By default the slow crawl option is set, you can choose any one of the above options depending upon your crawl speed requirements.
  5. You can reduce the page load delay time  to a smaller value for faster crawling.How to increase search crawler speed in expertrec
Are you showing the right products, to the right shoppers, at the right time? Contact us to know more.
You may also like