Sometimes you might want to add a search box to your authenticated pages ( pages that need a login for access). So while using a search engine crawler to index these pages, you have to give certain details so that it can go beyond the login pages. Doing this is very easy with expertrec site search engine.

Lets take an example. We want to index the following pages and the related URLs, behind login pages

Here login URL is the page URL. In this case it is

Login formid– To find the login form ID, open developer tools in your chrome browser (control+shift+i) and select the form element in the developer mode. In this case it is p_logincrawling behind login pages

Enter the id/name for username box- Select the id/name of the input box. Here it is p_txtUsername

Enter the id/name for password box- In the inspect element mode, click on the password box for the password box idcrawling behind login pages

Enter a username and password for the crawler and press update.

Now go to the home page and press recrawl. Thats it. Now you can go to your demo page and check if your search results include the behind login pages or not.crawling behind login pages


muthali ganesh

Muthali loves writing about emerging technologies and easy solutions for complex tech issues. You can reach out to him through chat or by raising a support ticket on the left hand side of the page.

1 Comment

Comments are closed.