Request Header
Overview
Here, we will explain the configuration for request headers. Request headers contain additional information that is added to the requests when crawling and retrieving documents. They can be used, for example, to automatically log in a user based on specific header values, such as in an authentication system.
Management Methods
Display Method
To access the list page for configuring request headers shown below, click on “[Crawler > Request Header]” in the left menu.
To edit, click on the configuration name.
Creating Settings
To open the Request Headers settings page, click on the “Create New” button.
Setting Items
Name
Specify the name of the request header to be included in the requests.
Value
Specify the value of the request header to be included in the requests.
Web Config
Select the web crawl configuration to which the request headers will be applied. Only the selected crawl configuration will have the request headers added.
Deleting Settings
Click on the configuration name on the list page, and when the delete button is clicked, a confirmation screen will appear. Clicking the delete button will remove the configuration.