Skip to content

crawler.request_timeout (collection.cfg setting)

Description

This is the maximum number of milliseconds that the crawler will wait for a HTTP GET request to return. If the web server does not start to return the page in question before this timeout, the crawler assumes the page was unavailable.

Note: This value is multiplied by 4 to give the parser (link extraction) timeout.

Default value

crawler.request_timeout=15000

See also

top

Funnelback logo
v15.18.0