Skip to content

crawler.protocols (collection.cfg setting)

Description

This option is a comma-separated list of protocols to process. Note that the protocol must be supported by the crawler configuration (See Crawler.packages.httplib).

Default value

crawler.protocols=http,https

Examples

Crawl HTTP only:

crawler.protocols=http

See also

top

Funnelback logo
v15.16.0