Skip to content

crawler.store_headers (collection.cfg setting)

Description

This parameter controls whether HTTP headers are stored when downloading content. This should normally be set to true, as these headers are used by the indexer and web crawler when doing incremental crawling.

Default value

crawler.store_headers=true

See also

top

Funnelback logo
v15.18.0