Skip to content

crawler.revisit.num_times_revisit_skipped_threshold (collection.cfg setting)

Description

This parameter specifies a threshold to use when looking at how many times we have skipped revisiting a URL (and used a copy of its content instead).

A particular revisit policy might decide that if the number of times we have skipped a revisit for a given URL is higher than the threshold then a revisit would be required. The "number of times a revisit has been skipped" value for that URL would then be reset to zero.

Default value

crawler.revisit.num_times_revisit_skipped_threshold=2

See also

top

Funnelback logo
v15.16.0