Skip to content

crawler.follow_links_in_comments (collection.cfg setting)

Description

This parameter controls whether the webcrawler should follow links found inside HTML comments.

Caveats

This parameter does not apply to links extracted from Javascript code - please see the separate crawler.extract_links_from_javascript parameter to control the behaviour of following links in Javascript (which sometimes appears in HTML comments).

Default value

crawler.follow_links_in_comments=false

The default behaviour is false i.e. do not follow commented-out links.

See also

top

Funnelback logo
v15.18.0