Skip to content

crawler.max_download_size (collection.cfg setting)

Description

This parameter specifies the maximum download size for any single file during the crawl. The value is specified in MB (Megabytes). The default value is 10 MB.

This download limit applies to both HTML files and binary files (e.g. PDF, Word etc.).

Default value

crawler.max_download_size=10

See also

top

Funnelback logo
v15.16.0