Skip to content

crawler.max_download_size

Specifies the maximum size of files the crawler will download (in MB).

Key: crawler.max_download_size
Type: Integer
Can be set in: collection.cfg

Description

This parameter specifies the maximum download size for any single file during the crawl. The value is specified in MB (Megabytes). The default value is 10 MB.

This download limit applies to both HTML files and binary files (e.g. PDF, Word etc.).

Default Value

crawler.max_download_size=10

See Also

top

Funnelback logo
v15.22.0