Skip to content

crawler.cache.URLCache_max_size

Specifies the maximum size of URLCache.

Key: crawler.cache.URLCache_max_size
Type: Integer
Can be set in: collection.cfg

Description

This is the maximum size of the URL cache which records all URLs seen during the crawl (whether downloaded or not). This directive may be ignored by some cache implementations.

Default Value

crawler.cache.URLCache_max_size=50000000

⚠ Caveats

May be ignored by some cache implementations.

See Also

top

Funnelback logo
v15.22.0