crawler.cache.LRUCache_max_size
Maximum size of LRUCache. Upon reaching this size the cache will drop old elements.
Key: crawler.cache.LRUCache_max_size
Type: Integer
Can be set in: collection.cfg
Description
This is the maximum size of the LRU cache for URL storage. If too many elements are encountered the least recently used (LRU) elements in the cache will be flushed from the cache.
Default Value
crawler.cache.LRUCache_max_size=500000