indexing.use_manifest
Specifies if a manifest file should be used for indexing.
Key: indexing.use_manifest
Type: Boolean
Can be set in: collection.cfg
Description
This parameter is used to control the use of a manifest file during indexing.
If set to true the indexer will look for a manifest.txt file in the log directory. This file should contain a list of file paths, one per line. The indexer will index this list of files rather than scanning over the data directory.
This manifest.txt file is automatically output by the Funnelback webcrawler.
Note: this option should not be used if you are using a WARCStore.
Default Value
indexing.use_manifest=false
Examples
Turn on the use of the manifest:
indexing.use_manifest=true