crawler.frontier_hosts (collection.cfg setting)
This option allows you to specify which hosts crawlers are running on when using a
DistributedFrontier (distributed crawling). Each host will be responsible for its own subset of the web servers being crawled.
Specify the IP addresses of the hosts that the distributed crawl is running on.