Data Reports

Introduction

The data reports provide statistics and reports on data gathered during the update process. These reports are only available for web collections.

Reports

These reports give a breakdown of which URLs contain broken links in the crawled dataset. It is possible to drill down into the report by clicking on the "site" link. CSV exports of the data are also available.

Generating Data Reports

Data reports are enabled by default for web collections, and are based on statistics files (named *.stat.md) generated by the web crawler in the log directory. These files are processed by a script called make_report.pl which outputs a set of static HTML reports in $SEARCH_HOME/admin/data_report/<collection>/

See also

top