Abstract: Explanation about progress status information during website crawl in A1 Keyword Research Navigation:A1 Keyword Research - Help Index
Understand Website Scan Information
The website crawler keeps total counts for following states:
Listed found:
Unique URLs located.
Listed deduced:
Appears after website scan has finished: Assume crawler during scan found links to
"example/somepage.html", but none to "example/". The latter is then "deduced" to exist.
Analyzed content:
Unique URLs with content analyzed.
Analyzed references:
Unique URLs with content analyzed and have all their links in content resolved (e.g. links to URLs that redirects).
Log and Analyze Website Crawling Issues
If you experience strange problems spidering your website,
you can try enable Scan website - Data collection - Logging of progress.
After website scan, you can find a log file in the program data directory logs/misc.
The log file can be useful in solving problems related to crawler filters, robots.txt, no-follow links etc.
You can find out through which page the crawler first found a specific website section.