Google Webmaster Tools Webcrawl Diagnostics and Errors

Many people submit generated XML sitemaps directly to Google Webmaster Tools. However, when viewing Webcrawl Diagnostics, they see Google report mysterious website crawling problems.

When viewing the list of submitted sitemaps, the webmaster tools shows if any of them have warnings and/or errors. Unfortunately, the red flag graphic is used for both critical errors and warnings. (The latter does not prevent Google from indexing the XML sitemap.)

However, it is possible to see the exact error message that causes the sitemap error/warning flag to be shown. To see how, check the underneath screenshot taken from the webmaster sitemap tools.

An error often reported for URLs is 404 : Not Found. You may get such errors even if your website has no internal linking errors, and your XML sitemap is 100% correct.



Google follows links from websites all over the internet. Google remembers these links for quite a long time. In our experience, this means that if some website at some point in time has linked to a non-existing page at your website, Google will keep reporting this as an error for a long time.

Examples of how incorrect links to your website can occur on external websites:

• Someone posted and mistyped a link to your website on a forum.
• You posted a link on a website which incorrectly shortened it.

Your generated XML sitemaps can not contain URLs that redirect if you want Google sitemap tools to accept them. This includes error codes 301 : Moved Permanently, 302 : Found and 302 : Moved Temporarily.

A1 Sitemap Generator will never include URLs that redirect unless explicitly configured so. Instead it will include the redirect destination URLs.