Sitemap Generator for e107 Websites
If your website uses e107 content management system, you have to adjust the sitemap generator crawler options to successfully crawl the e107 CMS based website and create HTML and XML sitemaps.
e107 CMS Websites and Sitemap Generator Tool
Some websites uses a content management system. Such systems sometimes include code that prevent website crawling by unknown robots.
From reports by users of A1 Sitemap Generator it seems that
e107 CMS is one such system.
Program Website Scan Settings for e107 CMS
Scan website | Crawler engine: Set max simultaneous connections/threads to one.
Crawler engine | Advanced engine settings: Set GET as default for page requests.
Mask the identity of the crawler in our sitemap generator software:
- Mimic "user surfing website":
- In General options and tools | Internet crawler set user agent to Mozilla/4.0 (compatible; MSIE 7.0; Win32).
- In Scan website | Webmaster filters disable/uncheck Download "robots.txt" and Obey "robots.txt" file if found.