Microsys
Tell a Friend  Link to  Bookmark  Feedback   Language
Online StoreOur SoftwareCompany ForumCompany BlogAbout UsContact Us

Keyword Research and e107 CMS Websites

Abstract: If your website uses e107 content management system, you have to adjust A1 Sitemap Generator crawler options to successfully crawl the e107 CMS based website and create HTML and XML sitemaps.
Navigate: Keyword Research | Buy | Download | Help Index

e107 CMS Websites and Sitemap Generators

Some websites uses a content management system. Such systems sometimes include code that prevent website crawling by unknown robots. From reports by users of A1 Keyword Research it seems that e107 CMS is one such system.


Sitemap Generator Settings for e107 CMS


  • Scan website | Crawler engine: Set max simultaneous connections/threads to one.

  • Crawler engine | Advanced engine settings: Set GET as default for page requests.

  • Mask the identity of our sitemap crawler:

    • Mimic "user surfing website":
      • In General options | Internet crawler set user agent to Mozilla/4.0 (compatible; MSIE 7.0; Win32).
      • In Scan website | Webmaster filters disable/uncheck Download "robots.txt" and Obey "robots.txt" file if found.

Company


Community

Website software tools


Business software utilities


Popular freeware programs

Online tools


Webmaster articles


Website promotion resources

 © Copyright 1997-2010 Microsys | about | contact | legal | privacy