Microsys
  

Download and Archive Content from Ask and Answer Websites

If a website full of important questions and answers is about to close, you may want a local copy for your own use.
Help: overview | previous | next

 To see all the options available, you will have to switch off easy mode 

 With options that use a dropdown list, any [+] or [-] button next to adds or removes items in the list itself 

Do You Have Permission to Download Questions and Answers

As we are not lawyers, we can not give legal advice, and hence we do not know if you are allowed under e.g. fair use to download such content, even if just for your own usage.

You may want to either:
  • Ask for explicit permission from the website with the questions and answers.
  • Contact a lawyer and seek legal advice before you proceed.


How to Configure A1 Website Download

  • Scan website > Paths
    • Set website domain address and/or directory path to the same root domain address the content (here questions and answers are located, e.g. http://answers.example.org.
    • In Beyond website root path, initiate scanning from paths add some paths that lead to he content you want, e.g. search phrases http://answers.example.org/search-results?search-for-questions=example

      Note: The file download path of this URL is also the best starting point to view and surf the downloaded content offline.

  • Scan website > Analysis filters
    • In limit analysis of internal URLs to which match as "relative path" OR "text" OR "regex" in list add the following limit-to filter to limit which page URLs get and analyzed for URLs. In this case: ::search-results\?search-for-questions=example(&page=[0-9]{1,4})?

      Using the above limit filter A1 Website Analyze will crawl all search result pages that up till and including result page 9999.

This help page is maintained by

As one of the lead developers, his hands have touched most of the code in the software from Microsys.

If you email any questions, chances are that he will be the one answering them.
A1 Website DownloadAbout A1 Website Download

Download and take complete websites with you to browse on offline media. Copy and store entire sites for backup, archive and documentation purposes. Never loose a web site again.
Share this page with friends   LinkedIn   Twitter   Facebook   Pinterest   Google+   YouTube  
 © Copyright 1997-2017 Microsys

 Usage of this website constitutes an accept of our legal, privacy and cookies information.