Filter URLs for Session IDs in Website Scraper Tool
Our website scraper tool supports filtering out common and custom session IDs when crawling website URLs.
Most webmasters avoid using session IDs in URLs and links,
in particular if the crawler/browser supports session cookies.
A1 Website Scraper defaults to accept
session cookies, but can when necessary filter out session IDs in all links and URLs.
If you enable automatic filtering of session IDs, notice that all common session variable names
are already included in default configuration. However, if your website uses a special name for session IDs, you can add it to the list.
