Data download available directly from Data Preview

Data download to XLSX or CSV from Data Preview mode.

Pick URL of the website

It would be useful that webscraper would have ability to pick website URL where it is at the moment.

Replace sitemap on import action

If there is a sitemap with the same name, ask if the user wants to replace it.

Ability to copy/clone a selector

Option to Pause and continue while scraping

Option to pause the scraping so that if we want to complete a captcha or if we want to move away from the system.

Bulk start URL import functionality

Scraping in ascending order when using page range

Example: www.domain.com?page=[1-9] Start scraping from page 1 and up.

When in incognito mode, open scraper window in incognito mode

Expected: If working in incognito mode the scraper popup window is also opened in the incognito mode.

Show start time and end time in data output

Data output provides information on when the scraping was started and finished.

Sticky header for Sitemap controls

Expectation: Header with Sitemap controls remains visible when scrolling down the sitemap or selector list.

Add date and timestamp to the Export file name

Example: test-20190906.csv test-20190908-1115.csv

Sitemap backup functionality

Sitemaps are backed up locally in a designated folder

Pause scraper if a Captcha is triggered

User can resolve the captcha and resume scraping

Add data download buttons to browse view

Going from “Browse“ to “Export data“ is an extra step. Add the download buttons to the “Browse“ view.

Network data selector

Add a selector that extracts data from XHR/Ajax

Time stamp

add time stamp of data extraction

Ability to delete sitemaps in bulk

Currently, sitemaps have to be deleted one-by-one which is a lot of clicks

Ability to download images while scraping

Use cases: The image might only be accessible within the current session The image might be dynamic and does not exist outside the current context The image might not be public, and only accessible when you are logged in

Allow clicking on elements within the page, whilst the selection tool is active

When ALT key is pressed, the click should perform a website click and not element selection

Temporary toggle on/off selectors

While building and testing the sitemap to be able to toggle off the action of selectors without having to delete them.