Data download available directly from Data Preview

Data download to XLSX or CSV from Data Preview mode.

Pick URL of the website

It would be useful that webscraper would have ability to pick website URL where it is at the moment.

Replace sitemap on import action

If there is a sitemap with the same name, ask if the user wants to replace it.

Ability to copy/clone a selector

Option to Pause and continue while scraping

Option to pause the scraping so that if we want to complete a captcha or if we want to move away from the system.

When in incognito mode, open scraper window in incognito mode

Expected: If working in incognito mode the scraper popup window is also opened in the incognito mode.

Bulk start URL import functionality

Scraping in ascending order when using page range

Example: www.domain.com?page=[1-9] Start scraping from page 1 and up.

Pause scraper if a Captcha is triggered

User can resolve the captcha and resume scraping

Show start time and end time in data output

Data output provides information on when the scraping was started and finished.

Sitemap backup functionality

Sitemaps are backed up locally in a designated folder

Network data selector

Add a selector that extracts data from XHR/Ajax

Sticky header for Sitemap controls

Expectation: Header with Sitemap controls remains visible when scrolling down the sitemap or selector list.

Add date and timestamp to the Export file name

Example: test-20190906.csv test-20190908-1115.csv

Add data download buttons to browse view

Going from “Browse“ to “Export data“ is an extra step. Add the download buttons to the “Browse“ view.

Time stamp

add time stamp of data extraction

Temporary toggle on/off selectors

While building and testing the sitemap to be able to toggle off the action of selectors without having to delete them.

Ability to delete sitemaps in bulk

Currently, sitemaps have to be deleted one-by-one which is a lot of clicks

Ability to change selector order in Website State Setup

Ability to change selector order in Website State Setup with drag and drop

Mark columns that should not be included in the export file

Example use case: to exclude navigation data columns like href and pagination