Data download available directly from Data Preview

Data download to XLSX or CSV from Data Preview mode.

Pick URL of the website

It would be useful that webscraper would have ability to pick website URL where it is at the moment.

Replace sitemap on import action

If there is a sitemap with the same name, ask if the user wants to replace it.

Sticky header for Sitemap controls

Expectation: Header with Sitemap controls remains visible when scrolling down the sitemap or selector list.

Ability to copy/clone a selector

Network data selector

Add a selector that extracts data from XHR/Ajax

Ability to delete sitemaps in bulk

Currently, sitemaps have to be deleted one-by-one which is a lot of clicks

Add date and timestamp to the Export file name

Example: test-20190906.csv test-20190908-1115.csv

Bulk start URL import functionality

When in incognito mode, open scraper window in incognito mode

Expected: If working in incognito mode the scraper popup window is also opened in the incognito mode.

Show start time and end time in data output

Data output provides information on when the scraping was started and finished.

Add grouping to Text, Image and Element Attribute selectors

Currently, only Grouped Selector can extract data from multiple elements into a single cell. Add a configuration option to Text, Image and Element Attribute selectors: Extraction type: First element only (this is the current solution) Join values (data from all elements will be joined in a single value) separator (additional input to specify glue - ",") Multiple columns (selector creates multiple columns instead of one. For example image1, image2, image3) column count (number of generated columns specified upfront)

Add data download buttons to browse view

Going from “Browse“ to “Export data“ is an extra step. Add the download buttons to the “Browse“ view.

Allow clicking on elements within the page, whilst the selection tool is active

When ALT key is pressed, the click should perform a website click and not element selection

Sitemap backup functionality

Sitemaps are backed up locally in a designated folder

Include failed pages/URLs in the data output

Record pages that didn’t load and get scraped.

Temporary toggle on/off selectors

While building and testing the sitemap to be able to toggle off the action of selectors without having to delete them.

Ability to change selector order in Website State Setup

Ability to change selector order in Website State Setup with drag and drop

Fallback Selector for Web Scraping

When scraping data from a webpage, we often expect certain elements (selectors) to be present. However, there may be cases where the expected selector is missing. In such situations, the scraper should be able to look for an alternative selector to gather the data from. How It Works: The scraper first looks for the primary selector. If the primary selector is not found, the scraper automatically looks for a fallback selector. If neither selector is found, the scraper could either stop or log an error. This feature ensures that the web scraper can handle missing or changing page structures and still gather data efficiently.

Enable dark theme for Web Scraper extension