Web Scraper

Sitemap Wizard + AI-Powered Selector Generation - Now Available

We have released a major update to our Web Scraper extension, making data extraction faster, easier, and more reliable.

Highlights:
• New Sitemap Wizard - Create sitemaps in just a few clicks with a redesigned interface.
• AI-Powered Selector Generation - Automatically detects and maps selectors for listing pages and product pages.
• Improved Selector Tools - Avoid unstable CSS classes and keep your scrapers running with less maintenance.

Read the full update: https://webscraper.io/blog/sitemap-wizard-update
See the new Sitemap Wizard in action: https://www.youtube.com/watch?v=zdhBsDHTWME

Web Scraper Sitemap Wizard This video provides a walkthrough of the Web Scraper Sitemap Wizard, a tool used to create and configure sitemaps for web data extraction. It covers the basi...

We're thrilled to share the latest enhancements in our extension to make your experience even smoother. Check out the new features and improvements in our latest release:

Features:

1. Confirmation Popup for Selector Deletion:

Never worry about accidental deletions! Now, a handy confirmation popup will ensure you're intentional when removing a selector.

2. Enhanced Link Selector:

We've supercharged the link selector to allow you to pick elements that may not be HTML links but contain valuable links. Flexibility at its finest!

3. HTML Code Display on Hover:

Get a closer look at your web elements! Hover over an element, and voila, the corresponding HTML code will be displayed, making the selection even more precise.

Fixes:

1. Faster Data Extraction:

We've tackled a slowdown issue on some sites caused by Chrome background page throttling. Enjoy quicker and more efficient data extraction!

2. Smooth Sailing Through Page Loads:

Say goodbye to hiccups! Our fix ensures the scraper won't get stuck on a bad page load, providing a seamless scraping experience.

Refactoring:

1. UI Code Revamp:

Behind the scenes, we've been hard at work refining our UI code. You may notice some changes already as they lay the foundation for future improvements and a more polished user interface.

Your feedback has been invaluable in shaping these updates. We're committed to delivering a top-notch experience, and these features are just the beginning. Try them out, and let us know what you think!

The shortlist for 🏆 Latvian Startup Awards 2023 🏆 is here! Top-3 startups and founders in 7 categories - you will find out the jury-chosen winners on September 8. Check them out below, or on our website: https://startupawards.lv/latvian-startup-awards-finalists/

❗ But that's not all - voting for the final, 8th category, COMMUNITY CHOICE, is open! Which startup inspires you? Vote now: https://startupawards.lv/community-choice-voting/
Deadline - midnight of September 6!

🎊 See you there on September 8 and let's celebrate the winners together!

BREAKTHROUGH
Aerones | Giraffe360 | Naco Technologies

NEWCOMER
PrintyMed | Swotzy | Trace.Space

SCALEUP
Giraffe360 | Lokalise | Printify

IMPACT
BirgerMind | Cellbox Labs | Longenesis

HARDWARE
Aerones | Giraffe360 | WeedBot

DIGITAL
ATOM Mobility | Corebook | Web Scraper

FOUNDER-HERO
Artis Kehris | Emil Syundyukov | James Janis Berdigans

COMMUNITY CHOICE
👉 Vote now! https://startupawards.lv/community-choice-voting/

Hey there! We've got some major news to share with you that will up your scraping game. We're thrilled to introduce the latest and greatest version of Web Scraper. Take your experience to a new level with the newly updated Link Selector and more.

To read the full article about the changes made in the newest release, visit https://webscraper.io/blog/web-scraper-1.29.66-release

Happy scraping!

It has been a while since the last update, but we are back with a new release and are excited to share with you what have we been up to.

In the latest Web Scraper update, we have done some code refactoring so everything works smoothly with the new Chrome manifest V3 API, added a 'drag' feature so the selector order can be changed easily at any time, implemented an auto selector optimization for improved scraping performance and more.

You can read the full article here - https://webscraper.io/blog/web-scraper-1.29.60-release

For the last months, we have been working towards the Web Scraper 0.6.5 release and finally, it is here!

Mainly, our focus has been on 'under the hood' features, with the goal of making the UX as seamless as possible.

Sadly, no fancy new selectors this time round, but, the experience and workflow of the tool should be improved significantly.

There has been a couple of new features added as well as a lot of validators, bug fixed and tons and tons of refactoring.

So, you might ask, what will be different moving forward? The new release includes Firefox sitemap sync with Web Scraper Cloud, new data export order and more...

You can find the full list of changes here - https://webscraper.io/blog/web-scraper-0.6.5-release

Even though mostly, the Web Scraper selector tool does its magic on its own, on occasion, you just need that extra flexibility to make your sitemap bulletproof.

This is where creating selectors manually might be the right choice for you. So, let's nerd it up together! 🥸

In the article, we are looking into more advanced selectors, such as isolating elements positionally, containing certain string values or attribute values and how these selectors can be chained together to capture these tricky elements.

To find out more, head on to -

A Quick Guide to CSS and jQuery Selectors for Web Scraper The most popular web scraping extension. Start scraping in minutes. Automate your tasks with our Cloud Scraper. No software to download, no coding needed.

Looking for an easy way of integrating Amazon Athena into your data analysis workflow?

Now, Web Scraper Cloud allows you to do so - export your data directly to Amazon S3 and use the powerful features available to Amazon Athena.

Here is a quick guide on how to get you up and running in minutes - https://webscraper.io/blog/data-analysis-using-anazon-athena

🥳 Another day, another integration! 🥳

You asked for it, we delivered it!

Web Scraper Cloud now supports data export to Google Drive.

Check it out yourself by signing up for a 7-day free trial - https://cloud.webscraper.io/register

Looking for alternative ways of collecting data? Where to start? What to use? What are the options?

This time, we are discussing the use of node package Cheerio for data extraction.

What set-up is needed, what to look out for and what results to expect? Check out our latest article -

Headless Scraping with Cheerio The most popular web scraping extension. Start scraping in minutes. Automate your tasks with our Cloud Scraper. No software to download, no coding needed.

Ever thought of scraping information from such public data conglomerates as LinkedIn, Facebook and others? Is this prohibited or can the public information be collected?

Well... the short answer is - it depends.

We asked a Data Protection Specialist about this topic and here is the answer -

Scraping public data. Is it legal? The most popular web scraping extension. Start scraping in minutes. Automate your tasks with our Cloud Scraper. No software to download, no coding needed.

In light of the recent developments regarding Russia's invasion of Ukraine, Web Scraper has suspended access to our platform for all Russian and Belarussian users.

We stand with Ukraine!