Browser Automation — paid against free

Paid against free › Data & Research › Web Scraping & Crawling › Browser Automation · Automation and scraping on Repo Radar

Paid 0 reviewed

Prices and free tiers as checked, dated on each review.

Paid tools for this job are being added. The free alternatives below are ready to use.

Free to use. You run it on your own server.

They do this job.

A Python toolkit for collecting data from web pages that can find an item again after the page layout changes.

A Python framework for collecting data from web pages that are trying to block automated visitors.

A version of curl whose connections look exactly like a real browser's.

A command-line tool that takes screenshots of web pages, records short demonstration videos, and pulls data out of pages.

A second choice: they cover part of this job or are a building block for it.

A crawler service that turns websites into clean Markdown or structured data.

Installs and looks after one reader per website so an assistant can read public web content.

A crawler that turns web pages into clean text for a language model.

A Python framework for fetching and parsing large numbers of web pages.

It runs small agents that watch things and act on what they find.

A crawling framework for JavaScript that manages the queue, the retries and the rate limits.

It downloads every picture from an album or a profile with one command.

A Python scraper that learns what to extract from one example you give it.

Like `jq`, but for HTML: it pulls parts out of a page using CSS selectors.

A Python tool that pulls the article out of a web page and leaves the menus and adverts behind.

Saves a web page in a real browser, so the copy still works later.

One job at a time: the paid tools worth paying for, the free ones you can run yourself, and who should pick which.

No tracking pixels. One click to leave. We use your address to send Stack Radar and nothing else. Privacy.