In simple English
This tool watches websites for changes, downloads data and runs automated browser tasks. It runs as a small background program on your computer or server. You write simple configuration files to tell it what pages to watch. It can send alerts to your desktop or through webhooks when something changes. It uses very little memory and requires no setup of external databases.
What it is
SpyWeb is a self-contained monitoring and scraping engine written in Rust with built-in scheduling and Lua scripting. It ships as a single file of around 8 megabytes and uses less than 10 megabytes of memory at idle.
What it is good for
Solo builders who want to track price drops, check competitor listings, monitor public records or run simple automated web tasks without paying for a cloud subscription.
- Packs everything into a single small binary file with almost zero idle memory use.
- Allows complex custom logic and data handling using embedded Lua scripts.
- Includes a built-in scheduler, internal database and desktop or webhook alerts out of the box.
- Requires comfort with the command line and writing configuration files.
- Browser automation features require a separate installation of Chromium or Chrome on your system.
- Aggressive scraping intervals can easily get your server or IP address blocked by target websites.
Heavy Python scraping scripts, paid monitoring services and complex cron job setups.
Chromium, SQLite and custom webhook receivers.
- dgtlmoon/changedetection.io35k stars
A popular web page change detection tool with a graphical interface and notification options.
- apify/crawlee26k stars
A web scraping and browser automation library for JavaScript and TypeScript developers.
- PrefectHQ/prefect24k stars
Adds scheduling, retries and a run history to Python functions you already have.
- alirezamika/autoscraper8.1k stars
A Python scraper that learns what to extract from one example you give it.
curl -L -o spyweb.tar.gz https://dl.spyweb.app/linux && tar -xf spyweb.tar.gz && rm spyweb.tar.gz ./spyweb start