In simple English
This tool searches Google, Bing, Yahoo, and other sites from a command line or a Python script. It grabs the results and saves them as files. You do not need to pay for an official search API. Search engines often block scrapers, so your IP address might get a temporary ban. You need some basic Python knowledge to run it.
What it is
A Python library that extracts search results from web pages without using official APIs. It supports proxies and outputs data in JSON, CSV, or HTML formats.
What it is good for
Solo builders who need to collect search results automatically without paying for commercial search APIs, and who can handle occasional IP blocks.
Status
No code changes since 2025-04-02.
- Collects results from multiple search engines using one script.
- Saves scraped data directly to CSV, JSON, or HTML files.
- Supports HTTP and SOCKS proxies to help avoid bans.
- May trigger temporary IP bans from search engines due to scraping.
- Requires a Python environment and some coding knowledge to operate.
- Some listed search engines no longer work because websites change often.
Paying for commercial search APIs or writing custom scraping scripts from scratch
Requests (a Python library for making HTTP requests easily)
- soxoj/async-search-scraper73 stars
An asynchronous version of a similar search scraper written for faster execution.
- cybertec-postgresql/pg_timetable1.4k stars
A job scheduler for PostgreSQL whose jobs and schedules live in the database itself.
- PrefectHQ/prefect24k stars
Adds scheduling, retries and a run history to Python functions you already have.
git clone https://github.com/tasos-py/Search-Engines-Scraper.git cd Search-Engines-Scraper python setup.py install