In simple English
This tool crawls websites to inspect links, meta tags, and headings. It helps you find search engine optimization errors on your site. You run it on your own computer through a web browser. It costs nothing to use, and you do not need a paid subscription. You need some technical comfort to install and run it.
What it is
LibreCrawl is a Python Flask web application that crawls websites, analyzes SEO data, renders JavaScript pages, and exports results. It supports multiple users and provides a plugin system for custom analysis.
What it is good for
Solo builders and site owners who want to audit their website structure, check links, and find missing meta tags without paying hundreds of dollars for commercial desktop software.
- Runs locally or in Docker with no subscription fees.
- Renders JavaScript for modern single-page applications.
- Exports crawl results to CSV, Excel, JSON, or XML.
- Requires Python or Docker knowledge to set up.
- JavaScript rendering makes crawling noticeably slower.
- Large websites require significant memory and disk space.
Screaming Frog SEO Spider
Playwright
- GoogleChrome/lighthouse-ci7.1k stars
Runs the standard page audit on every code change and fails the change if the page got slower.
- harlan-zw/nuxt-seo1.5k stars
Seven search-engine and answer-engine modules for Nuxt sites, installed as one package.
- Swetrix/swetrix1.2k stars
Website analytics with no cookies, plus performance monitoring and error tracking, which you can host yourself.
git clone https://github.com/PhialsBasement/LibreCrawl.git cd LibreCrawl cp .env.example .env docker compose up -d