3.1k stars · GPL-3.0 · 2.0.23 (2026-07-08) · Track this in Scout
The opposite architecture from the LiteLLM-plus-custom-code path — batteries actually included: FastAPI, RAG, plugin loader, WebSocket chat, all in one image.
▶Repo detailsthe review · specs · pros & cons
What it is
An opinionated framework for a custom AI agent as a microservice. Ships a FastAPI service with built-in retrieval-augmented generation, a plugin loader, and a WebSocket chat endpoint. GPL-3.0.
What it is good for. The Cat is the shortest path to a "chat with your docs" widget on a marketing site: point it at Docling-produced pages, drop the widget into Starlight, and a reader on a tutorial can ask a follow-up. Building the same thing by hand means LiteLLM + Instructor + pgvector, which is the right call inside a real product but heavy for a marketing chatbot.
- Under 3k stars but a real Docker image and real docs — a working thing, not a research demo
- RAG, plugins and WebSocket chat all included
- GPL-3.0 — self-host and modify freely
- GPL-3.0 on a marketing chatbot is fine; embedding it inside a paid product feature is not
- Small community (3.0k stars); if the maintainer disappears, you are on your own
- Overlaps a stack this ledger has already assembled — pick a lane, do not run both
A paid 'chat with your docs' widget
Docling for the markdown it reads, and a docs site to embed the widget in
