3.1k stars · GPL-3.0 · 2.0.23 (2026-07-08)
The opposite architecture from the LiteLLM-plus-custom-code path — batteries actually included: FastAPI, RAG, plugin loader, WebSocket chat, all in one image.
▶Repo detailsthe review · specs · pros & cons · install
What it is
An opinionated framework for a custom AI agent as a microservice. Ships a FastAPI service with built-in retrieval-augmented generation, a plugin loader, and a WebSocket chat endpoint. GPL-3.0.
Why it matters
Not for the app itself — Grasppy is its own architecture. The Cat is worth knowing about as the shortest path to a "chat with your docs" widget on the marketing site: point it at your Docling-produced pages, drop the widget into Starlight, and a reader on a tutorial can ask a follow-up. The alternative is building this yourself with LiteLLM + Instructor + pgvector — which you should for the actual product, but not for a marketing chatbot.
- Under 3k stars but a real Docker image and real docs — a working thing, not a research demo
- RAG, plugins and WebSocket chat all included
- GPL-3.0 — self-host and modify freely
- GPL-3.0 on a marketing chatbot is fine; embedding it inside a paid Grasppy feature is not
- Small community (3.0k stars); if the maintainer disappears, you are on your own
- Overlaps a stack you are already assembling — pick a lane, do not run both
A paid 'chat with your docs' widget
Docling for the markdown it reads, and a docs site to embed the widget in
Docker service beside Grasppy.