AI and models · Independent · 28 Oct 2026

LostRuins/koboldcpp

KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.

← AI and models
KoboldCpp: local AI runner. Runs large language models and multimodal AI files locally.
Verified28 Oct 2026

Radar check

What we found when we opened it. Every bar is one fact, with its date.

Alive100

Last code pushed 28 Oct 2026, the same day before this check.

Releases100

Latest release v1.123.1 on 13 Oct 2026.

Maturity70

Public since March 2023, a little over 3 years.

Adoption82

12,083 stars and 802 forks.

Activity100

1,748 commits and 104 new issues in the last 90 days.

Community100

2,180 contributors. 51 pull requests merged in 90 days.

Security40

No security policy file says how to report a problem. 2 published security advisories.

Licence AGPL-3.0: free to run; offering a changed copy to others as a service means publishing your changesSetup effort 2 of 5Payoff 4 of 5
How the bars are scored
  • Alive. Days since the last code push: a week or less 100, a month 90, three months 70, six months 50, a year 30, eighteen months 15, older 0.
  • Releases. Age of the latest GitHub release, on a similar scale; no bar when the project publishes no releases.
  • Maturity. Age of the project: eight years 100, five 90, three 70, two 55, one 40, six months 25, younger 10.
  • Adoption. Stars on a log scale: 100,000 stars is 100, 10,000 is 80, 1,000 is 60, 100 is 40.
  • Activity. Commits in the last 90 days: 300 or more 100, 100 85, 30 65, 10 45, any 25.
  • Community. People who have contributed: 100 or more 100, 30 80, 10 60, 5 40, 2 25, one 10.
  • Security. A published security policy 80, none 40; published advisories are listed, not scored.

Checked by Repo Radar on 28 Oct 2026 from the repository on GitHub.

In simple English

This tool lets you run powerful artificial intelligence models right on your own computer. You download one file, pick a model file, and start a local web page in your browser. It chats with you, writes stories, and generates images or voice clips without sending your data to the cloud. You do not need to install complex programming tools to use it. It is free to run, though you need a computer with enough memory to hold the model.

What it is

KoboldCpp is a single-file program that packages a chat interface and an AI engine into one executable. It runs text, image, and audio models on your computer's CPU or graphics card.

What it is good for

Solo builders who want to run private AI models locally for chatbots, writing tools, or local API development without paying monthly subscription fees.

Stars12k
LicenceAGPL-3.0
Latestv1.123.1 (2026-10-13)checked 28 Oct 2026
Last code change2026-10-28
Written inC++
Summary (Key Points)from the README
Key features
  • Local text generation: Runs any GGUF language model in chat, adventure, instruct, or story modes, and compatible vision models add image understanding.
  • Image and video generation: Supports Stable Diffusion 1.5, SDXL, SD3, and Flux for images, plus WAN 2.2 and LTX2.3 for video.
  • Speech and music: Whisper handles speech-to-text, Kokoro and Qwen3TTS handle text-to-speech, and ACE Step 1.5 handles music generation.
  • Tools and agents: Supports MCP servers, tool calling, web search, and RAG through TextDB, plus an integrated KoboldCpp Agent that starts with `--agent`.
  • Writing and roleplay: The bundled KoboldAI Lite WebUI offers memory, world info, author's notes, and Tavern character card import.
  • Compatible APIs: Endpoints for KoboldAI, OpenAI, Ollama, A1111/Forge, ComfyUI, Whisper, and XTTS are served at the default `http://localhost:5001`.
  • Portable executable: One file for Windows, Linux, or macOS needs no installation and runs on CPU or GPU with full or partial offloading.
  • Hosted provider mode: Launching with `--nomodel` connects the web UI to AI Horde, OpenAI Compatible, Anthropic, OpenRouter, Gemini, Grok, or Mistral instead of a local model.
Ways to install
Platform or methodWhat it needsEffort
Windows executableDownload `koboldcpp.exe` and double-click itLow
Linux x86-64 binary`chmod +x`, then run from a terminalLow
macOS (Apple Silicon)`chmod +x`, and possibly a security whitelist stepLow
Android via TermuxTermux from F-Droid, then the installer script or a manual build with a small GGUF modelMedium
Source buildGit, Python 3, a C/C++ toolchain, and GPU backend librariesHigh
Google ColabA Google account, and compliance with Colab's termsLow
DockerExperts only, with an NVIDIA or AMD GPU expectedHigh
Important
  • Models not included: KoboldCpp ships without model files, so you must download a GGUF model separately.
  • Phishing risk: `koboldcpp.com` is a malicious fake site. Only trust the official GitHub releases or koboldcpp.net.
  • Hardware limits: Memory needs depend on model size and context length, and autofit is only an estimate that may need manual tuning.
  • Old CPUs: Some devices crash at startup; try the `oldpc` build or `--noavx2`.
  • Intel Macs: These require a source build.
  • Docker: It may perform poorly on some Windows or macOS setups, and ARM systems may fail to run it.
  • Android: The instructions cover CPU builds only, and GPU acceleration depends on the device and its drivers.
  • Third-party projects: Unofficial packages and forks may be outdated or unmaintained.
  • Licence: KoboldCpp and KoboldAI Lite use AGPL v3.0, while bundled components keep their own licences.

Written by an AI model from the project’s README; not part of the review, and it can be wrong.

Setup effort
2 / 5
Payoff
4 / 5
Good
  • Runs entirely offline without sending your private data to external servers.
  • Packaged as a single standalone executable file with zero complex installation steps.
  • Provides compatible API endpoints so other apps can talk to your local model as if it were OpenAI.
Watch for
  • Requires a computer with a dedicated graphics card and plenty of RAM to run large models smoothly.
  • Downloading and selecting the right model files and hardware settings can be confusing for beginners.
  • Uses the AGPL-3.0 licence (a strict open-source licence that requires you to share your source code if you modify the software and host it publicly).
Replaces

Paid cloud AI chat subscriptions and complex local Python AI environments

Works well with

A GGUF model file downloaded from Hugging Face

Similar repositories
  • ollama/ollama185k stars

    Get up and running with large language models locally via a simpler command-line tool.

  • ggml-org/llama.cpp133k stars

    The low-level C++ inference engine that powers the model execution underneath KoboldCpp.

Also reviewed on Repo Radar
  • vllm-project/vllm96k stars

    A serving engine that makes one graphics card answer many requests at once.

  • infiniflow/ragflow93k stars

    A question-answering system built on a document collection, with the sources shown beside every answer.

  • basicmachines-co/basic-memory4.3k stars

    Gives an AI assistant a memory that is stored as plain text files you can read.

Install
curl -fLo koboldcpp-linux-x64 https://github.com/LostRuins/koboldcpp/releases/latest/download/koboldcpp-linux-x64
chmod +x koboldcpp-linux-x64
./koboldcpp-linux-x64

Independent: reviewed for Repo Radar outside the daily editions. Every independent repository

On Stack Radar: AI & Automation › AI Models & Inference › Language Models.

Get the next edition in your inbox

A dozen repositories, opened and checked. The licence read, the last release dated, and the ones that did not make it named with the reason. It is the half most lists leave out.

No tracking pixels. One click to leave. The archive stays free either way.

We use your address to send the edition and nothing else. Confirm by email, leave in one click. How we handle it.