# KoboldCpp

> Source: https://aiwiki.ai/wiki/koboldcpp
> Updated: 2026-11-17
> Fact-checked: 2026-11-17
> Categories: Developer Tools, Large Language Models, Open Source AI
> License: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/) - attribute to "AI Wiki (aiwiki.ai)"
> Cite as: AI Wiki. "KoboldCpp." aiwiki.ai, 17 Nov 2026. https://aiwiki.ai/wiki/koboldcpp
> From AI Wiki (https://aiwiki.ai), the free encyclopedia of artificial intelligence. Reuse freely with attribution.

**KoboldCpp** is a free, open-source program for running [large language models](https://aiwiki.ai/wiki/large_language_model) and other generative models on a user's own computer. It is distributed as a single executable file that needs no installation, loads models in the [GGUF](https://aiwiki.ai/wiki/gguf) format, and serves a bundled browser interface, KoboldAI Lite, together with several application programming interfaces (APIs).[1] The project is a fork of [llama.cpp](https://aiwiki.ai/wiki/llama_cpp) hosted on [GitHub](https://aiwiki.ai/wiki/github) and maintained by the developer known as LostRuins, who also goes by Concedo. Its own code is licensed under the GNU Affero General Public License version 3 (AGPL-3.0).[2][1][3]

The software began in March 2023 as llamacpp-for-kobold, a bridge between llama.cpp and the KoboldAI writing tools, and was renamed KoboldCpp on April 3, 2023.[4][5] It has since grown to cover image, video, speech and music generation, a terminal coding agent, and compatibility layers for the [OpenAI](https://aiwiki.ai/wiki/openai), [Anthropic](https://aiwiki.ai/wiki/anthropic) and [Ollama](https://aiwiki.ai/wiki/ollama) APIs.[1] As of November 17, 2026, the latest release was version 1.124.2, and the repository had 12,332 stars and 826 forks on GitHub.[6][2]

## History

### KoboldAI background

KoboldCpp is named after KoboldAI, a community project for AI-assisted fiction that its README cites as its inspiration.[1] The original KoboldAI Client, whose GitHub repository was created on May 2, 2021, describes itself as a browser-based front end for AI-assisted writing with local and remote models. It offers Memory, Author's Note and World Info fields for steering a story, an Adventure mode played like the text game AI Dungeon, and a chatbot mode. Its README credits a contributor called The Gantian as the creator and lists Henk717 among the contributors.[7][8] As of November 2026 that README calls the client legacy software that is no longer maintained and directs readers to KoboldCpp.[7]

Before starting KoboldCpp, LostRuins had written KoboldAI Lite, a single-page web interface for KoboldAI back ends and for AI Horde, a volunteer-run network of text and image generation workers. The Lite repository dates from December 24, 2022.[9][3][10]

### From llamacpp-for-kobold to KoboldCpp

The KoboldCpp repository was created on March 16, 2023, six days after llama.cpp's own repository.[2][11] The first release, llamacpp-for-kobold-1.0.0, followed on March 18, 2023. Its notes describe an initial version without bundled weights, started by running a [Python](https://aiwiki.ai/wiki/python) script with the path of a [quantized](https://aiwiki.ai/wiki/quantization) [GGML](https://aiwiki.ai/wiki/ggml) model and a port number.[4] Version 1.0.1, two days later, told users to connect through the hosted KoboldAI Lite page or the full KoboldAI client. Version 1.0.2 on March 21 embedded Kobold Lite in the program and changed the project's license to AGPL version 3.[12][13] Release 1.0.4 on March 24 introduced a standalone Windows executable built with PyInstaller, the packaging the project still uses.[14][6]

Release 1.0.8beta on April 3, 2023 renamed the project. Its notes read "Rebranded to koboldcpp (formerly llamacpp-for-kobold)", and the same release added loaders for the GPT4All and [GPT-J](https://aiwiki.ai/wiki/gpt_j) model formats, so the program was no longer tied to [LLaMA](https://aiwiki.ai/wiki/llama)-family models.[5] Support for [GPT-2](https://aiwiki.ai/wiki/gpt-2) and an instruct mode compatible with Stanford's [Alpaca](https://aiwiki.ai/wiki/alpaca) prompt format arrived two days later, version 1.1 on April 7 simplified the version numbering, and [RWKV](https://aiwiki.ai/wiki/rwkv) models were supported from version 1.10 on April 18.[15][16][17]

### Expansion beyond text

Through 2023 the releases concentrated on text generation: GPU acceleration, a graphical launcher, new samplers and the move to GGUF. From 2024 the project integrated other inference libraries, which added image generation, speech recognition and synthesis, video and music. The table lists milestones as dated in the repository's release history.[18]

| Date | Version | Change |
|---|---|---|
| March 18, 2023 | 1.0.0 | First release, as llamacpp-for-kobold [4] |
| April 3, 2023 | 1.0.8beta | Renamed KoboldCpp; GPT4All and GPT-J formats [5] |
| April 12, 2023 | 1.5 | Experimental GPU prompt processing through CLBlast [19] |
| April 14, 2023 | 1.7 | Smart Context [20] |
| April 28, 2023 | 1.15 | Graphical "Easy Mode" launcher [21] |
| June 29, 2023 | 1.33 | CUDA support in a single all-in-one build [22] |
| July 24, 2023 | 1.37.1 | Embedded AI Horde worker [23] |
| August 24, 2023 | 1.41 | GGUF model support; `.kcpps` settings files [24] |
| October 1, 2023 | 1.45.2 | OpenAI-compatible completions endpoint [25] |
| November 4, 2023 | 1.48.1 | Context Shifting; Min-P sampler [26] |
| January 27, 2024 | 1.56 | Vulkan GPU back end [27] |
| March 4, 2024 | 1.60.1 | Local image generation through stable-diffusion.cpp [28] |
| March 13, 2024 | 1.61.2 | Vision through multimodal projectors [29] |
| June 4, 2024 | 1.67 | Speech-to-text through whisper.cpp [30] |
| August 19, 2024 | 1.73.1 | Official macOS binaries [31] |
| November 30, 2024 | 1.79.1 | Ollama API emulation; multiplayer; speculative decoding [32] |
| January 18, 2025 | 1.82.4 | Text-to-speech with OuteTTS [33] |
| October 12, 2025 | 1.100.1 | Video generation with WAN models [34] |
| January 17, 2026 | 1.106.2 | MCP server and client support [35] |
| January 31, 2026 | 1.107.3 | CLBlast back end removed [36] |
| March 3, 2026 | 1.109.2 | Experimental music generation; Qwen3-TTS voice cloning [37] |
| June 12, 2026 | 1.115.2 | Full Anthropic Messages API support [38] |
| September 26, 2026 | 1.122.1 | Integrated KoboldCpp Agent [39] |
| October 31, 2026 | 1.124 | audio.cpp speech and music models; chat completions over AI Horde [6] |

## Relationship to llama.cpp and model formats

GitHub records the repository as a fork of `ggml-org/llama.cpp`, and the README describes the program as "Inspired by KoboldAI and built on llama.cpp".[2][1] The fork tracks its parent: release notes routinely end with a line about merging fixes, new model support and improvements from upstream.[6][40] It has also diverged a great deal. On November 17, 2026, GitHub's comparison of the two default branches showed KoboldCpp's `concedo` branch 4,993 commits ahead of upstream `master` and 465 commits behind it.[41]

Part of the divergence comes from keeping things that upstream dropped. KoboldCpp added GGUF loading in version 1.41 on August 24, 2023, and the release notes said all older models would continue to work.[24] The 1.33 notes list the earlier GGML, GGMF and GGJT (versions 1 to 3) file variants as supported, and the README still promises backward compatibility with legacy GGML `.bin` models, with the caveat that some newer features may be unavailable for them.[22][1] The project's website adds that GGML models are limited to a 16k context.[42] The maintainer likewise kept the CLBlast (OpenCL) back end after upstream removed it in mid-2024, and deleted it only in version 1.107.3 in January 2026.[43][36]

Text models must be GGUF or GGML files. The wiki states that safetensors and PyTorch checkpoints are not supported natively and have to be converted first, and the project links to conversion and quantization tools for that purpose.[3][1] Model files are not bundled. The README says models are separate from the software and points users to [Hugging Face](https://aiwiki.ai/wiki/hugging_face), which hosts GGUF builds of many [open-weight](https://aiwiki.ai/wiki/open_weights) models.[1]

## License

The repository's `LICENSE.md` is the text of the GNU Affero General Public License, version 3, and GitHub's license detection reports AGPL-3.0.[44][2] The README states: "KoboldCpp and KoboldAI Lite are licensed under the GNU AGPL v3.0, unless a file states otherwise." It adds that bundled components keep their own licenses, naming the [MIT license](https://aiwiki.ai/wiki/mit_license) for GGML, llama.cpp, stable-diffusion.cpp, Qwen3-TTS.cpp and acestep.cpp and the [Apache 2.0 license](https://aiwiki.ai/wiki/apache_license) for audio.cpp.[1] The source tree carries those upstream license files next to the vendored code, for example an MIT license with Georgi Gerganov's copyright notice for llama.cpp.[45]

The AGPL has applied since version 1.0.2 in March 2023, whose notes record the change and observe that the original GGML library and llama.cpp remain MIT-licensed in their own repositories.[13] According to its preamble, the AGPL is a copyleft license designed with network server software in mind.[44] KoboldAI Client, KoboldAI Lite and the AI Horde server use the same license.[8][10][46]

## Features

### Interfaces

Starting the program without arguments opens a graphical launcher in which the user picks a model file and hardware settings. Once the model has loaded, KoboldAI Lite is served at `http://localhost:5001`.[21][1] Lite has four modes, chosen from a format menu: Story mode for fiction, in which the model continues the user's text; Adventure mode for interactive fiction in the style of AI Dungeon; Chat mode for conversation with a character persona; and Instruct mode for instruction and response in the manner of ChatGPT.[3][9] It carries over KoboldAI's memory, world info and author's note fields, imports Tavern and SillyTavern character cards and KoboldAI save files, and offers interface styles named Classic, Messenger, Aesthetic and Corpo.[3]

Other interfaces ship in the same file. Since version 1.102.3 (November 2025) the llama.cpp web UI is bundled at `/lcpp` as an alternative aimed at assistant-style use, and there are separate pages for image generation (StableUI at `/sdui`) and music generation (MusicUI at `/musicui`).[47][1] A NoScript page works in browsers without JavaScript, and a `--cli` flag gives an interactive terminal chat without starting the server.[3] Lite can also run with no local model and connect to external services such as AI Horde or [OpenRouter](https://aiwiki.ai/wiki/openrouter).[1]

### APIs

The server exposes several API families on one port, so that software written for other back ends can use a local model.[48][1]

| API family | Example paths | Purpose |
|---|---|---|
| KoboldAI (native) | `/api/v1/generate`, `/api/extra/generate/stream` | Text generation, streaming, token counting, aborting a request |
| OpenAI-compatible | `/v1/chat/completions`, `/v1/completions`, `/v1/responses`, `/v1/embeddings` | Chat with tools and images, completions, embeddings |
| OpenAI-compatible audio and images | `/v1/audio/transcriptions`, `/v1/audio/speech`, `/v1/images/generations` | Transcription, speech, image generation |
| Anthropic-compatible | `/v1/messages` | Messages API with images and tool calls |
| Ollama-compatible | `/api/generate`, `/api/chat`, `/api/embed` | Emulation for clients written for Ollama |
| A1111 / Forge | `/sdapi/v1/txt2img`, `/sdapi/v1/img2img` | Image generation and editing |
| ComfyUI-compatible | `/prompt`, `/view` | Image generation for [ComfyUI](https://aiwiki.ai/wiki/comfyui) clients |
| XTTS-compatible | `/tts_to_audio` | Text-to-speech |

The OpenAI-compatible completions endpoint dates from October 2023 and the chat completions endpoint from the following week.[25][49] Ollama emulation was added in November 2024. The wiki says it is not recommended for normal use and exists for compatibility with tools that require Ollama specifically.[32][3] Basic `/v1/messages` and `/v1/responses` support came in April 2026 and full support for the Anthropic Messages API in June 2026.[50][38] Version 1.87.4 in April 2025 improved [function calling](https://aiwiki.ai/wiki/function_calling) through the chat completions endpoint, including an automatic mode, and added an endpoint for separately loaded [embedding](https://aiwiki.ai/wiki/embeddings) models.[51]

### Hardware back ends

KoboldCpp runs on the CPU alone or offloads some or all model layers to a GPU. As of November 2026 the documented back ends are [CUDA](https://aiwiki.ai/wiki/cuda) for [NVIDIA](https://aiwiki.ai/wiki/nvidia) cards, Vulkan for NVIDIA, [AMD](https://aiwiki.ai/wiki/amd) and Intel cards, Metal on [Apple Silicon](https://aiwiki.ai/wiki/apple_silicon) Macs, and an experimental [ROCm](https://aiwiki.ai/wiki/rocm) build for AMD cards on Linux.[52] If no back end is chosen, the program detects the hardware and picks one, and an "autofit" option tries to choose how many layers to place on the GPU.[52][3]

The set has changed over time. CLBlast was the first GPU option, added in April 2023, and CUDA joined the main build with version 1.33 in June 2023.[19][22] The Vulkan back end, contributed by the developer 0cc4m, arrived in January 2024, and the documentation now tells AMD users to try it first.[27][52] The OpenBLAS CPU path was removed in September 2024 and CLBlast in January 2026, when an "Older PC" Vulkan mode replaced the CLBlast options for processors without AVX instructions.[53][36] The project's documentation reports that on an RTX 3090 running the Qwen3-VL-8B model, CUDA processed a prompt of about 1,000 tokens roughly 16 times as fast as Vulkan, while generation speeds were closer (82.0 against 71.5 tokens per second).[52]

Release 1.114.1 (May 2026) added an RPC mode that shares GPUs across machines on a network and an experimental mode that runs several text requests in parallel.[54]

### Context handling and sampling

Two features address the cost of reprocessing a long prompt when a conversation outgrows the model's [context window](https://aiwiki.ai/wiki/context_window). Smart Context, from April 2023, reserves about half of the context as a spare buffer so that the prompt needs recomputing less often, at the price of a smaller usable context.[20][3] Context Shifting, introduced in version 1.48.1 in November 2023 under the nickname "EvenSmarterContext", instead shifts the [KV cache](https://aiwiki.ai/wiki/kv_cache) to drop the oldest tokens and append new ones without reprocessing. It works only with GGUF models, is on by default, and takes precedence over Smart Context.[26][3] Later additions include a "smartcache" that keeps snapshots of the KV cache in RAM for switching between conversations, quantized KV caches, [flash attention](https://aiwiki.ai/wiki/flash_attention) (on by default) and [speculative decoding](https://aiwiki.ai/wiki/speculative_decoding) with a draft model.[3][32]

The wiki documents a long list of samplers: Top-K, Top-A, [Top-P](https://aiwiki.ai/wiki/top_p), tail-free sampling, typical sampling, [temperature](https://aiwiki.ai/wiki/temperature) and dynamic temperature, repetition penalty, Mirostat, Min-P, the DRY anti-repetition sampler and XTC ("Exclude Top Choices"), along with a configurable sampler order. Output can be constrained with GBNF grammars, a form of [structured output](https://aiwiki.ai/wiki/structured_output), and a phrase-banning feature that the wiki labels "Anti-Slop" backtracks and regenerates when a banned string appears.[3]

### Images, video, speech and music

Image generation was added in version 1.60.1 in March 2024 by integrating stable-diffusion.cpp, with an endpoint compatible with the API of the [AUTOMATIC1111](https://aiwiki.ai/wiki/automatic1111) web UI.[28] The README lists support for [Stable Diffusion](https://aiwiki.ai/wiki/stable_diffusion) 1.5, [SDXL](https://aiwiki.ai/wiki/sdxl), SD3, [Flux](https://aiwiki.ai/wiki/flux), [Qwen Image](https://aiwiki.ai/wiki/qwen_image) and other image models, and for WAN 2.2, LTX and MiniMax video models. [Video generation](https://aiwiki.ai/wiki/ai_video_generation) began with WAN models in October 2025.[1][34]

Vision input uses multimodal projector files loaded with `--mmproj`. The feature dates from version 1.61.2, whose notes compare it to [LLaVA](https://aiwiki.ai/wiki/llava) but say it is not limited to LLaVA models. Audio input for suitable [multimodal models](https://aiwiki.ai/wiki/multimodal_model) followed in July 2025.[29][55]

[Speech recognition](https://aiwiki.ai/wiki/speech_recognition) arrived in June 2024 through whisper.cpp, which runs OpenAI's [Whisper](https://aiwiki.ai/wiki/whisper) models, and can be used for push-to-talk or hands-free voice input in Lite.[30] [Text-to-speech](https://aiwiki.ai/wiki/text_to_speech_ai) started with OuteTTS in January 2025. The TTS.cpp library brought the Kokoro, Parler and Dia models in August 2025, and Qwen3-TTS with voice cloning was added in March 2026.[33][56][37] [Music generation](https://aiwiki.ai/wiki/ai_music_generation) with ACE-Step models came in the same March 2026 release, marked experimental. Version 1.124 on October 31, 2026 integrated a subset of models from the audio.cpp project, among them the YuE2 music model and more than a dozen speech models.[37][6]

### Tools and the KoboldCpp Agent

Version 1.81.1 in January 2025 added a web search proxy that queries DuckDuckGo from the local machine, and TextDB, a browser-based document lookup that the release notes call "a very rudimentary form of browser-based RAG" (see [retrieval-augmented generation](https://aiwiki.ai/wiki/retrieval_augmented_generation)).[57] Support for the [Model Context Protocol](https://aiwiki.ai/wiki/model_context_protocol) came in January 2026, first for remote MCP servers and then as a bridge that lets KoboldCpp act as an MCP server and client.[58][35]

Version 1.122.1 on September 26, 2026 added the KoboldCpp Agent, a terminal [agent](https://aiwiki.ai/wiki/ai_agents) harness that the release notes present as a lightweight replacement for tools such as [opencode](https://aiwiki.ai/wiki/opencode), Codex or [Claude Code](https://aiwiki.ai/wiki/claude_code). It has nine built-in tools for reading, writing and editing files, running shell commands, searching, fetching web pages, viewing images and asking the user a question, and it can connect to any OpenAI-compatible endpoint.[39][59] The documentation warns that the agent can change files and run commands on the computer, recommends at least 12 GB of video memory, and notes that by default it asks for approval before each tool call.[59]

### Configuration and administration

Launcher settings can be saved to `.kcpps` files and loaded with `--config`, a feature added in version 1.41. Templates with the `.kcppt` extension, introduced in version 1.71.1 in July 2024, are meant for sharing: they leave out device-specific settings and can embed download links for the model files, so that another user can start a working setup from one file.[24][60][3] An admin mode lets an operator switch between saved configurations while the server runs, and a router mode added in March 2026 swaps models automatically when an OpenAI-style request names a different one.[3][61] For shared servers there are password protection, rate limits, SSL certificates, a multiplayer mode in which several people edit one Lite session, and a `--remotetunnel` option that opens a Cloudflare tunnel.[3][32]

## Platforms and distribution

The project's website says the official downloads are on the GitHub releases page and that files from any other site are not official.[63] As of version 1.124.2 each release contains seven ready-to-run files.[62][18]

| File | System | GPU back ends |
|---|---|---|
| `koboldcpp.exe` | Windows x64 | CUDA 12, Vulkan |
| `koboldcpp-nocuda.exe` | Windows x64 | Vulkan |
| `koboldcpp-oldpc.exe` | Windows x64 | CUDA 11, Vulkan |
| `koboldcpp-linux-x64` | Linux x64 | CUDA 12, Vulkan |
| `koboldcpp-linux-x64-nocuda` | Linux x64 | Vulkan |
| `koboldcpp-linux-x64-oldpc` | Linux x64 | CUDA 11, Vulkan |
| `koboldcpp-mac-arm64` | macOS on Apple Silicon | Metal |

Every file can also run on the CPU alone. The executables are one-file PyInstaller bundles that unpack their libraries into a temporary folder at startup.[62][6][63] The CUDA builds are large: in release 1.124.2 the main Windows file was about 623 MB, against about 90 MB for the `nocuda` build.[18] Official macOS binaries have existed since August 2024, set up by the KoboldAI contributor henk717.[31] There are no prebuilt files for Intel Macs, Windows on ARM or Linux on ARM. Those platforms, and others such as OpenBSD and Raspberry Pi, need a build from source.[62][1]

On Android the program is built and run inside the Termux terminal, either with an installer script or by hand. The wiki cautions that inference on a phone is likely to be slow and memory-limited and suggests connecting to a remote instance instead.[1][3] The project also maintains a [Google Colab](https://aiwiki.ai/wiki/google_colab) notebook that runs KoboldCpp on a cloud GPU, a Docker image (`koboldai/koboldcpp`) that the documentation says is intended for experts renting cloud GPUs, a [RunPod](https://aiwiki.ai/wiki/runpod) image, a public demo on Hugging Face Spaces and a SourceForge mirror.[64][1] The README lists community packages for Arch Linux and Nix as unofficial.[1]

Since version 1.37.1 (July 2023) KoboldCpp has included a worker for AI Horde. With an API key and a worker name set, the program serves Horde requests in the background, and according to the documentation it does so only when the model has had no local request for 20 seconds.[23][65] The 1.124 release extended the worker to chat completions requests, with tool calls, streaming and vision, over the Horde.[6]

## Releases and development

GitHub listed 133 numbered releases between March 18, 2023 and October 31, 2026: 62 in 2023, 27 in 2024, 24 in 2025 and 20 in the first ten months of 2026. In 2026 a new numbered version appeared every 11 to 26 days, about 16 days apart on average.[18] Fixes made shortly after a release are published as hotfixes under the same release entry with a higher patch number. Version 1.124 was published on October 31, 2026, and its 1.124.2 hotfix was tagged on November 2.[6][18] Automatically updated "rolling" builds, which the documentation describes as experimental and possibly unstable, are available between releases.[62]

All but one of the 137 release entries (numbered versions plus a few rolling and tools builds) were published from the LostRuins account. GitHub's contributor list for the repository, which also counts commits inherited from llama.cpp, shows LostRuins as the largest committer with about 4,500 commits as of November 2026.[18][66] Release notes also credit outside contributors, for example for the Vulkan back end, the macOS builds and the image-generation code.[27][31][40] The repository had 12,332 stars, 826 forks and 547 open issues and pull requests on November 17, 2026.[2]

In October 2026 the project launched koboldcpp.net, a community website with beginner guides and reference documentation, put together with the help of a contributor and intended in part to counter imitation sites (see Limitations and criticism below). Executable downloads remain on GitHub.[40]

## Use and community

KoboldCpp is closely associated with creative writing and character role-play, the uses KoboldAI was built for. Its README lists story writing and role-play beside assistant chat among its purposes and recommends a specific model for "Creative Writing and Roleplay".[1] When the llama.cpp web UI was bundled in 2025, the release notes described it as an extra option designed for assistant use cases and recommended KoboldAI Lite for role-play and story writing.[47]

KoboldCpp can also serve as the back end for a separate front end. The documentation of SillyTavern, a browser interface for chatting with AI characters, has a page on KoboldCpp, and its guide to self-hosted models presents KoboldCpp as a no-installation way to serve GGUF models, selected in SillyTavern as its own API type.[67][68] The KoboldCpp wiki in turn names SillyTavern and Agnaistic as third-party front ends for chat and role-play that support it.[3] A setup guide by Tom Smigla on Tech Tactician, updated in October 2026, calls using KoboldCpp with SillyTavern "one of the most popular private local alternatives to services like Character.AI or Chub.AI".[69] The Linux software site LinuxLinks profiled the program in September 2025, noting its single-file distribution and AGPL license.[70]

Support and discussion take place on the KoboldAI Discord server, the r/KoboldAI subreddit and the repository's issue tracker.[1]

## Comparison with other local model runners

Several programs occupy the same niche of running open models on personal hardware, and every one in the table below uses llama.cpp for GGUF inference. The table compares them on license, interface, engine and packaging, as each project described itself in November 2026. AI Wiki's [guide to local LLMs](https://aiwiki.ai/wiki/best_local_llms) covers the choice of model.

| Program | License | Interface | Inference engine | Packaging |
|---|---|---|---|---|
| KoboldCpp | AGPL-3.0, with MIT-licensed llama.cpp and GGML parts [1] | Launcher window, bundled web UIs, APIs [1] | Fork of llama.cpp, plus stable-diffusion.cpp and speech and music libraries [1] | Single executable, no installer [1] |
| [llama.cpp](https://aiwiki.ai/wiki/llama_cpp) server | MIT [11] | Command line, OpenAI-compatible API server with a built-in chat app [71] | llama.cpp [71] | Install script, prebuilt binaries, Docker, source build [71] |
| [Ollama](https://aiwiki.ai/wiki/ollama) | MIT [72] | Command line, REST API and, since July 2025, a desktop app [73] | llama.cpp listed as a supported back end [73] | Installers, install script, Docker image [73] |
| [LM Studio](https://aiwiki.ai/wiki/lmstudio) | Proprietary; source code not published [74] | Desktop app, local API [75] | llama.cpp, and [MLX](https://aiwiki.ai/wiki/mlx) on Apple Silicon [75] | Installer [75] |
| TextGen (formerly text-generation-webui) | AGPL-3.0 [76] | Desktop app, OpenAI- and Anthropic-compatible API [77] | llama.cpp, ik_llama.cpp, Transformers, ExLlamaV3, TensorRT-LLM [77] | Portable builds; separate installation for extra back ends [77] |
| [Jan](https://aiwiki.ai/wiki/jan_ai) | Apache 2.0 [78] | Desktop app, local OpenAI-compatible server [79] | Bundled llama.cpp engine [79] | Installers for Windows, macOS and Linux [79] |

KoboldCpp's main interface runs in the browser, whereas LM Studio and Jan are installed desktop applications. It shares the AGPL with TextGen, while llama.cpp, Ollama and Jan use permissive licenses.[1][75][79][76][11][72][78]

## Limitations and criticism

### Antivirus false positives and unsigned binaries

The project's documentation acknowledges that some antivirus programs flag the Windows executable as a trojan or as suspicious. It attributes this to the self-extracting bundle and says the files are not code-signed because the maintainers do not buy signing certificates.[63] In April 2024 users reported that Windows Defender detected the 1.63 release as `Trojan:Win32/Sabsik.FL.A!ml`. The maintainer replaced the automatically built binary with a locally built one, henk717 wrote that the file had been submitted to Microsoft for review, and a user reported the next day that the detection had stopped.[80][81] SillyTavern's guide tells Windows users that they may see a Microsoft Defender pop-up on first launch.[67]

### Impersonation sites

The project did not register the koboldcpp.com domain. In September 2026 LostRuins asked users to report a site at that address, describing it as a cybersquatted, AI-generated imitation that pushes malware through pop-ups and ranks highly in search results.[82] The README carries a phishing warning, and the project's website listed five fake domains as of November 2026.[1][63]

### Platform gaps and file size

Prebuilt files cover only x64 Windows and Linux and Apple Silicon Macs. The documentation says the Docker image may perform poorly on Windows and macOS hosts and may fail on ARM, calls the ROCm build very experimental, and does not recommend Windows 7.[62][64][52] The main CUDA executable exceeds 600 MB. In the 1.68 release notes the maintainer answered a question about the growing file size by pointing to upstream llama.cpp's CUDA code and saying there was very little the maintainer could personally do about it.[18][43]

### Removed and limited features

Users who depended on CLBlast were told to stay on an earlier version after its removal in 1.107.3.[36] Legacy GGML models still load but with restrictions, and the project does not recommend its own Ollama emulation for normal use.[42][3]

### Security

Release notes record several security fixes: a ported fix for CVE-2024-21836 (1.60.1), a fix for a potential request-flooding vulnerability (1.63), restrictions that stop `.kcpps` and `.kcppt` files from triggering `--onready` shell commands (1.90.2 and 1.114.1), and fixes for potential buffer overflows when loading some legacy models (1.124).[28][81][83][54][6] The repository's advisory page lists four security advisories published between August and October 2026, three of them rated high: memory-safety flaws in the loaders for legacy model formats and for speech models, and a flaw that let a single API request exhaust the server's memory or stall it through an unbounded `rep_pen_range` value, which affected versions up to 1.122.1. That advisory describes the API as having no authentication by default and listening on all network interfaces. None of the four had a CVE identifier as of November 17, 2026.[84] The wiki advises operators of public instances to set a password and rate limits and not to enable admin mode without a strong password, and the 1.114.1 notes advise against exposing the RPC port to the public internet.[3][54]

## See also

- [llama.cpp](https://aiwiki.ai/wiki/llama_cpp)
- [GGUF](https://aiwiki.ai/wiki/gguf)
- [Ollama](https://aiwiki.ai/wiki/ollama)
- [LM Studio](https://aiwiki.ai/wiki/lmstudio)
- [GPT4All](https://aiwiki.ai/wiki/gpt4all)
- [Open WebUI](https://aiwiki.ai/wiki/open_webui)
- [Open-source AI](https://aiwiki.ai/wiki/open_source_ai)
- [Best local LLMs](https://aiwiki.ai/wiki/best_local_llms)

## References

1. LostRuins. "KoboldCpp: Run local AI models with a built-in web UI" (README). GitHub, retrieved November 17, 2026. https://github.com/LostRuins/koboldcpp/blob/concedo/README.md
2. GitHub. "LostRuins/koboldcpp" (repository metadata: stars, forks, license, parent repository, creation date). GitHub REST API, retrieved November 17, 2026. https://api.github.com/repos/LostRuins/koboldcpp
3. LostRuins. "The KoboldCpp FAQ and Knowledgebase". KoboldCpp wiki, GitHub, last edited October 18, 2026. https://github.com/LostRuins/koboldcpp/wiki
4. LostRuins. "llamacpp-for-kobold-1.0.0" (release notes). GitHub, March 18, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.0.0
5. LostRuins. "koboldcpp-1.0.8beta" (release notes). GitHub, April 3, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.0.8beta
6. LostRuins. "koboldcpp-1.124.2" (release notes). GitHub, October 31, 2026. https://github.com/LostRuins/koboldcpp/releases/tag/v1.124.2
7. KoboldAI. "KoboldAI - Your gateway to GPT writing" (README). KoboldAI-Client, GitHub, retrieved November 17, 2026. https://github.com/KoboldAI/KoboldAI-Client/blob/main/README.md
8. GitHub. "KoboldAI/KoboldAI-Client" (repository metadata). GitHub REST API, retrieved November 17, 2026. https://api.github.com/repos/KoboldAI/KoboldAI-Client
9. LostRuins. "KoboldAI Lite" (README). GitHub, retrieved November 17, 2026. https://github.com/LostRuins/lite.koboldai.net/blob/main/README.md
10. GitHub. "LostRuins/lite.koboldai.net" (repository metadata). GitHub REST API, retrieved November 17, 2026. https://api.github.com/repos/LostRuins/lite.koboldai.net
11. GitHub. "ggml-org/llama.cpp" (repository metadata). GitHub REST API, retrieved November 17, 2026. https://api.github.com/repos/ggml-org/llama.cpp
12. LostRuins. "llamacpp-for-kobold-1.0.1" (release notes). GitHub, March 20, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.0.1
13. LostRuins. "llamacpp-for-kobold-1.0.2" (release notes). GitHub, March 21, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.0.2
14. LostRuins. "llamacpp-for-kobold-1.0.4" (release notes). GitHub, March 24, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.0.4
15. LostRuins. "koboldcpp-1.0.9beta" (release notes). GitHub, April 5, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.0.9beta
16. LostRuins. "koboldcpp-1.1" (release notes). GitHub, April 7, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.1
17. LostRuins. "koboldcpp-1.10" (release notes). GitHub, April 18, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.10
18. GitHub. "LostRuins/koboldcpp releases" (release list with dates, authors and file sizes). GitHub REST API, retrieved November 17, 2026. https://api.github.com/repos/LostRuins/koboldcpp/releases?per_page=100
19. LostRuins. "koboldcpp-1.5" (release notes). GitHub, April 12, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.5
20. LostRuins. "koboldcpp-1.7.1" (release notes). GitHub, April 14, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.7
21. LostRuins. "koboldcpp-1.15" (release notes). GitHub, April 28, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.15
22. LostRuins. "koboldcpp-1.33 Ultimate Edition" (release notes). GitHub, June 29, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.33
23. LostRuins. "koboldcpp-1.37.1" (release notes). GitHub, July 24, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.37.1a
24. LostRuins. "koboldcpp-1.41 (beta)" (release notes). GitHub, August 24, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.41
25. LostRuins. "koboldcpp-1.45.2" (release notes). GitHub, October 1, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.45.2
26. LostRuins. "koboldcpp-1.48.1" (release notes). GitHub, November 4, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.48.1
27. LostRuins. "koboldcpp-1.56" (release notes). GitHub, January 27, 2024. https://github.com/LostRuins/koboldcpp/releases/tag/v1.56
28. LostRuins. "koboldcpp-1.60.1" (release notes). GitHub, March 4, 2024. https://github.com/LostRuins/koboldcpp/releases/tag/v1.60.1
29. LostRuins. "koboldcpp-1.61.2" (release notes). GitHub, March 13, 2024. https://github.com/LostRuins/koboldcpp/releases/tag/v1.61.2
30. LostRuins. "koboldcpp-1.67" (release notes). GitHub, June 4, 2024. https://github.com/LostRuins/koboldcpp/releases/tag/v1.67
31. LostRuins. "koboldcpp-1.73.1" (release notes). GitHub, August 19, 2024. https://github.com/LostRuins/koboldcpp/releases/tag/v1.73.1
32. LostRuins. "koboldcpp-1.79.1" (release notes). GitHub, November 30, 2024. https://github.com/LostRuins/koboldcpp/releases/tag/v1.79.1
33. LostRuins. "koboldcpp-1.82.4" (release notes). GitHub, January 18, 2025. https://github.com/LostRuins/koboldcpp/releases/tag/v1.82.4
34. LostRuins. "koboldcpp-1.100.1" (release notes). GitHub, October 12, 2025. https://github.com/LostRuins/koboldcpp/releases/tag/v1.100.1
35. LostRuins. "koboldcpp-1.106.2" (release notes). GitHub, January 17, 2026. https://github.com/LostRuins/koboldcpp/releases/tag/v1.106.2
36. LostRuins. "koboldcpp-1.107.3" (release notes). GitHub, January 31, 2026. https://github.com/LostRuins/koboldcpp/releases/tag/v1.107.3
37. LostRuins. "koboldcpp-1.109.2" (release notes). GitHub, March 3, 2026. https://github.com/LostRuins/koboldcpp/releases/tag/v1.109.2
38. LostRuins. "koboldcpp-1.115.2" (release notes). GitHub, June 12, 2026. https://github.com/LostRuins/koboldcpp/releases/tag/v1.115.2
39. LostRuins. "koboldcpp-1.122.1" (release notes). GitHub, September 26, 2026. https://github.com/LostRuins/koboldcpp/releases/tag/v1.122.1
40. LostRuins. "koboldcpp-1.123.1" (release notes). GitHub, October 13, 2026. https://github.com/LostRuins/koboldcpp/releases/tag/v1.123.1
41. GitHub. "Compare ggml-org/llama.cpp master with LostRuins/koboldcpp concedo" (commits ahead and behind). GitHub REST API, retrieved November 17, 2026. https://api.github.com/repos/LostRuins/koboldcpp/compare/ggml-org:llama.cpp:master...LostRuins:koboldcpp:concedo
42. KoboldCpp project. "Frequently asked questions (FAQ)". koboldcpp.net, retrieved November 17, 2026. https://koboldcpp.net/docs/faq/
43. LostRuins. "koboldcpp-1.68" (release notes). GitHub, June 19, 2024. https://github.com/LostRuins/koboldcpp/releases/tag/v1.68
44. LostRuins. "LICENSE.md" (GNU Affero General Public License, Version 3). koboldcpp, GitHub, retrieved November 17, 2026. https://github.com/LostRuins/koboldcpp/blob/concedo/LICENSE.md
45. LostRuins. "LLAMACPP_LICENSE" (MIT License, copyright Georgi Gerganov). koboldcpp, GitHub, retrieved November 17, 2026. https://github.com/LostRuins/koboldcpp/blob/concedo/src/LLAMACPP_LICENSE
46. GitHub. "Haidra-Org/AI-Horde" (repository metadata). GitHub REST API, retrieved November 17, 2026. https://api.github.com/repos/Haidra-Org/AI-Horde
47. LostRuins. "koboldcpp-1.102.3" (release notes). GitHub, November 26, 2025. https://github.com/LostRuins/koboldcpp/releases/tag/v1.102.3
48. KoboldCpp project. "API endpoints reference". koboldcpp.net, retrieved November 17, 2026. https://koboldcpp.net/docs/api/endpoints/
49. LostRuins. "koboldcpp-1.46.1" (release notes). GitHub, October 8, 2023. https://github.com/LostRuins/koboldcpp/releases/tag/v1.46.1
50. henk717. "koboldcpp-1.111.2" (release notes). LostRuins/koboldcpp, GitHub, April 3, 2026. https://github.com/LostRuins/koboldcpp/releases/tag/v1.111.2
51. LostRuins. "koboldcpp-1.87.4" (release notes). GitHub, April 1, 2025. https://github.com/LostRuins/koboldcpp/releases/tag/v1.87.4
52. KoboldCpp project. "GPU backends: CUDA, Vulkan, ROCm, Metal, CPU". koboldcpp.net, retrieved November 17, 2026. https://koboldcpp.net/docs/hardware/backends/
53. LostRuins. "koboldcpp-1.75.2" (release notes). GitHub, September 21, 2024. https://github.com/LostRuins/koboldcpp/releases/tag/v1.75.2
54. LostRuins. "koboldcpp-1.114.1" (release notes). GitHub, May 30, 2026. https://github.com/LostRuins/koboldcpp/releases/tag/v1.114.1
55. LostRuins. "koboldcpp-1.96.2" (release notes). GitHub, July 17, 2025. https://github.com/LostRuins/koboldcpp/releases/tag/v1.96.2
56. LostRuins. "koboldcpp-1.98.1" (release notes). GitHub, August 24, 2025. https://github.com/LostRuins/koboldcpp/releases/tag/v1.98.1
57. LostRuins. "koboldcpp-1.81.1" (release notes). GitHub, January 4, 2025. https://github.com/LostRuins/koboldcpp/releases/tag/v1.81.1
58. LostRuins. "koboldcpp-1.105.4" (release notes). GitHub, January 2, 2026. https://github.com/LostRuins/koboldcpp/releases/tag/v1.105.4
59. KoboldCpp project. "KoboldCpp Agent". koboldcpp.net, retrieved November 17, 2026. https://koboldcpp.net/docs/features/agent/
60. LostRuins. "koboldcpp-1.71.1" (release notes). GitHub, July 25, 2024. https://github.com/LostRuins/koboldcpp/releases/tag/v1.71.1
61. LostRuins. "koboldcpp-1.110" (release notes). GitHub, March 19, 2026. https://github.com/LostRuins/koboldcpp/releases/tag/v1.110
62. KoboldCpp project. "Release files and system requirements". koboldcpp.net, retrieved November 17, 2026. https://koboldcpp.net/docs/install/releases/
63. KoboldCpp project. "Staying safe: where to download KoboldCpp, and known fake sites". koboldcpp.net, retrieved November 17, 2026. https://koboldcpp.net/docs/install/staying-safe/
64. KoboldCpp project. "Run on Google Colab or Docker". koboldcpp.net, retrieved November 17, 2026. https://koboldcpp.net/docs/install/colab-docker/
65. KoboldCpp project. "AI Horde worker". koboldcpp.net, retrieved November 17, 2026. https://koboldcpp.net/docs/features/horde-worker/
66. GitHub. "LostRuins/koboldcpp contributors". GitHub REST API, retrieved November 17, 2026. https://api.github.com/repos/LostRuins/koboldcpp/contributors
67. SillyTavern. "KoboldCpp". SillyTavern Documentation, retrieved November 17, 2026. https://docs.sillytavern.app/usage/api-connections/koboldcpp/
68. SillyTavern. "Self-hosted AI models". SillyTavern Documentation, retrieved November 17, 2026. https://docs.sillytavern.app/usage/how-to-use-a-self-hosted-model/
69. Smigla, Tom. "Quickest SillyTavern x KoboldCpp Starter Guide (Local AI Characters RP)". Tech Tactician, March 19, 2025 (updated October 22, 2026). https://techtactician.com/sillytavern-and-koboldcpp-full-starter-guide-local-ai-rp
70. Emms, Steve. "KoboldCpp - AI text-generation software". LinuxLinks, September 26, 2025. https://www.linuxlinks.com/koboldcpp-ai-text-generation-software/
71. ggml-org. "llama.cpp" (README). GitHub, retrieved November 17, 2026. https://github.com/ggml-org/llama.cpp/blob/master/README.md
72. GitHub. "ollama/ollama" (repository metadata). GitHub REST API, retrieved November 17, 2026. https://api.github.com/repos/ollama/ollama
73. Ollama. "Ollama" (README). GitHub, retrieved November 17, 2026. https://github.com/ollama/ollama/blob/main/README.md
74. Element Labs. "LM Studio Desktop App Terms of Service". lmstudio.ai, version of August 23, 2026. https://lmstudio.ai/app-terms
75. Element Labs. "Welcome to LM Studio Docs!". lmstudio.ai, retrieved November 17, 2026. https://lmstudio.ai/docs/app
76. GitHub. "oobabooga/textgen" (repository metadata; the former oobabooga/text-generation-webui address redirects here). GitHub REST API, retrieved November 17, 2026. https://api.github.com/repos/oobabooga/textgen
77. oobabooga. "TextGen" (README). GitHub, retrieved November 17, 2026. https://github.com/oobabooga/textgen/blob/main/README.md
78. Menlo Research. "LICENSE" (Apache License, Version 2.0). janhq/jan, GitHub, retrieved November 17, 2026. https://github.com/janhq/jan/blob/main/LICENSE
79. Menlo Research. "Jan - Open-source ChatGPT replacement" (README). GitHub, retrieved November 17, 2026. https://github.com/janhq/jan/blob/main/README.md
80. "koboldcpp-1.63 :: Trojan:Win32/Sabsik.FL.A!ml". Issue #795, LostRuins/koboldcpp, GitHub, April 20, 2024. https://github.com/LostRuins/koboldcpp/issues/795
81. LostRuins. "koboldcpp-1.63" (release notes). GitHub, April 20, 2024. https://github.com/LostRuins/koboldcpp/releases/tag/v1.63
82. LostRuins. "Help needed: report the fake phishing site koboldcpp.com". Discussion #2499, LostRuins/koboldcpp, GitHub, September 26, 2026. https://github.com/LostRuins/koboldcpp/discussions/2499
83. LostRuins. "koboldcpp-1.90.2" (release notes). GitHub, April 29, 2025. https://github.com/LostRuins/koboldcpp/releases/tag/v1.90.2
84. LostRuins. "Security Advisories". koboldcpp, GitHub, retrieved November 17, 2026. https://github.com/LostRuins/koboldcpp/security/advisories

