Citation and evidence

KoboldCpp

Report a problem with this article

Edit article
More

Use this article

Raw MarkdownExplore connections

Improve this page

Revision historyDiscuss this article

Topics

Developer ToolsLarge Language ModelsOpen Source AI

Cite this article

KoboldCpp is a free, open-source program for running large language models and other generative models on a user's own computer. It is distributed as a single executable file that needs no installation, loads models in the GGUF format, and serves a bundled browser interface, KoboldAI Lite, together with several application programming interfaces (APIs).[1] The project is a fork of llama.cpp hosted on GitHub and maintained by the developer known as LostRuins, who also goes by Concedo. Its own code is licensed under the GNU Affero General Public License version 3 (AGPL-3.0).[2][1][3]

The software began in March 2023 as llamacpp-for-kobold, a bridge between llama.cpp and the KoboldAI writing tools, and was renamed KoboldCpp on April 3, 2023.[4][5] It has since grown to cover image, video, speech and music generation, a terminal coding agent, and compatibility layers for the OpenAI, Anthropic and Ollama APIs.[1] As of November 17, 2026, the latest release was version 1.124.2, and the repository had 12,332 stars and 826 forks on GitHub.[6][2]

History

KoboldAI background

KoboldCpp is named after KoboldAI, a community project for AI-assisted fiction that its README cites as its inspiration.[1] The original KoboldAI Client, whose GitHub repository was created on May 2, 2021, describes itself as a browser-based front end for AI-assisted writing with local and remote models. It offers Memory, Author's Note and World Info fields for steering a story, an Adventure mode played like the text game AI Dungeon, and a chatbot mode. Its README credits a contributor called The Gantian as the creator and lists Henk717 among the contributors.[7][8] As of November 2026 that README calls the client legacy software that is no longer maintained and directs readers to KoboldCpp.[7]

Before starting KoboldCpp, LostRuins had written KoboldAI Lite, a single-page web interface for KoboldAI back ends and for AI Horde, a volunteer-run network of text and image generation workers. The Lite repository dates from December 24, 2022.[9][3][10]

From llamacpp-for-kobold to KoboldCpp

The KoboldCpp repository was created on March 16, 2023, six days after llama.cpp's own repository.[2][11] The first release, llamacpp-for-kobold-1.0.0, followed on March 18, 2023. Its notes describe an initial version without bundled weights, started by running a Python script with the path of a quantized GGML model and a port number.[4] Version 1.0.1, two days later, told users to connect through the hosted KoboldAI Lite page or the full KoboldAI client. Version 1.0.2 on March 21 embedded Kobold Lite in the program and changed the project's license to AGPL version 3.[12][13] Release 1.0.4 on March 24 introduced a standalone Windows executable built with PyInstaller, the packaging the project still uses.[14][6]

Release 1.0.8beta on April 3, 2023 renamed the project. Its notes read "Rebranded to koboldcpp (formerly llamacpp-for-kobold)", and the same release added loaders for the GPT4All and GPT-J model formats, so the program was no longer tied to LLaMA-family models.[5] Support for GPT-2 and an instruct mode compatible with Stanford's Alpaca prompt format arrived two days later, version 1.1 on April 7 simplified the version numbering, and RWKV models were supported from version 1.10 on April 18.[15][16][17]

Expansion beyond text

Through 2023 the releases concentrated on text generation: GPU acceleration, a graphical launcher, new samplers and the move to GGUF. From 2024 the project integrated other inference libraries, which added image generation, speech recognition and synthesis, video and music. The table lists milestones as dated in the repository's release history.[18]

DateVersionChange
March 18, 20231.0.0First release, as llamacpp-for-kobold [4]
April 3, 20231.0.8betaRenamed KoboldCpp; GPT4All and GPT-J formats [5]
April 12, 20231.5Experimental GPU prompt processing through CLBlast [19]
April 14, 20231.7Smart Context [20]
April 28, 20231.15Graphical "Easy Mode" launcher [21]
June 29, 20231.33CUDA support in a single all-in-one build [22]
July 24, 20231.37.1Embedded AI Horde worker [23]
August 24, 20231.41GGUF model support; .kcpps settings files [24]
October 1, 20231.45.2OpenAI-compatible completions endpoint [25]
November 4, 20231.48.1Context Shifting; Min-P sampler [26]
January 27, 20241.56Vulkan GPU back end [27]
March 4, 20241.60.1Local image generation through stable-diffusion.cpp [28]
March 13, 20241.61.2Vision through multimodal projectors [29]
June 4, 20241.67Speech-to-text through whisper.cpp [30]
August 19, 20241.73.1Official macOS binaries [31]
November 30, 20241.79.1Ollama API emulation; multiplayer; speculative decoding [32]
January 18, 20251.82.4Text-to-speech with OuteTTS [33]
October 12, 20251.100.1Video generation with WAN models [34]
January 17, 20261.106.2MCP server and client support [35]
January 31, 20261.107.3CLBlast back end removed [36]
March 3, 20261.109.2Experimental music generation; Qwen3-TTS voice cloning [37]
June 12, 20261.115.2Full Anthropic Messages API support [38]
September 26, 20261.122.1Integrated KoboldCpp Agent [39]
October 31, 20261.124audio.cpp speech and music models; chat completions over AI Horde [6]

Expanded article table

Relationship to llama.cpp and model formats

GitHub records the repository as a fork of ggml-org/llama.cpp, and the README describes the program as "Inspired by KoboldAI and built on llama.cpp".[2][1] The fork tracks its parent: release notes routinely end with a line about merging fixes, new model support and improvements from upstream.[6][40] It has also diverged a great deal. On November 17, 2026, GitHub's comparison of the two default branches showed KoboldCpp's concedo branch 4,993 commits ahead of upstream master and 465 commits behind it.[41]

Part of the divergence comes from keeping things that upstream dropped. KoboldCpp added GGUF loading in version 1.41 on August 24, 2023, and the release notes said all older models would continue to work.[24] The 1.33 notes list the earlier GGML, GGMF and GGJT (versions 1 to 3) file variants as supported, and the README still promises backward compatibility with legacy GGML .bin models, with the caveat that some newer features may be unavailable for them.[22][1] The project's website adds that GGML models are limited to a 16k context.[42] The maintainer likewise kept the CLBlast (OpenCL) back end after upstream removed it in mid-2024, and deleted it only in version 1.107.3 in January 2026.[43][36]

Text models must be GGUF or GGML files. The wiki states that safetensors and PyTorch checkpoints are not supported natively and have to be converted first, and the project links to conversion and quantization tools for that purpose.[3][1] Model files are not bundled. The README says models are separate from the software and points users to Hugging Face, which hosts GGUF builds of many open-weight models.[1]

License

The repository's LICENSE.md is the text of the GNU Affero General Public License, version 3, and GitHub's license detection reports AGPL-3.0.[44][2] The README states: "KoboldCpp and KoboldAI Lite are licensed under the GNU AGPL v3.0, unless a file states otherwise." It adds that bundled components keep their own licenses, naming the MIT license for GGML, llama.cpp, stable-diffusion.cpp, Qwen3-TTS.cpp and acestep.cpp and the Apache 2.0 license for audio.cpp.[1] The source tree carries those upstream license files next to the vendored code, for example an MIT license with Georgi Gerganov's copyright notice for llama.cpp.[45]

The AGPL has applied since version 1.0.2 in March 2023, whose notes record the change and observe that the original GGML library and llama.cpp remain MIT-licensed in their own repositories.[13] According to its preamble, the AGPL is a copyleft license designed with network server software in mind.[44] KoboldAI Client, KoboldAI Lite and the AI Horde server use the same license.[8][10][46]

Features

Interfaces

Starting the program without arguments opens a graphical launcher in which the user picks a model file and hardware settings. Once the model has loaded, KoboldAI Lite is served at http://localhost:5001.[21][1] Lite has four modes, chosen from a format menu: Story mode for fiction, in which the model continues the user's text; Adventure mode for interactive fiction in the style of AI Dungeon; Chat mode for conversation with a character persona; and Instruct mode for instruction and response in the manner of ChatGPT.[3][9] It carries over KoboldAI's memory, world info and author's note fields, imports Tavern and SillyTavern character cards and KoboldAI save files, and offers interface styles named Classic, Messenger, Aesthetic and Corpo.[3]

Other interfaces ship in the same file. Since version 1.102.3 (November 2025) the llama.cpp web UI is bundled at /lcpp as an alternative aimed at assistant-style use, and there are separate pages for image generation (StableUI at /sdui) and music generation (MusicUI at /musicui).[47][1] A NoScript page works in browsers without JavaScript, and a --cli flag gives an interactive terminal chat without starting the server.[3] Lite can also run with no local model and connect to external services such as AI Horde or OpenRouter.[1]

APIs

The server exposes several API families on one port, so that software written for other back ends can use a local model.[48][1]

API familyExample pathsPurpose
KoboldAI (native)/api/v1/generate, /api/extra/generate/streamText generation, streaming, token counting, aborting a request
OpenAI-compatible/v1/chat/completions, /v1/completions, /v1/responses, /v1/embeddingsChat with tools and images, completions, embeddings
OpenAI-compatible audio and images/v1/audio/transcriptions, /v1/audio/speech, /v1/images/generationsTranscription, speech, image generation
Anthropic-compatible/v1/messagesMessages API with images and tool calls
Ollama-compatible/api/generate, /api/chat, /api/embedEmulation for clients written for Ollama
A1111 / Forge/sdapi/v1/txt2img, /sdapi/v1/img2imgImage generation and editing
ComfyUI-compatible/prompt, /viewImage generation for ComfyUI clients
XTTS-compatible/tts_to_audioText-to-speech

Expanded article table

The OpenAI-compatible completions endpoint dates from October 2023 and the chat completions endpoint from the following week.[25][49] Ollama emulation was added in November 2024. The wiki says it is not recommended for normal use and exists for compatibility with tools that require Ollama specifically.[32][3] Basic /v1/messages and /v1/responses support came in April 2026 and full support for the Anthropic Messages API in June 2026.[50][38] Version 1.87.4 in April 2025 improved function calling through the chat completions endpoint, including an automatic mode, and added an endpoint for separately loaded embedding models.[51]

Hardware back ends

KoboldCpp runs on the CPU alone or offloads some or all model layers to a GPU. As of November 2026 the documented back ends are CUDA for NVIDIA cards, Vulkan for NVIDIA, AMD and Intel cards, Metal on Apple Silicon Macs, and an experimental ROCm build for AMD cards on Linux.[52] If no back end is chosen, the program detects the hardware and picks one, and an "autofit" option tries to choose how many layers to place on the GPU.[52][3]

The set has changed over time. CLBlast was the first GPU option, added in April 2023, and CUDA joined the main build with version 1.33 in June 2023.[19][22] The Vulkan back end, contributed by the developer 0cc4m, arrived in January 2024, and the documentation now tells AMD users to try it first.[27][52] The OpenBLAS CPU path was removed in September 2024 and CLBlast in January 2026, when an "Older PC" Vulkan mode replaced the CLBlast options for processors without AVX instructions.[53][36] The project's documentation reports that on an RTX 3090 running the Qwen3-VL-8B model, CUDA processed a prompt of about 1,000 tokens roughly 16 times as fast as Vulkan, while generation speeds were closer (82.0 against 71.5 tokens per second).[52]

Release 1.114.1 (May 2026) added an RPC mode that shares GPUs across machines on a network and an experimental mode that runs several text requests in parallel.[54]

Context handling and sampling

Two features address the cost of reprocessing a long prompt when a conversation outgrows the model's context window. Smart Context, from April 2023, reserves about half of the context as a spare buffer so that the prompt needs recomputing less often, at the price of a smaller usable context.[20][3] Context Shifting, introduced in version 1.48.1 in November 2023 under the nickname "EvenSmarterContext", instead shifts the KV cache to drop the oldest tokens and append new ones without reprocessing. It works only with GGUF models, is on by default, and takes precedence over Smart Context.[26][3] Later additions include a "smartcache" that keeps snapshots of the KV cache in RAM for switching between conversations, quantized KV caches, flash attention (on by default) and speculative decoding with a draft model.[3][32]

The wiki documents a long list of samplers: Top-K, Top-A, Top-P, tail-free sampling, typical sampling, temperature and dynamic temperature, repetition penalty, Mirostat, Min-P, the DRY anti-repetition sampler and XTC ("Exclude Top Choices"), along with a configurable sampler order. Output can be constrained with GBNF grammars, a form of structured output, and a phrase-banning feature that the wiki labels "Anti-Slop" backtracks and regenerates when a banned string appears.[3]

Images, video, speech and music

Image generation was added in version 1.60.1 in March 2024 by integrating stable-diffusion.cpp, with an endpoint compatible with the API of the AUTOMATIC1111 web UI.[28] The README lists support for Stable Diffusion 1.5, SDXL, SD3, Flux, Qwen Image and other image models, and for WAN 2.2, LTX and MiniMax video models. Video generation began with WAN models in October 2025.[1][34]

Vision input uses multimodal projector files loaded with --mmproj. The feature dates from version 1.61.2, whose notes compare it to LLaVA but say it is not limited to LLaVA models. Audio input for suitable multimodal models followed in July 2025.[29][55]

Speech recognition arrived in June 2024 through whisper.cpp, which runs OpenAI's Whisper models, and can be used for push-to-talk or hands-free voice input in Lite.[30] Text-to-speech started with OuteTTS in January 2025. The TTS.cpp library brought the Kokoro, Parler and Dia models in August 2025, and Qwen3-TTS with voice cloning was added in March 2026.[33][56][37] Music generation with ACE-Step models came in the same March 2026 release, marked experimental. Version 1.124 on October 31, 2026 integrated a subset of models from the audio.cpp project, among them the YuE2 music model and more than a dozen speech models.[37][6]

Tools and the KoboldCpp Agent

Version 1.81.1 in January 2025 added a web search proxy that queries DuckDuckGo from the local machine, and TextDB, a browser-based document lookup that the release notes call "a very rudimentary form of browser-based RAG" (see retrieval-augmented generation).[57] Support for the Model Context Protocol came in January 2026, first for remote MCP servers and then as a bridge that lets KoboldCpp act as an MCP server and client.[58][35]

Version 1.122.1 on September 26, 2026 added the KoboldCpp Agent, a terminal agent harness that the release notes present as a lightweight replacement for tools such as opencode, Codex or Claude Code. It has nine built-in tools for reading, writing and editing files, running shell commands, searching, fetching web pages, viewing images and asking the user a question, and it can connect to any OpenAI-compatible endpoint.[39][59] The documentation warns that the agent can change files and run commands on the computer, recommends at least 12 GB of video memory, and notes that by default it asks for approval before each tool call.[59]

Configuration and administration

Launcher settings can be saved to .kcpps files and loaded with --config, a feature added in version 1.41. Templates with the .kcppt extension, introduced in version 1.71.1 in July 2024, are meant for sharing: they leave out device-specific settings and can embed download links for the model files, so that another user can start a working setup from one file.[24][60][3] An admin mode lets an operator switch between saved configurations while the server runs, and a router mode added in March 2026 swaps models automatically when an OpenAI-style request names a different one.[3][61] For shared servers there are password protection, rate limits, SSL certificates, a multiplayer mode in which several people edit one Lite session, and a --remotetunnel option that opens a Cloudflare tunnel.[3][32]

Platforms and distribution

The project's website says the official downloads are on the GitHub releases page and that files from any other site are not official.[63] As of version 1.124.2 each release contains seven ready-to-run files.[62][18]

FileSystemGPU back ends
koboldcpp.exeWindows x64CUDA 12, Vulkan
koboldcpp-nocuda.exeWindows x64Vulkan
koboldcpp-oldpc.exeWindows x64CUDA 11, Vulkan
koboldcpp-linux-x64Linux x64CUDA 12, Vulkan
koboldcpp-linux-x64-nocudaLinux x64Vulkan
koboldcpp-linux-x64-oldpcLinux x64CUDA 11, Vulkan
koboldcpp-mac-arm64macOS on Apple SiliconMetal

Expanded article table

Every file can also run on the CPU alone. The executables are one-file PyInstaller bundles that unpack their libraries into a temporary folder at startup.[62][6][63] The CUDA builds are large: in release 1.124.2 the main Windows file was about 623 MB, against about 90 MB for the nocuda build.[18] Official macOS binaries have existed since August 2024, set up by the KoboldAI contributor henk717.[31] There are no prebuilt files for Intel Macs, Windows on ARM or Linux on ARM. Those platforms, and others such as OpenBSD and Raspberry Pi, need a build from source.[62][1]

On Android the program is built and run inside the Termux terminal, either with an installer script or by hand. The wiki cautions that inference on a phone is likely to be slow and memory-limited and suggests connecting to a remote instance instead.[1][3] The project also maintains a Google Colab notebook that runs KoboldCpp on a cloud GPU, a Docker image (koboldai/koboldcpp) that the documentation says is intended for experts renting cloud GPUs, a RunPod image, a public demo on Hugging Face Spaces and a SourceForge mirror.[64][1] The README lists community packages for Arch Linux and Nix as unofficial.[1]

Since version 1.37.1 (July 2023) KoboldCpp has included a worker for AI Horde. With an API key and a worker name set, the program serves Horde requests in the background, and according to the documentation it does so only when the model has had no local request for 20 seconds.[23][65] The 1.124 release extended the worker to chat completions requests, with tool calls, streaming and vision, over the Horde.[6]

Releases and development

GitHub listed 133 numbered releases between March 18, 2023 and October 31, 2026: 62 in 2023, 27 in 2024, 24 in 2025 and 20 in the first ten months of 2026. In 2026 a new numbered version appeared every 11 to 26 days, about 16 days apart on average.[18] Fixes made shortly after a release are published as hotfixes under the same release entry with a higher patch number. Version 1.124 was published on October 31, 2026, and its 1.124.2 hotfix was tagged on November 2.[6][18] Automatically updated "rolling" builds, which the documentation describes as experimental and possibly unstable, are available between releases.[62]

All but one of the 137 release entries (numbered versions plus a few rolling and tools builds) were published from the LostRuins account. GitHub's contributor list for the repository, which also counts commits inherited from llama.cpp, shows LostRuins as the largest committer with about 4,500 commits as of November 2026.[18][66] Release notes also credit outside contributors, for example for the Vulkan back end, the macOS builds and the image-generation code.[27][31][40] The repository had 12,332 stars, 826 forks and 547 open issues and pull requests on November 17, 2026.[2]

In October 2026 the project launched koboldcpp.net, a community website with beginner guides and reference documentation, put together with the help of a contributor and intended in part to counter imitation sites (see Limitations and criticism below). Executable downloads remain on GitHub.[40]

Use and community

KoboldCpp is closely associated with creative writing and character role-play, the uses KoboldAI was built for. Its README lists story writing and role-play beside assistant chat among its purposes and recommends a specific model for "Creative Writing and Roleplay".[1] When the llama.cpp web UI was bundled in 2025, the release notes described it as an extra option designed for assistant use cases and recommended KoboldAI Lite for role-play and story writing.[47]

KoboldCpp can also serve as the back end for a separate front end. The documentation of SillyTavern, a browser interface for chatting with AI characters, has a page on KoboldCpp, and its guide to self-hosted models presents KoboldCpp as a no-installation way to serve GGUF models, selected in SillyTavern as its own API type.[67][68] The KoboldCpp wiki in turn names SillyTavern and Agnaistic as third-party front ends for chat and role-play that support it.[3] A setup guide by Tom Smigla on Tech Tactician, updated in October 2026, calls using KoboldCpp with SillyTavern "one of the most popular private local alternatives to services like Character.AI or Chub.AI".[69] The Linux software site LinuxLinks profiled the program in September 2025, noting its single-file distribution and AGPL license.[70]

Support and discussion take place on the KoboldAI Discord server, the r/KoboldAI subreddit and the repository's issue tracker.[1]

Comparison with other local model runners

Several programs occupy the same niche of running open models on personal hardware, and every one in the table below uses llama.cpp for GGUF inference. The table compares them on license, interface, engine and packaging, as each project described itself in November 2026. AI Wiki's guide to local LLMs covers the choice of model.

ProgramLicenseInterfaceInference enginePackaging
KoboldCppAGPL-3.0, with MIT-licensed llama.cpp and GGML parts [1]Launcher window, bundled web UIs, APIs [1]Fork of llama.cpp, plus stable-diffusion.cpp and speech and music libraries [1]Single executable, no installer [1]
llama.cpp serverMIT [11]Command line, OpenAI-compatible API server with a built-in chat app [71]llama.cpp [71]Install script, prebuilt binaries, Docker, source build [71]
OllamaMIT [72]Command line, REST API and, since July 2025, a desktop app [73]llama.cpp listed as a supported back end [73]Installers, install script, Docker image [73]
LM StudioProprietary; source code not published [74]Desktop app, local API [75]llama.cpp, and MLX on Apple Silicon [75]Installer [75]
TextGen (formerly text-generation-webui)AGPL-3.0 [76]Desktop app, OpenAI- and Anthropic-compatible API [77]llama.cpp, ik_llama.cpp, Transformers, ExLlamaV3, TensorRT-LLM [77]Portable builds; separate installation for extra back ends [77]
JanApache 2.0 [78]Desktop app, local OpenAI-compatible server [79]Bundled llama.cpp engine [79]Installers for Windows, macOS and Linux [79]

Expanded article table

KoboldCpp's main interface runs in the browser, whereas LM Studio and Jan are installed desktop applications. It shares the AGPL with TextGen, while llama.cpp, Ollama and Jan use permissive licenses.[1][75][79][76][11][72][78]

Limitations and criticism

Antivirus false positives and unsigned binaries

The project's documentation acknowledges that some antivirus programs flag the Windows executable as a trojan or as suspicious. It attributes this to the self-extracting bundle and says the files are not code-signed because the maintainers do not buy signing certificates.[63] In April 2024 users reported that Windows Defender detected the 1.63 release as Trojan:Win32/Sabsik.FL.A!ml. The maintainer replaced the automatically built binary with a locally built one, henk717 wrote that the file had been submitted to Microsoft for review, and a user reported the next day that the detection had stopped.[80][81] SillyTavern's guide tells Windows users that they may see a Microsoft Defender pop-up on first launch.[67]

Impersonation sites

The project did not register the koboldcpp.com domain. In September 2026 LostRuins asked users to report a site at that address, describing it as a cybersquatted, AI-generated imitation that pushes malware through pop-ups and ranks highly in search results.[82] The README carries a phishing warning, and the project's website listed five fake domains as of November 2026.[1][63]

Platform gaps and file size

Prebuilt files cover only x64 Windows and Linux and Apple Silicon Macs. The documentation says the Docker image may perform poorly on Windows and macOS hosts and may fail on ARM, calls the ROCm build very experimental, and does not recommend Windows 7.[62][64][52] The main CUDA executable exceeds 600 MB. In the 1.68 release notes the maintainer answered a question about the growing file size by pointing to upstream llama.cpp's CUDA code and saying there was very little the maintainer could personally do about it.[18][43]

Removed and limited features

Users who depended on CLBlast were told to stay on an earlier version after its removal in 1.107.3.[36] Legacy GGML models still load but with restrictions, and the project does not recommend its own Ollama emulation for normal use.[42][3]

Security

Release notes record several security fixes: a ported fix for CVE-2024-21836 (1.60.1), a fix for a potential request-flooding vulnerability (1.63), restrictions that stop .kcpps and .kcppt files from triggering --onready shell commands (1.90.2 and 1.114.1), and fixes for potential buffer overflows when loading some legacy models (1.124).[28][81][83][54][6] The repository's advisory page lists four security advisories published between August and October 2026, three of them rated high: memory-safety flaws in the loaders for legacy model formats and for speech models, and a flaw that let a single API request exhaust the server's memory or stall it through an unbounded rep_pen_range value, which affected versions up to 1.122.1. That advisory describes the API as having no authentication by default and listening on all network interfaces. None of the four had a CVE identifier as of November 17, 2026.[84] The wiki advises operators of public instances to set a password and rate limits and not to enable admin mode without a strong password, and the 1.114.1 notes advise against exposing the RPC port to the public internet.[3][54]

Continue reading

More from See also

More to read

Topics:Developer ToolsLarge Language ModelsOpen Source AI

References

  1. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12 ^13 ^14 ^15 ^16 ^17 ^18 ^19 ^20 ^21 ^22 ^23 ^24 ^25 ^26LostRuins. "KoboldCpp: Run local AI models with a built-in web UI" (README). GitHub, retrieved November 17, 2026. github.com/...README.md
  2. ^1 ^2 ^3 ^4 ^5 ^6GitHub. "LostRuins/koboldcpp" (repository metadata: stars, forks, license, parent repository, creation date). GitHub REST API, retrieved November 17, 2026. api.github.com/...koboldcpp
  3. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9 ^10 ^11 ^12 ^13 ^14 ^15 ^16 ^17 ^18 ^19LostRuins. "The KoboldCpp FAQ and Knowledgebase". KoboldCpp wiki, GitHub, last edited October 18, 2026. github.com/...wiki
  4. ^1 ^2 ^3LostRuins. "llamacpp-for-kobold-1.0.0" (release notes). GitHub, March 18, 2023. github.com/...v1.0.0
  5. ^1 ^2 ^3LostRuins. "koboldcpp-1.0.8beta" (release notes). GitHub, April 3, 2023. github.com/...v1.0.8beta
  6. ^1 ^2 ^3 ^4 ^5 ^6 ^7 ^8 ^9LostRuins. "koboldcpp-1.124.2" (release notes). GitHub, October 31, 2026. github.com/...v1.124.2
  7. ^1 ^2KoboldAI. "KoboldAI - Your gateway to GPT writing" (README). KoboldAI-Client, GitHub, retrieved November 17, 2026. github.com/...README.md
  8. ^1 ^2GitHub. "KoboldAI/KoboldAI-Client" (repository metadata). GitHub REST API, retrieved November 17, 2026. api.github.com/...KoboldAI-Client
  9. ^1 ^2LostRuins. "KoboldAI Lite" (README). GitHub, retrieved November 17, 2026. github.com/...README.md
  10. ^1 ^2GitHub. "LostRuins/lite.koboldai.net" (repository metadata). GitHub REST API, retrieved November 17, 2026. api.github.com/...lite.koboldai.net
  11. ^1 ^2 ^3GitHub. "ggml-org/llama.cpp" (repository metadata). GitHub REST API, retrieved November 17, 2026. api.github.com/...llama.cpp
  12. ^LostRuins. "llamacpp-for-kobold-1.0.1" (release notes). GitHub, March 20, 2023. github.com/...v1.0.1
  13. ^1 ^2LostRuins. "llamacpp-for-kobold-1.0.2" (release notes). GitHub, March 21, 2023. github.com/...v1.0.2
  14. ^LostRuins. "llamacpp-for-kobold-1.0.4" (release notes). GitHub, March 24, 2023. github.com/...v1.0.4
  15. ^LostRuins. "koboldcpp-1.0.9beta" (release notes). GitHub, April 5, 2023. github.com/...v1.0.9beta
  16. ^LostRuins. "koboldcpp-1.1" (release notes). GitHub, April 7, 2023. github.com/...v1.1
  17. ^LostRuins. "koboldcpp-1.10" (release notes). GitHub, April 18, 2023. github.com/...v1.10
  18. ^1 ^2 ^3 ^4 ^5 ^6 ^7GitHub. "LostRuins/koboldcpp releases" (release list with dates, authors and file sizes). GitHub REST API, retrieved November 17, 2026. api.github.com/...releases
  19. ^1 ^2LostRuins. "koboldcpp-1.5" (release notes). GitHub, April 12, 2023. github.com/...v1.5
  20. ^1 ^2LostRuins. "koboldcpp-1.7.1" (release notes). GitHub, April 14, 2023. github.com/...v1.7
  21. ^1 ^2LostRuins. "koboldcpp-1.15" (release notes). GitHub, April 28, 2023. github.com/...v1.15
  22. ^1 ^2 ^3LostRuins. "koboldcpp-1.33 Ultimate Edition" (release notes). GitHub, June 29, 2023. github.com/...v1.33
  23. ^1 ^2LostRuins. "koboldcpp-1.37.1" (release notes). GitHub, July 24, 2023. github.com/...v1.37.1a
  24. ^1 ^2 ^3LostRuins. "koboldcpp-1.41 (beta)" (release notes). GitHub, August 24, 2023. github.com/...v1.41
  25. ^1 ^2LostRuins. "koboldcpp-1.45.2" (release notes). GitHub, October 1, 2023. github.com/...v1.45.2
  26. ^1 ^2LostRuins. "koboldcpp-1.48.1" (release notes). GitHub, November 4, 2023. github.com/...v1.48.1
  27. ^1 ^2 ^3LostRuins. "koboldcpp-1.56" (release notes). GitHub, January 27, 2024. github.com/...v1.56
  28. ^1 ^2 ^3LostRuins. "koboldcpp-1.60.1" (release notes). GitHub, March 4, 2024. github.com/...v1.60.1
  29. ^1 ^2LostRuins. "koboldcpp-1.61.2" (release notes). GitHub, March 13, 2024. github.com/...v1.61.2
  30. ^1 ^2LostRuins. "koboldcpp-1.67" (release notes). GitHub, June 4, 2024. github.com/...v1.67
  31. ^1 ^2 ^3LostRuins. "koboldcpp-1.73.1" (release notes). GitHub, August 19, 2024. github.com/...v1.73.1
  32. ^1 ^2 ^3 ^4LostRuins. "koboldcpp-1.79.1" (release notes). GitHub, November 30, 2024. github.com/...v1.79.1
  33. ^1 ^2LostRuins. "koboldcpp-1.82.4" (release notes). GitHub, January 18, 2025. github.com/...v1.82.4
  34. ^1 ^2LostRuins. "koboldcpp-1.100.1" (release notes). GitHub, October 12, 2025. github.com/...v1.100.1
  35. ^1 ^2LostRuins. "koboldcpp-1.106.2" (release notes). GitHub, January 17, 2026. github.com/...v1.106.2
  36. ^1 ^2 ^3 ^4LostRuins. "koboldcpp-1.107.3" (release notes). GitHub, January 31, 2026. github.com/...v1.107.3
  37. ^1 ^2 ^3LostRuins. "koboldcpp-1.109.2" (release notes). GitHub, March 3, 2026. github.com/...v1.109.2
  38. ^1 ^2LostRuins. "koboldcpp-1.115.2" (release notes). GitHub, June 12, 2026. github.com/...v1.115.2
  39. ^1 ^2LostRuins. "koboldcpp-1.122.1" (release notes). GitHub, September 26, 2026. github.com/...v1.122.1
  40. ^1 ^2 ^3LostRuins. "koboldcpp-1.123.1" (release notes). GitHub, October 13, 2026. github.com/...v1.123.1
  41. ^GitHub. "Compare ggml-org/llama.cpp master with LostRuins/koboldcpp concedo" (commits ahead and behind). GitHub REST API, retrieved November 17, 2026. api.github.com/...er...LostRuins:koboldcpp:concedo
  42. ^1 ^2KoboldCpp project. "Frequently asked questions (FAQ)". koboldcpp.net, retrieved November 17, 2026. koboldcpp.net/...faq
  43. ^1 ^2LostRuins. "koboldcpp-1.68" (release notes). GitHub, June 19, 2024. github.com/...v1.68
  44. ^1 ^2LostRuins. "LICENSE.md" (GNU Affero General Public License, Version 3). koboldcpp, GitHub, retrieved November 17, 2026. github.com/...LICENSE.md
  45. ^LostRuins. "LLAMACPP_LICENSE" (MIT License, copyright Georgi Gerganov). koboldcpp, GitHub, retrieved November 17, 2026. github.com/...LLAMACPP_LICENSE
  46. ^GitHub. "Haidra-Org/AI-Horde" (repository metadata). GitHub REST API, retrieved November 17, 2026. api.github.com/...AI-Horde
  47. ^1 ^2LostRuins. "koboldcpp-1.102.3" (release notes). GitHub, November 26, 2025. github.com/...v1.102.3
  48. ^KoboldCpp project. "API endpoints reference". koboldcpp.net, retrieved November 17, 2026. koboldcpp.net/...endpoints
  49. ^LostRuins. "koboldcpp-1.46.1" (release notes). GitHub, October 8, 2023. github.com/...v1.46.1
  50. ^henk717. "koboldcpp-1.111.2" (release notes). LostRuins/koboldcpp, GitHub, April 3, 2026. github.com/...v1.111.2
  51. ^LostRuins. "koboldcpp-1.87.4" (release notes). GitHub, April 1, 2025. github.com/...v1.87.4
  52. ^1 ^2 ^3 ^4 ^5KoboldCpp project. "GPU backends: CUDA, Vulkan, ROCm, Metal, CPU". koboldcpp.net, retrieved November 17, 2026. koboldcpp.net/...backends
  53. ^LostRuins. "koboldcpp-1.75.2" (release notes). GitHub, September 21, 2024. github.com/...v1.75.2
  54. ^1 ^2 ^3LostRuins. "koboldcpp-1.114.1" (release notes). GitHub, May 30, 2026. github.com/...v1.114.1
  55. ^LostRuins. "koboldcpp-1.96.2" (release notes). GitHub, July 17, 2025. github.com/...v1.96.2
  56. ^LostRuins. "koboldcpp-1.98.1" (release notes). GitHub, August 24, 2025. github.com/...v1.98.1
  57. ^LostRuins. "koboldcpp-1.81.1" (release notes). GitHub, January 4, 2025. github.com/...v1.81.1
  58. ^LostRuins. "koboldcpp-1.105.4" (release notes). GitHub, January 2, 2026. github.com/...v1.105.4
  59. ^1 ^2KoboldCpp project. "KoboldCpp Agent". koboldcpp.net, retrieved November 17, 2026. koboldcpp.net/...agent
  60. ^LostRuins. "koboldcpp-1.71.1" (release notes). GitHub, July 25, 2024. github.com/...v1.71.1
  61. ^LostRuins. "koboldcpp-1.110" (release notes). GitHub, March 19, 2026. github.com/...v1.110
  62. ^1 ^2 ^3 ^4 ^5KoboldCpp project. "Release files and system requirements". koboldcpp.net, retrieved November 17, 2026. koboldcpp.net/...releases
  63. ^1 ^2 ^3 ^4KoboldCpp project. "Staying safe: where to download KoboldCpp, and known fake sites". koboldcpp.net, retrieved November 17, 2026. koboldcpp.net/...staying-safe
  64. ^1 ^2KoboldCpp project. "Run on Google Colab or Docker". koboldcpp.net, retrieved November 17, 2026. koboldcpp.net/...colab-docker
  65. ^KoboldCpp project. "AI Horde worker". koboldcpp.net, retrieved November 17, 2026. koboldcpp.net/...horde-worker
  66. ^GitHub. "LostRuins/koboldcpp contributors". GitHub REST API, retrieved November 17, 2026. api.github.com/...contributors
  67. ^1 ^2SillyTavern. "KoboldCpp". SillyTavern Documentation, retrieved November 17, 2026. docs.sillytavern.app/...koboldcpp
  68. ^SillyTavern. "Self-hosted AI models". SillyTavern Documentation, retrieved November 17, 2026. docs.sillytavern.app/...to-use-a-self-hosted-model
  69. ^Smigla, Tom. "Quickest SillyTavern x KoboldCpp Starter Guide (Local AI Characters RP)". Tech Tactician, March 19, 2025 (updated October 22, 2026). techtactician.com/...ull-starter-guide-local-ai-rp
  70. ^Emms, Steve. "KoboldCpp - AI text-generation software". LinuxLinks, September 26, 2025. linuxlinks.com/koboldcpp-ai-text-generation-software
  71. ^1 ^2 ^3ggml-org. "llama.cpp" (README). GitHub, retrieved November 17, 2026. github.com/...README.md
  72. ^1 ^2GitHub. "ollama/ollama" (repository metadata). GitHub REST API, retrieved November 17, 2026. api.github.com/...ollama
  73. ^1 ^2 ^3Ollama. "Ollama" (README). GitHub, retrieved November 17, 2026. github.com/...README.md
  74. ^Element Labs. "LM Studio Desktop App Terms of Service". lmstudio.ai, version of August 23, 2026. lmstudio.ai/app-terms
  75. ^1 ^2 ^3 ^4Element Labs. "Welcome to LM Studio Docs!". lmstudio.ai, retrieved November 17, 2026. lmstudio.ai/...app
  76. ^1 ^2GitHub. "oobabooga/textgen" (repository metadata; the former oobabooga/text-generation-webui address redirects here). GitHub REST API, retrieved November 17, 2026. api.github.com/...textgen
  77. ^1 ^2 ^3oobabooga. "TextGen" (README). GitHub, retrieved November 17, 2026. github.com/...README.md
  78. ^1 ^2Menlo Research. "LICENSE" (Apache License, Version 2.0). janhq/jan, GitHub, retrieved November 17, 2026. github.com/...LICENSE
  79. ^1 ^2 ^3 ^4Menlo Research. "Jan - Open-source ChatGPT replacement" (README). GitHub, retrieved November 17, 2026. github.com/...README.md
  80. ^"koboldcpp-1.63 :: Trojan:Win32/Sabsik.FL.A!ml". Issue #795, LostRuins/koboldcpp, GitHub, April 20, 2024. github.com/...795
  81. ^1 ^2LostRuins. "koboldcpp-1.63" (release notes). GitHub, April 20, 2024. github.com/...v1.63
  82. ^LostRuins. "Help needed: report the fake phishing site koboldcpp.com". Discussion #2499, LostRuins/koboldcpp, GitHub, September 26, 2026. github.com/...2499
  83. ^LostRuins. "koboldcpp-1.90.2" (release notes). GitHub, April 29, 2025. github.com/...v1.90.2
  84. ^LostRuins. "Security Advisories". koboldcpp, GitHub, retrieved November 17, 2026. github.com/...advisories

Improve this article

Add missing citations, update stale details, or write a clearer explanation. Anyone can edit: changes go live when you publish, and every edit is checked by an editor.

1 revision · v1 · 5,343 words · full history

Fact-checks are independent of edits: a reviewer re-verifies the article against its sources and stamps the date. How we verify

Research and drafting on this wiki are AI-assisted, under named human editorial standards. How AI is used here

Cite this page: AI Wiki. "KoboldCpp." aiwiki.ai, updated 17 Nov 2026. CC BY 4.0. https://aiwiki.ai/wiki/koboldcpp

Edit article