koboldcpp-1.119
pasta.mp4
- NEW: Added support for Video generation and I2V with Minimax H3.
- Requires 4 files as described in this docs. For ease of use, you can download the MiniMax H3 quick setup .kcppt template here
- NEW: Added support for Muse Glimmer, jinja templates and tool calling also supported. Qwen 3.8 is also fully supported now.
- Added support for DSpark and Dflash speculative decoding
- Increased max images and audio attachments supported to 64
- Added support for Mistral reasoning budget by @JulienJBO
- Autoswap name matching fixes by @Anai-Guo
- Increase max runtime image LoRAs supported from 4 to 10.
- Added support for Image progress and previews during image generation by @wbruna
- Support Autoswap for openai image endpoint, added support for OpenAI Image editing API
/v1/images/edits - Fixed an image gen memory leak
- Use python's CSV writer for benchmark saving
- Updated Kobold Lite, multiple fixes and improvements
- Merged fixes, new model support, and improvements from upstream
Download and run the koboldcpp.exe (Windows) or koboldcpp-linux-x64 (Linux), which is a one-file pyinstaller for NVIDIA GPU users.
If you have an older CPU or older NVIDIA GPU and koboldcpp does not work, try oldpc version instead (Cuda11 + AVX1).
If you don't have an NVIDIA GPU, or do not need CUDA, you can use the nocuda version which is smaller.
If you're using AMD, we recommend trying the Vulkan option in the nocuda build first, for best support. Alternatively, you can download our rolling ROCm binary here if you use Linux.
If you're on a modern MacOS (M-Series) you can use the koboldcpp-mac-arm64 MacOS binary.
Click here for .gguf conversion and quantization tools
Newer rolling experimental builds can be found here, these are auto-updated and may be unstable.
Run it from the command line with the desired launch parameters (see --help), or manually select the model in the GUI.
and then once loaded, you can connect like this (or use the full koboldai client):
http://localhost:5001
For more information, be sure to run the program from command line with the --help flag. You can also refer to the readme and the wiki.