Pre-release 1 of version 2.5.0 is now available! This is a pre-release with offline installers and includes:
- GGUF file format support (only, old model files will not run)
- Completely new set of models including Mistral and Wizard v1.2
- Restored support for Falcon model (which is now GPU accelerated)
- Restored support for MPT
- Based on latest llama.cpp as of late September
- Speed improvements and bugfixes to GPU support
- Improved GUI for cpu/gpu fallback
- Numerous other improvements