- Options for token-embedding quantization and disk streaming
- Improved quantization accuracy
- Update HF Transformers integration module to Transformers 5, add backprop for wrapped EXL3 layers
- Faster model loading
- Performance improvements
- Reduced system memory and VRAM overhead
- Fixes for MiMo-V2.6
- Lots and lots of (latent) bugfixes
Full Changelog: v1.5.3...v1.5.4