🚀 New Features
- Speculative decoding stats in the UI: token speed footer now shows tok/sec plus draft token acceptance %
🔧 Improvements & Fixes
- Windows DLL bundling: all upstream DLLs now ship together, backend prefs for TurboQuant vs upstream no longer overwrite each other (#175)
- Resumable downloads: model downloads now survive interruptions, resuming from the last saved byte via HTTP Range requests with exponential backoff (1s to 32s) instead of starting over
- Faster, safer MLX loads: text only checkpoints route through proper model classification, with a dedicated lock so a slow or failed load no longer blocks other models
- Backend version checks on Windows no longer pop a console window
- 5+ stability/UI fixes across model loading, downloads, and token timing
🙏 Contributors
Thanks to @Vect0rM, @AlexFromAtomic, @TheLeaderDev, @dtorey-d for their contributions to this release!