- Preliminary support for DeepseekV3 (validated against JoyAI-LLM-Flash and Moonlight-16B-A3B, no routing groups yet)
- Second-tier CPU K/V cache, and more intelligent page and checkpoint eviction policies
- Fix freq/rep. penalties causing slowdown on long contexts
- XTC sampler and token bans
- Mitigate some latent vulnerabilities in Safetensors loader
- Other bugfixes, optimizations and QoL improvements
Full Changelog: v1.2.1...v1.3.0