- Less memory overhead for uncached attn with large head sizes
- Switchable, uncached sliding-window mode with checkpoints to reduce cache size in Gemma4 and Step3.5
- More accurate VRAM estimation for autosplit loader
- Reduced K/V quantization overhead
- EXL3 GEMM kernel optimizations
- AVX-512 support (TP all-reduce)
- Various bugfixes
Full Changelog: v0.0.29...v0.0.30