github woct0rdho/SageAttention v2.2.0-windows.post3

latest releases: v2.2.0-windows.post5, v2.2.0-windows.post4
9 months ago

(This is not SageAttention3. For SageAttention3 you can download the wheel at https://github.com/mengqin/SageAttention/releases , and see the discussion at #42 (comment) )

Fix GQA case for smooth_k, see thu-ml#252

Previously the SageAttention2++ kernels may not correctly fallback to the old SageAttention2 kernels on RTX 40xx and CUDA < 12.8 . Now it's fixed, see #46

The wheels for PyTorch 2.9 are published. CUDA 13.0 is supported since PyTorch 2.9 .

Don't miss a new SageAttention release

NewReleases is sending notifications on new releases.