SageAttention2++ kernels (sv_f8_accum_f16) are added. Compared to SageAttention 2.1, they improve the speed with almost no quality loss. They only support RTX 40xx (sm89) and 50xx (sm120) GPUs, and CUDA >= 12.8, therefore PyTorch >= 2.7 .
The SageAttention 2.2 wheels contain both the SageAttention2++ kernels and the old SageAttention2 kernels. On older GPU and CUDA, the old SageAttention2 kernels will be used, so it will still run but without the speedup.
For PyTorch 2.8, the nightly wheels are unstable, so the SageAttention wheels here may not work with the torch nightly wheel on any day. They're only tested with torch 2.8.0.dev20250627 .