github Dao-AILab/flash-attention fa4-v4.0.0.beta36

pre-release4 hours ago

What's Changed

  • Fix paged KV-cache CUDA graph capture by @pkuwangh in #2984
  • [CuTe, SM100] Unify hd256 backward (2/5): 64-row KV tile per CTA (M=64 TMEM layout) with GQA, varlen and deterministic support by @Johnsonms in #2965
  • [Tests] CUDA graph capture/replay coverage for FA4 (CuTe) and FA2 entry points by @yunweili3 in #3007
  • [CuTe, SM100] Unify hd256 backward (3/5): hdim 256 on FlashAttentionBackwardSm100 (opt-in) by @Johnsonms in #2966
  • [CuTe] Add typed forward configurations by @drisspg in #2732

New Contributors

Full Changelog: fa4-v4.0.0.beta35...fa4-v4.0.0.beta36

Don't miss a new flash-attention release

NewReleases is sending notifications on new releases.