github Dao-AILab/flash-attention fa4-v4.0.0.beta25

pre-release5 hours ago

What's Changed

  • Remove SM100 Functions from Hopper Flash Attention 3 by @ankutalev in #2746
  • [CuTe,Sm100] Varlen Dynamic Persistent scheduler and metadata by @reubenconducts in #2559
  • [AI] Add doc on debug methodology by @jayhshah in #2753
  • [ROCm] Fix CK varlen_fwd binding argument mismatch by @hyoon1 in #2742
  • [CuTe, SM100] Sparse MLA bwd: don't scatter dK/dV at -1 sentinel indices by @abcdabcd987 in #2755

New Contributors

Full Changelog: fa4-v4.0.0.beta24...fa4-v4.0.0.beta25

Don't miss a new flash-attention release

NewReleases is sending notifications on new releases.