What's Changed
- Add an Attention Sink to Flash MLA for SM100 by @floatingtrees in #2768
- [CuTe, SM100] Stop the non-causal hdim 128 softmax warps spilling by @dawnop in #2869
- [CuTe, SM100] hd256 2-CTA: support seqused_q/seqused_k and the decoder paged-KV shape by @kzos in #2810
- [CuTe, SM100] Preserve hd256 output alignment for vectorized stores by @drisspg in #2880
- One more deprecation; by @drisspg in #2867
- [CuTe, SM100, HD256] optimize SM100 HD256 varlen scheduling and epilogues by @catwinee in #2807
- [CuTe, SM90] Fix swapped backward MMA layout and use 2-stage hdim256 config by @SuperGoodGame in #2888
- [CuTe, Bwd] Return zero gradients for empty Q/K workloads by @guoriyue in #2776
- [CuTe, Fwd] Fix PackGQA predication for padded head dimensions by @guoriyue in #2775
New Contributors
- @floatingtrees made their first contribution in #2768
- @dawnop made their first contribution in #2869
- @kzos made their first contribution in #2810
- @catwinee made their first contribution in #2807
- @SuperGoodGame made their first contribution in #2888
Full Changelog: fa4-v4.0.0.beta30...fa4-v4.0.0.beta31