What's Changed
- [CuTe, Fwd, SM100] Prevent NaN contamination from unused V cache entries by @fusheng-ji in #2983
- [CuTe] Format config.py with ruff so the Lint workflow passes again by @WeiYedi in #3067
- [CuTe, Bwd, SM100] Bound the K/V TMA loads by seqlen_k so unused rows cannot poison dQ (packed varlen and dense seqused_k) by @yunweili3 in #3012
- [CuTe, SM90] Bound the K/V TMA loads by seqlen_k (fwd + bwd, packed varlen and dense seqused_k) by @yunweili3 in #3013
- [CuTe] Bound ragged K/V TMA loads with per-CTA descriptor updates instead of a wrap-around descriptor by @yunweili3 in #3071
- [CuTe, SM100] Unify hd256 backward (4/7): pack the query heads of a KV head into the Q tile (GQA) by @Johnsonms in #2967
- [CuTe, SM100] Fix 2CTA CLC tile coords and make forward work-tile coordinates logical by @drisspg in #3034
New Contributors
- @fusheng-ji made their first contribution in #2983
- @WeiYedi made their first contribution in #3067
Full Changelog: fa4-v4.0.0.beta36...fa4-v4.0.0.beta37