What's Changed
- [CuTe, SM100] Unify hd256 backward (5/7): cheaper deterministic dQ semaphore (overlapped release on the M=64 serial schedule, early acquire, relaxed release) by @Johnsonms in #3058
- [CuTe] Route forward through typed configs by @drisspg in #2733
- [CuTe, SM100] Add swap-AB split-KV decode by @ighoshsubho in #2973
- [CuTe, SM100] Run causal forward on CLC by default by @drisspg in #3062
- [CuTe] Route backward through typed configs by @drisspg in #3044
- [CuTe] Route MLA forward through typed configs by @drisspg in #3054
- [CuTe, SM100] Put the forward shared-memory layout in the config by @drisspg in #3056
- [CuTe] Add explicit forward config benchmark by @drisspg in #2735
- [CuTe] Tune GB300 forward scheduling by @drisspg in #2738
- [CuTe] Add explicit forward config autotuning by @drisspg in #2743
- [mla] expose kernel cta choice for autotuning by @liangel-02 in #3091
- [mla] pad dense 2CTA MQA heads to the 128-row tile for 65-127 heads by @liangel-02 in #3118
New Contributors
- @ighoshsubho made their first contribution in #2973
Full Changelog: fa4-v4.0.0.beta37...fa4-v4.0.0.beta38