NVIDIA/cudnn-frontend v1.20.0

v1.20.0 release

on GitHub

cuDNN Frontend v1.20.0 is the recommended version for cuDNN 9.20.0 and later releases.

Open-Source Kernels 🚀 🚀

• Fused RMSNorm + SiLU: The Fused RMSNorm + SiLU engine implements a single-kernel fusion of RMS normalization followed by SiLU (Swish) activation. It is designed and optimized specifically for the WAN VAE decoder's L2Norm + SiLU pattern on B200, but supports arbitrary problem sizes on SM80 to SM103 GPUs.

Improvements:

• Allow GEMM + Amax, GEMM + SwiGLU, Grouped GEMM + SwiGLU, Grouped GEMM + dSwiglu, and NSA kernels to run on GB300.

• Improve the reproducer tool to report and reproduce SDPA failures.