NVIDIA/cudnn-frontend v1.14.1

v1.14.1-release

on GitHub

📢 cuDNN Frontend v1.14.1 — Release Notes

🚀 Improvements

🔹 SDPA

• Improved support checks for Hopper backward propagation (bprop) to fix a bug (introduced in 9.11 and fixed in 9.13) affecting certain large head-dimension combinations of d_qk and d_v.
• Added support for sink parameter for SDPA opertation. Refer new samples
  • fp16_fwd_with_sink_token.cpp
    • fp16_bwd_with_sink_token.cpp

🔹 Pointwise

• Added beta support for configurable beta for swish

🔹 Other Updates

• See PR #163 and #165 for custom DLPack path

✅ Recommended Action: Upgrade to cuDNN Frontend v1.14.1 for full compatibility with cuDNN 9.13.0+, improved SDPA support, additional normalization support, and deviceless graph compilation features.