ggml-org/llama.cpp b11632

on GitHub

cuda, hip: GDN chunked kernel (#29353)

• cuda, hip: GDN chunked kernel

Ported-from: tetherto#257
Source-commit: 53f0027
Co-authored-by: Aman Gupta aman.gupta@tether.io

• fix older builds

• review fixes

• cuda: enable GDN MMA on tested Ampere and Ada GPUs

Enable SM86 and SM89 after RTX 3090 and RTX 4090 correctness and prefill benchmarks. Keep other untested architectures on the existing fallback.

Assisted-by: Codex

• cuda : use refactored swizzle API in GDN MMA

• ggml : GDN only guarantees the final state when n_tokens > K

• cuda : add short GDN MMA phase comments

Co-authored-by: gianni-cor gianfranco.cordella@tether.io
Co-authored-by: Aman Gupta aman.gupta@tether.io