Details
CANN: support gated linear attn (#18653)
- CANN: support gated linear attn
This change adds support for the GGML_OP_GATED_LINEAR_ATTN operator.
The feature was implemented by YushengZhao. Because the previous
submission was based on an outdated codebase, this PR was rebased to
merge.
Co-authored-by: YushengZhao yusheng.chao@outlook.com
Co-authored-by: hipudding huafengchun@gmail.com
- CANN: optimize OP gla
Optimize gla for high preformance
- Remove unused comments
Co-authored-by: 赵禹昇 2501112001@cninfer02.localdomain
Co-authored-by: YushengZhao yusheng.chao@outlook.com
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: