Details
CUDA: Fix non-contig rope (#19338)
- Rename variables + fix rope_neox
Seems memory layout is shared with Vulkan so we can port fix from
#19299
-
Fix rope_multi
-
Fix rope_vision
-
Fix rope_norm
-
Rename ne* to ne0* for consistent variable naming
-
cont : consistent stride names
Co-authored-by: Georgi Gerganov ggerganov@gmail.com
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: