Details
ggml-cuda: enable cuda-graphs for n-cpu-moe (#18934)
-
ggml-cuda: add split-wise cuda graph
-
add n-cpu-moe compare_llama_bench.py
-
fix hip/musa builds
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: