Details
ggml-cpu: add RVV vec dot kernels for quantization types (#18859)
- ggml-cpu: add rvv quantize_row_q8_K kernel
Co-authored-by: Rehan Qasim rehan.qasim@10xengineers.ai
- ggml-cpu: add rvv vec_dot for iq4_nl, mxfp4, iq2_xxs
Co-authored-by: Rehan Qasim rehan.qasim@10xengineers.ai
-
ggml-cpu: add rvv vec_dot for iq4_xs, refactor
-
ggml-cpu: remove ifunc for rvv vec dot
-
ggml-cpu: add vec_dot for iq2_xs, iq3_xxs
Co-authored-by: Rehan Qasim rehan.qasim@10xengineers.ai
- ggml-cpu: refactor quants.c
Co-authored-by: taimur-10x taimur.ahmad@10xengineers.ai
Co-authored-by: Rehan Qasim rehan.qasim@10xengineers.ai
Co-authored-by: Rehan Qasim rehanbhatti0317@gmail.com
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: