github ggml-org/llama.cpp b8006

latest releases: b11612, b11610, b11609...
8 months ago
Details

opencl: add general Q6_K mm and Q4_K mv (#19347)

  • opencl: add general q6_k mm

  • opencl: refine condition for q6_K mm

  • opencl: add general q4_K mv

  • opencl: fix whitespace

macOS/iOS:

Linux:

Windows:

openEuler:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.