ggml-org/llama.cpp b10791

on GitHub

opencl: quant lm_head / decode GEMV and medium-batch GEMM optimizations (speculative decoding/MTP) (#26477)

• opencl: quant lm_head / decode GEMV and medium-batch GEMM optimizations

• opencl: guard q4_K/q6_K tiled_ns convert-kernel registration for non-Adreno build

• opencl: gate q4_K MUL_MAT+GLU fusion dispatch to Adreno

• opencl: require the noshuffle weight layout in the q4_K GLU fusion gate

• opencl: do not take the vectorized f16 mrow GEMV path on an unaligned row stride

• opencl: pass the new get_scale_min_k4 stride argument at the row-major call sites

• opencl: enable the q4_K split-K decode GEMV only where it is measured to win

• opencl: record the X1-85 split-K datapoint (neutral, exclusion confirmed)

• opencl: restrict the tiled lm_head/embed GEMV default to X2E/A8X

• opencl: fix q4_K variant kernels to read the transposed scales layout

• opencl: keep the flat-GEMV large-m escape opt-in

• opencl: guard the o4 GEMV store against the rounded-up dispatch tail

• opencl: restore the tiled q4_K/q6_K layout on tensor read-back

• opencl: split-K for the q8_0 decode GEMV at small M

• opencl: keep the q6_K noshuffle correctness escape ahead of the opt-in gate