ggml-org/llama.cpp b11936

on GitHub

llama : build the k-pool sparse selection independently of the kq_mask shape (#31243)

• llama : build the k-pool sparse selection independently of the kq_mask shape

qwen4exp (QSA) and glm5-next pick cache cells by index and no longer read the kq_mask values, but they still shaped the selection like the dense kq_mask. Build the selection as [n_kv, n_tokens] over the cache cells instead, and split it into the streams of the K view right before the attention.

This lets the dense mask change its layout (e.g. per-sequence row lists) without touching the sparse layers.

• improve comment

Co-authored-by: Georgi Gerganov ggerganov@gmail.com

• llama : drop the unused build_fused_top_k_mask args, review nits

Co-authored-by: Georgi Gerganov ggerganov@gmail.com