ggml-org/llama.cpp b11554

on GitHub

vulkan: handle mul_mat_id duplicates in the prepass rather than looping (#29998)

• vulkan: compute every row of an expert in mul_mm_id when ids repeat

• vulkan: handle mul_mat_id duplicates in the prepass rather than looping

Extend the "hoist row ids" optimization to always be enabled and to emit a
compact list of tile descriptions that need to run, and to emit multiple tiles
when needed. Then we can launch a tighter upper bound on the number of
workgroups and the tail can trivially early exit.

Co-authored-by: Anjielon <[EMAIL_REDACTED]>