ggml-org/llama.cpp b11905

on GitHub

vulkan: rms norm optimization using subgroup reductions (#29882)

• RMS Norm Subgroup reductions optimizaton

• Fix build error

• Improved optimization

• Make usage of BLOCK_SIZE consistent

• Add fast path to skip 2nd subgroupAdd

• Add AMD Vendor to subgroup reduction opt

• Add comment clarifying rms_dict and merge_maps behavior

• Add unroll

• Rebase

• Fixed syntax issue

• Add 128/256/512 block sizes to non-subgroup path

• Remove trailing whitespace