ggml-org/llama.cpp b10667

on GitHub

metal : add fa-vec tunings for M4 Pro (#27824)

This is a followup contribution to efeda76 as requested in #27668 to add support for additional Apple GPUs. I generated this output using the provided instructions:

git clone https://github.com/ggml-org/llama.cpp
cd llama.cpp

cmake -B build -DGGML_METAL=ON
cmake --build build --target ggml-metal-tuning -j

./build/bin/ggml-metal-tuning fa-vec --dtype f16,q8_0 > fa_vec_rows.txt 2> fa_vec_sweep.log

This ran on a MacBook Pro (14-inch, Nov 2024) with Apple M4 Pro. The ggml-metal-tuning command completed successfully in 1h 13m 1s with no other notable load on the system.