ggml-org/llama.cpp b10668

on GitHub

metal : add fa-vec tunings for M3 Max, M5 and M5 Pro (#27863)

• metal : add fa-vec tunings for M5

This is a followup contribution to efeda76 as requested in #27668 to add support for additional Apple GPUs. I generated this output using the provided instructions:

git clone https://github.com/ggml-org/llama.cpp
cd llama.cpp

cmake -B build -DGGML_METAL=ON
cmake --build build --target ggml-metal-tuning -j

./build/bin/ggml-metal-tuning fa-vec --dtype f16,q8_0 > fa_vec_rows.txt 2> fa_vec_sweep.log

This ran on a machine with Apple M5.

Assisted-by: pi:llama.cpp/Qwen3.8-27B

• metal : add fa-vec tunings for M5 Pro

This adds fa_vec_tuned_table records for Apple M5 Pro to ggml-metal-tuning.cpp.

Contributed by SerayaEryn in #27668 (comment) (F16, Q4_0, Q8_0; M5 Pro, 20 GPU cores).

Assisted-by: pi:llama.cpp/Qwen3.8-27B

• metal : add fa-vec tunings for M3 Max

This adds fa_vec_tuned_table records for Apple M3 Max to ggml-metal-tuning.cpp.

Contributed by TeeAaTeeUu in #27668 (comment) (F16, Q8_0; M3 Max, MacBook Pro 64GB, low power mode).

Assisted-by: pi:llama.cpp/Qwen3.8-27B

• cont : whitespaces