ggml-org/llama.cpp b7564
on GitHub

3 hours ago

Details

HIP: Use mmq on MFMA devices for MUL_MAT_ID in cases where a lot of splits would be generated (#18202)

macOS/iOS:

Linux:

Windows:

openEuler:

Check out latest releases or
releases around ggml-org/llama.cpp b7564

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.

Get notifications