github ggml-org/llama.cpp b8893

latest releases: b9189, b9186, b9181...
23 days ago
Details

HIP: flip GGML_HIP_GRAPHS to default on (#22254)

In #11362 hip graph was disabled by default as, at the time, its performance impact was negative. Due to improvements in rocm and our usage and construction of graphs this is no longer true, so lets change the default.

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.