github ggml-org/llama.cpp b9047

latest releases: b9780, b9777, b9776...
one month ago
Details

common: do not fit to unknown device memory (#22614)

  • common: do not fit to unknown device memory

Signed-off-by: Florian Reinle f.reinle@otec.de

  • common: preserve host fallback for non-GPU fit devices

Signed-off-by: Florian Reinle f.reinle@otec.de

  • common: keep unknown GPU fit memory at zero

Signed-off-by: Florian Reinle f.reinle@otec.de


Signed-off-by: Florian Reinle f.reinle@otec.de

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.