github ggml-org/llama.cpp b9066
on GitHub

one hour ago
Details

CUDA: batch out_prod inner loop with cublasSgemmStridedBatched (#22651)

  • CUDA: batch out_prod inner loop with cublasSgemmStridedBatched

  • CUDA: batch out_prod inner loop with cublasSgemmStridedBatched

  • CUDA: add cublasSgemmStridedBatched mapping for HIP and MUSA backends

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

Check out latest releases or
releases around ggml-org/llama.cpp b9066

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.

Get notifications