github ggml-org/llama.cpp b9890

one hour ago
Details

CUDA: remove -sm row, refactor cuBLAS (#24216)

  • CUDA: remove -sm row, refactor cuBLAS

  • fix CDNA + BF16 logic

  • fix bad return

  • fix src0 strides, contiguous requirements

  • fix GGML_CUDA_FORCE_CUBLAS

  • fix casts to BF16

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.