github ggml-org/llama.cpp b10004

latest release: b10005
2 hours ago
Details

vulkan/cpu: Support f16 as SET_ROWS src. (#25432)

  • vulkan/cpu: Support f16 as SET_ROWS src.

This adds full support for f16 SET_ROWS (equivalent to f32) to vulkan and CPU
backends, and adds more backend tests.

  • Set DenormPreserve 16 when supported, to try to fix failures on Intel

  • tune error threshold

  • update metal supports_op

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.