github ggml-org/llama.cpp b11111

latest release: b11112
pre-release2 hours ago
Details

vulkan: add Intel Xe flash attention optimization kernels (2/3, Xe-LPG Plus/Xe2/Xe3) (#24406)

  • vulkan : Intel FA kernel optimization for split k path

  • vulkan : Host code update for Intel split k FA kernel path selection, fix A770 Linux op test failures

  • vulkan : use symmetric coopMatMulAdd() in flash_attn_decode_phase_1 shader to resolve test op failre on A770 Linux with 26.2.3 mesa driver

  • vulkan : fix editorconfig issue in flash_attn_decode_phase_2.comp


Co-authored-by: Liu, Russell russell.liu@intel.com

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.