github ggml-org/llama.cpp b10098

one hour ago
Details

hexagon: activation ops update (#25974)

  • hex-geglu: optimized all-in-one geglu microkernel

  • hex-geglu: enable non-contiguous src and strided DMA

  • hex-act: enable non-contiguous srs and strided DMA for rest of ACT ops

  • hex-act: generalize GLU per-thread functions via DEFINE_GLU_PER_THREAD macro

  • hexagon: move UNARY_SILU and UNARY_GELU to unary-ops

  • hex-act: replace the generic ops_context scratchpad usage with a local htp_vtcm_layout computation per act op.


Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com

Website:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.