github ggml-org/llama.cpp b10664

pre-releaseone hour ago
Details

ggml-hexagon: add HTP unary ops for ABS and LOG (#27786)

Add HVX-accelerated implementations for GGML_OP_LOG and
GGML_UNARY_OP_ABS on the HTP backend.

  • Register HTP_OP_UNARY_ABS and HTP_OP_UNARY_LOG in op_remap_to_htp()
  • Add ABS and LOG to ggml_backend_hexagon_device_supports_op()
  • Implement hvx_abs_f32_aa() in hvx-arith.h using hvx_vec_abs_f32()
  • Implement hvx_log_f32_aa() in hvx-log.h using hvx_vec_log_f32()
  • Add abs_f32() and log_f32() row-wise dispatch in unary-ops.c
  • Define tiled and non-tiled task functions via DEFINE_UNARY_TASK and
    DEFINE_UNARY_TILED_TASK macros
  • Route HTP_OP_UNARY_ABS and HTP_OP_UNARY_LOG through execute_op()
    in main.c

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.