github ggml-org/llama.cpp b11560

latest release: b11562
pre-releaseone hour ago
Details

hexagon: add IM2COL_3D (#30305)

  • hexagon: add IM2COL_3D support

Assisted-by: OpenCode

  • hexagon: add DMA paths for IM2COL_3D

Assisted-by: OpenCode

  • hexagon: avoid scalar fp16 conversions in IM2COL

Assisted-by: OpenCode

  • remove in-loop spills in pre-v81 devices

Assisted-by: OpenCode

  • hex-im2col: re-write to use canonical dma dbl-buff pipeline, remove divs and very inefficient fp conversions

  • hex-im2col: move kernel_params and vtcm layout precompute into the host

  • hex-im2col: remove explicit tracking of number of dma-pushes

  • hex-im2col: remove incorrect uint64_t casts

  • hex-im2col: no need for macros for dma loops and pass compute func ptr via local context

  • hex-im2col: use cursor pattern, tracing and proper n_threads handling

  • hex-im2col: support non-contigue views

  • hex-im2col: minor reformatting


Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.