github ggml-org/llama.cpp b12373

pre-release40 minutes ago
Details

hexagon: add support for SSM_SCAN op (#31921)

  • hexagon: add SSM_SCAN Op support

  • hex-ssm-scan: fix multi-device spliting

  • hex-ssm-scan: remove redundant checks and make kernel use host config

  • hex-ssm-scan: remove direct ddr access

  • hex-ssm-scan: remove DMA ordering

  • hex-ops: update supported ops

  • hex-ssm-scan: rewrite the dma pipeline to match other ops (dbl.buf, etc)

  • hex-ssm-scan: remove all fallbacks, only dma/vtcm paths

  • hex-ssm-scan: add kernel_type to kparams and remove redundant recomputes

  • hex-ssm-scan: avoid stalls in the overall pipeline (dma flush between chunks)

  • hex-ssm-scan: vectorize softplus

  • hex-ssm-scan: optimize hvx loops

  • hex-ssm-scan: add HMX support

  • hex-ssm-scan: add support for GGML_HEXAGON_SSM_SELECT

  • hex-ssm-scan: cleanup kernel names

  • hex-ssm-scan: simplify mdev checks

  • hex-mdev: improve mdev row-split solver


Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.