ggml-org/llama.cpp b12099

on GitHub

hexagon: add LIGHTNING_INDEXER support (#31289)

• hexagon: initial support for LIGHTNING_INDEXER op

• hex-lght-idxr: hmx for prefill

• hex-lght-idxr: q8_0 decode gather transpose, two-block decode compute

• hex-lght-idxr: pipelined hmx path for decode and prefill

• hex-lid: add support for K (f32)

• hex-lid: add support for K (f32)

• hex-lid: add support for q4_0

• hex-lid: remove scalar VTCM reads in the HMX q4_0 K prep and remove vector spills

• hex-lid: host/kernel kparams alighnment and remove sw devices in kernel

• hex-lit: update dma pipeline to use canonical dbl buffering in all paths

• hex-lit: add GGML_HEXAGON_LI_SELECT to force hmx/hvx paths

• hex-lit: add support for dims collapse

• hex-lit: make kparams constistent with other ops

Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com