ggml-org/llama.cpp b11970

on GitHub

hexagon: add conv2d support (#30995)

• hexagon: add conv2d op

• hex-conv2d: add double-buffered staging

• hex-conv2d: full 64-wide activation block transpose straight from staged buffer

• hex-conv2d: implicit gemm

• hex-conv2d: remove scalar path and kernel

• hex-conv2d: unify conv2d kernel params for all paths

• hex-conv2d: scale HMX result before f16 storage and then restore during unpacking to prevent overflow

• hex-conv2d: fix f16 overflow in HMX paths

• hex-conv2d: refactor to rebase to new op fusion machinery

• hex-conv2d: restructure DMA pipelines and trace scopes

• hex-conv2d: removed the HVX_WIDTH and HVX_TILED paths

• hex-conv2d: remove in-loop vector spills

• hex-conv2d: refactor kparams, vtcm-layout and dma-pipeline to match the other ops

• hex-conv2d: add basic support for CONV_2D_DW

Co-Authored-By: Pranav Dhinakar pdhinaka@qti.qualcomm.com

• hex-conv_2d_dw: use DMA in all paths

• hex-conv_2d_dw: support for chunking larger inputs

• hex-conv_2d_dw: remove scalar/hvx access for w tensor (replaced with sync dma copy)

• hex-conv-2d: fix warnings

• hex-conv2d-dw: vectorize all paths

• hex-conv-2d-dw: tree-based reductions and unrolling to optimize

• hex-conv-2d-dw: uninline compute loops from dma loops

• hex-conv-2d-dw: move all kernel selection into the host solver and simplify/specialize kernel dispatch

• hex-softmax: update obsolete gates to enable SOFT_MAX for mmproj

Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com
Co-authored-by: Pranav Dhinakar pdhinaka@qti.qualcomm.com