ggml-org/llama.cpp b11168

on GitHub

hexagon: dynamic quantizer improvements (#29395)

• hexagon: fix accuracy issue in Q8_0 N=1 MUL_MAT

• hex-quant: fix register spills

• hex-mm: use dma for all dyn.quant paths

Co-authored-by: Aparna M P aparmp@qti.qualcomm.com

• hex-mm: remove obsolete run_quant_task

• hex-mm: update tracing to properly wrap the events

• hex-mm: use act for activation data in all paths

• hex-mm: use act_ instead of src1_ to avoid confusion in fused kernels

• hex-mm: remove/reroute the rest of the non-DMA act (aka src1) logic

• hex-dma64: yet another pass at cleaning up the dma_addr_t casts

• Update ggml/src/ggml-hexagon/htp/matmul-ops.h

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co

• Update ggml/src/ggml-hexagon/htp/matmul-ops.c

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co

• Update ggml/src/ggml-hexagon/htp/matmul-ops.c

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co

• Update ggml/src/ggml-hexagon/htp/matmul-ops.c

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co

Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com
Co-authored-by: Aparna M P aparmp@qti.qualcomm.com
Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co