ggml-org/llama.cpp b12368

on GitHub

hexagon: improve buffer allocations and mappings (mmap stacking) (#32144)

• hex-bufs: combine queue and fence buffers

• hex-bufs: use n_threads for queue sizing

• hex-mmap: optimize buffer stacking at the host to avoid iova fragmentation

• hex-mmap: add simply retry for spurios mmap failures

• hex-mmap: use eager mode for extended mmap retries