github ggml-org/llama.cpp b12194

latest releases: b12196, b12195, b12197...
pre-releaseone hour ago
Details

hexagon: n_hvx and n_threads cleanup (#31857)

  • hex-nhvx: apply nhvx updates to the latest master

  • hex-nhvx: set N_HVX and N_THREADS based on the arch to avoid overallocation

  • hex-build: add support for enabling HTP_DEBUG via build.py

  • hex-trace: move tracing state/helpers into new htp-trace.h header

  • hex-dcache: cleanup dcache #defines

  • hex-hnvx: minimize the diff by reflowing the macros

  • hex-ci: fix python type/linter warnings

  • hex-nhvx: consitent logging

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.