github ggml-org/llama.cpp b10249

53 minutes ago
Details

server: add get_info tool (#26522)

  • server: add get_info tool

  • fix --rpc in docs

  • server: harden get_info probe result handling

Report the OS as unknown when the probe process fails to spawn or times
out, so the diagnostic text from run() is never returned as an OS name.
Strip the probe output on both ends, which also drops the blank line
that ver prints before the version on Windows. Name the output and
timeout limits, and report an unreadable working directory as unknown
instead of an empty string.

  • server: simplify get_info result handling

Drop the named limits and the working directory error branch, keeping
the probe result handling to a single expression.


Co-authored-by: Pascal admin@serveurperso.com

Website:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.