github ggml-org/llama.cpp b12119

pre-releaseone hour ago
Details

server : realtime: send an error event instead of crashing on exceptions (#31632)

  • server : realtime: send an error event instead of crashing on exceptions

  • server : route websocket handlers through ex_wrapper, remove the realtime test

  • server : realtime: keep the previous tools when the chat template rejects new ones

  • server : realtime: reject tool schemas the grammar cannot convert, drop ws_ex_wrapper

  • server : realtime: clarify the tool schema check comment

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.