github ggml-org/llama.cpp b7273

latest release: b7274
one hour ago

Warning

Release Format Update: Linux releases will soon use .tar.gz archives instead of .zip. Please make the necessary changes to your deployment scripts.

server: move msg diffs tracking to HTTP thread (#17740)

  • server: move msg diffs tracking to HTTP thread

  • wip

  • tool call tests ok

  • minor : style

  • cont : fix

  • move states to server_response_reader

  • add safe-guard

  • fix

  • fix 2


Co-authored-by: Georgi Gerganov ggerganov@gmail.com

macOS/iOS:

Linux:

Windows:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.