github ggml-org/llama.cpp b9688

latest releases: b9692, b9691, b9690...
6 hours ago
Details

server: (router) add model management API (#23976)

  • wip

  • server: (router) add SSE realtime updates API

  • nits

  • wip

  • add download API

  • add download api

  • update docs

  • add delete endpoint

  • fix std::terminate

  • fix crash

  • fix 2

  • add tests

  • nits

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.