github ggml-org/llama.cpp b8952

latest release: b8953
7 hours ago
Details

server: (router) Forward form-data to model server (Fixes #22044) (#22118)

  • This commit enables the router to forward form-data to model server.
    Fixes #22044 (enabling to use the /v1/audio/transcriptions in router mode)

    • Applied the suggestion from Copilots first comment: using the non-throwing json::parse overload.
  • Addressed Copilots third comment by extending the files representation to also include filename and content-type

  • Addressed Copilots fourth comment by making the RNG thread_local

  • Changed variable body from std::string to std::ostringstream in build_multipart_body
    as suggested by ngxson in #22118 (comment)

  • Added sanitize_field lambda in build_multipart_body for key, filename and content_type
    as suggested by ngxson in #22118 (comment)

  • explicitly checking if value/item is string before calling value/item.getstd::string()
    as requested by ngxson in #22118 (comment)

  • Added double quote to the sanitize lambda and throw on json parse failure


Co-authored-by: Ralph Paßgang ralph@trust-it.de

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.