github ggml-org/llama.cpp b11781

latest releases: b11785, b11784, b11782...
pre-release3 hours ago
Details

server : add POST /tts endpoint for TTS models (#26603)

  • mtmd: add audio out stream api

  • add /tts endpoint

  • add docs

  • wire up mtmd_helper_model_can_chat

  • upload speaker_ref via form-data

  • expose seed to api

  • fix header for pcm

  • wip

  • fix penalty_last_n

  • fix server_output_limits

  • fix pocket-tts stream

  • wip

  • add server_schema for tts

  • add server routing

  • server: coerce seed and stream from multipart form fields

Form fields arrive as strings, so -F seed=42 and -F stream=true were
rejected by the schema. seed joins the integer fields, parsed as a long
long so a full uint32 seed fits, and stream is read as a boolean when
it comes as a string.


Co-authored-by: Pascal admin@serveurperso.com

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.