ggml-org/llama.cpp b12237

on GitHub

mtmd: support gemma 4 input audio stream (#31965)

• mtmd: support gemma 4 input audio stream

• use 480ms step

• server: enable realtime embeddings only for audio generation

The realtime slot forced embeddings on, which marks every row of a
batch as an output. Only a model that generates audio reserves
n_batch outputs, so a chat model with an audio stream (Gemma 4)
aborted on its first batch of audio rows. The hidden state is only
read by the audio generation pipeline.

Co-authored-by: Pascal admin@serveurperso.com