ggml-org/llama.cpp b10715

on GitHub

spec : fuse the DFlash encoder into the KV cache injection (#27310)

• dflash : fuse the encoder into the KV injection decode

The encoder is a single fc + norm, but running it as a separate
llama_encode forced a device-to-host round trip of its output before the
injection decode could re-upload it, plus a second graph build per
round. Fold the encoder into the decoder's embd branch and feed the
target features directly to one llama_decode.

Assisted-by: Claude Fable

• nit

• Apply batched suggestions from code review

Co-authored-by: Ruixiang Wang wangruixiang07@outlook.com

• Fix missing references from renaming

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co
Co-authored-by: Ruixiang Wang wangruixiang07@outlook.com