github ggml-org/llama.cpp b12347

latest releases: b12359, v1.0.0, b12360...
pre-release47 minutes ago
Details

llama : prune (#30565)

  • llama : remove deprecated llama_set_warmup

Assisted-by: dsh:llama.cpp/ggml-org/DeepSeek-V4.1-Flash-1017-GGUF (Mac Studio, M5 Ultra, 256GB)

  • llama : remove remaining deprecated API

Drop the APIs marked DEPRECATED in llama.h, the deprecated
llama_context_params::defrag_thold field and the --defrag-thold option.

Assisted-by: dsh:llama.cpp/ggml-org/DeepSeek-V4.1-Flash-1017-GGUF (Mac Studio, M5 Ultra, 256GB)

  • fit-params : remove stale llama-ext.h include

Assisted-by: dsh:llama.cpp/ggml-org/DeepSeek-V4.1-Flash-1017-GGUF (Mac Studio, M5 Ultra, 256GB)

  • llama : document llama_model_dflash_selector_top_k

Assisted-by: dsh:llama.cpp/ggml-org/DeepSeek-V4.1-Flash-1017-GGUF (Mac Studio, M5 Ultra, 256GB)

  • llama : promote the NextN / speculative API from llama-ext.h

Move the NextN, layer input, embd row and state row APIs to llama.h
and rename llama_set_embd_state_src to llama_set_ctx_state_src, with
the internal llama_context::set_state_src following the same name.

Assisted-by: dsh:llama.cpp/ggml-org/DeepSeek-V4.1-Flash-1017-GGUF (Mac Studio, M5 Ultra, 256GB)

  • llama : polish the NextN API promotion

Move the NextN draft model queries next to the Adapters section, rename
the src parameters of llama_set_ctx_state_src and
llama_context::set_ctx_state_src to ctx_src, and drop the now-redundant
llama-ext.h includes from common/speculative.cpp and tools/imatrix.

Assisted-by: dsh:llama.cpp/ggml-org/DeepSeek-V4.1-Flash-1017-GGUF (Mac Studio, M5 Ultra, 256GB)

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI:

Don't miss a new llama.cpp release

NewReleases is sending notifications on new releases.