ggml-org/llama.cpp v0.7.0 on GitHub

Overview

llama.cpp v0.7.0 adds the LiliCorr speculative decoding technique and MTP for GLM5-Next, a new GPU cache for MoE experts kept in host memory (--moe-cache-mib, up to ~2.2x decode speedup when experts are offloaded), and a large batch of new models: K2 Horizon (dense and MoVA), Prism Bonsai 2 27B, EmbeddingGemma-2 (text+vision+audio), the LiquidAI d1/d1-omni and vLLM decision 2/d3 decision models, pplx-decider, MiniCPM-V 4.7, Nemotron Super 3.5 VL / Nemotron Bolt and maion-coder. The server gets a refactored chat session API (common_chat_session, part-based formatted output), much better slot and prompt-cache restore behavior, decision-model support for the new architectures and a new default port (9931), the web UI gains a full models manager, and ggml is updated to v0.27.0.

Highlights

New GPU cache for host-memory MoE experts (--moe-cache-mib): experts run on the GPU from an LRU cache, up to 2.2x faster decode #29887
The expert cache is now shared across multiple GPUs #30112
LiliCorr speculative decoding: candidate selection with a small draft transformer on top of DFlash #30506
GLM5-Next: MTP speculative decoding with an optimized sparse attention path #29928
K2 Horizon support in both dense and MoVA variants: conversion, tokenizer, chat template, -sm tensor splitting #29535
Prism Bonsai 2 27B ternary model support #29600
EmbeddingGemma-2: text + vision + audio embedding model #30054
New decision models: LiquidAI d1-3B, d1-omni-600M, vLLM decision 2, vLLM d3 and pplx-decider #30110 #30114 #30378 #30383 #30044
PLaMo-3 tokenizer implements reference pre-segmentation for exact tokenization parity #30045
RPC server supports -sm tensor (tensor-parallel RPC, RPC protocol v8) #26610
Server now listens on port 9931 by default instead of 8080 #30159

API changes

include/llama.h: new moe_cache_size context param for the host-expert GPU cache #29887
include/llama.h: new LLAMA_VOCAB_TYPE_PLAMO3 vocab type #30045
include/llama.h: llama_perf_context_data reports graph reallocations during inference #30329
include/llama.h: embeddings now skips the LM head when a pooling type other than NONE is used #30445
include/llama.h: llama_batch_ext_set_embd_state returns false when the context has no state embedding, M-RoPE order documented #30506
tools/server: chat layer refactored around common_chat_session with feed() / finish() #30210
tools/server: formatted chat output is now an array of parts instead of a single string #30389
tools/server: default listening port changed to 9931 (Docker images keep 8080 inside the container) #30159

New models

K2 Horizon: dense and MoVA variants with conversion, tokenizer, chat template and -sm tensor support #29535
Prism Bonsai 2 27B (ternary) #29600
EmbeddingGemma-2: text + vision + audio embeddings #30054
LiquidAI d1-3B and d1-omni-600M decision models #30110 #30114
vLLM decision 2 and vLLM d3 models #30378 #30383
pplx-decider decision model #30044
MiniCPM-V 4.7 multimodal model #29416
Nemotron Super 3.5 VL and Nemotron Bolt 74B A9B #30520
maion-coder architecture #29778
Mellum: MoE gating parameters read from GGUF and unified RoPE handling #30578
LiliCorr draft model conversion and graph #30506
Rerankers: classifier_activation support, exact GELU for ModernBERT encoders #29692 #30108

Core changes

Speculative decoding: MTP for GLM5-Next, LiliCorr drafts, correct mtmd handling in MTP graphs #29928 #30506 #30257
Speculative decoding: shared nextn tensor flags with consolidated row cropping and sched re-reserve on flag change #30097 #30017 #30020
Speculative decoding: fixed draft sampling and rejection handling, DFlash output head sharing #30095 #30111
New --spec-draft-n-ubatch to size the draft context batch separately and save VRAM #30459
MoE expert cache: host-memory experts served from a device LRU cache, supported over multiple GPUs #29887 #30112
Embedding models: skip the logits buffer and the LM head when pooling is enabled (up to 10x less VRAM) #30255 #30445
Embedding graphs: reordered get_rows, dropped the redundant t_embd expand and leftover ggml_cont calls #30160 #30461 #30198
No-cache attention: padded KV dimension and KQ bias, avoided graph reallocations #30416 #30446 #30439
k-pool models: selection built in the causal mask layout, fixed a scatter data race on shared sequences #30480 #29994
GLM5-Next sparse attention: removed the gather path #30042
KV cache: honor LLAMA_STATE_SEQ_FLAGS_PARTIAL_ONLY so draft checkpoints stop carrying the full KV #30514
Prefetching: merge ranges before issuing system prefetch calls, never map foreign ranges into a backend buffer #30532 #30405
Sampling: greedy selection for eligible temperature-zero chains, backend sampling graph kept static across ubatches #29797 #30223
Tokenizers: PLaMo-3 pre-segmentation and FiM tokens, opt-in NFC normalization for Unigram, strict UTF-8 validation #30045 #30090 #30390 #30485
Jinja: fixed loop variable scoping, Python-compatible tojson rendering, faster context copy #30533 #30483 #30362 #30562
Model split: distribute layers evenly when no device reports free memory #29677

Multi-modality changes

Added mtmd_build_inp_attn_mask for building non-causal multimodal attention masks #30259
Added cohere2 vision encoder support #30062
MTP drafts now handle mtmd inputs, Qwen3.8 Flash Next accepts image embeddings #30257 #30397
New multimodal architectures: MiniCPM-V 4.7, Nemotron Super 3.5 VL, EmbeddingGemma-2 (vision + audio) #29416 #30520 #30054

Server changes

/v1/systemone extended to the new decision models: d1-3B, d1-omni, vLLM decision 2/d3, pplx-decider #30110 #30114 #30378 #30383 #30044
Chat refactor: session-based parsing and part-based formatted output #30210 #30389
Generated text and tokens are now accumulated as parser input, preparing token-aware parsing #29876
Prompt cache: only restorable slot states are saved, so rerank and embedding requests no longer fill the cache #30498
Prompt cache: child tasks prefer empty slots and preserve the state they would overwrite #30567
A pinned busy slot is left untouched until the request can run on it #30295
Slot save/restore now keeps context checkpoints and the draft model state #26004 #30574
Fixed an off-by-two in the SWA reuse threshold that discarded restored states #30580
Fixed a stack-overflow crash when escaping special tokens with std::regex #30243
LLAMA_ARG_SLOT_SAVE_PATH environment variable for --slot-save-path #30272
New per-component server tests; vendored cpp-httplib updated to 0.61.0 #30312 #30494 #30134 #30081

UI changes

New Models Manager: one table of all served models with expandable quants, search, filters, sorting and favorites #29583
Row actions: load/unload, delete from disk, hide/unhide, resumable downloads with progress #29583
Model configuration side drawer with model info, chat template and "start a new chat" / "use in this chat" actions #29583
Models manager follow-ups: GGUF training context, favorite UX, filter and sort fixes #30228
Fixed ui_settings not being applied on the first visit in router mode #29668
Fixed text attachment preview overflow for large pasted text #29898
Fixed the default agentic turns limit falling back to 10 instead of 100 #30582

ggml changes

ggml updated to v0.27.0: the backend scheduler gains user callbacks for split weight copying and compute-buffer reallocation, and the RPC protocol is bumped to v8 for tensor-parallel RPC servers. Backends gained chunked gated-delta-net kernels on CUDA/HIP, KleidiAI SME2 k-quant matmuls and AVX2 Q2_0 dot products on CPU, L2-aware coopmat2 scheduling and bf16 activations on Vulkan, reordered-layout MoE kernels (MXFP4, IQ3, Q5_K, grouped XMX GEMM) on SYCL, dp4a MoE GEMMs on OpenCL, tensor-API and wider-head-dim flash attention on Metal, and a DMA/HVX copy overhaul with pooling and 3D im2col ops on Hexagon. Correctness work focused on non-contiguous and strided views, grid and workgroup size limits, out-of-bounds accesses and well-defined mul_mat_id behavior for duplicate expert ids; symbol visibility now defaults to hidden

Assets

Nightly build: b11669

More info

Releases and versioning of ggml-org projects

Changelog since v0.6.0

620d222 llama.cpp : bump version to 0.7.0 (#30603)
cd0a5b6 models : add Nemotron Super 3.5 VL and Nemotron Bolt 74B A9B support (#30520)
a11b653 scripts : add ci-status.sh to list active CI runs (#30586)
61ad80b server: fix the off-by-two in the SWA reuse threshold (#30580)
a6b91d8 model : Mellum - read MoE gating params from GGUF, unify RoPE (#30578)
ea736c1 server: save the draft state in the slot file (#30574)
b0d2391 server: prefer empty slots and keep states overwritten by child tasks (#30567)
c0cb53a sync : ggml
4ed1c85 ggml : bump version to 0.27.0
711780f ci : bump ty to 0.0.88 (#30587)
fd55cb9 fix(ui): take the agentic turns default from DEFAULT_AGENTIC_CONFIG (#30582)
3e4dfa8 models : add maion-coder (#29778)
08698c8 jinja : improve context copy constructor performance (#30562)
82e1e2f jinja : write nan and inf in tojson as json.dumps does (#30483)
47f5a64 vulkan : fix concurrent first device init (#29766)
e36df60 sycl : replace oneAPI package by DLE+oneDNN package (#30131)
9166cea opencl: fix OOB tail access for adreno noshuffle gemv kernels (#30421)
2130ca8 jinja : fix loop body variable scoping (#30533)
23f83e0 ggml-cpu : optimize pad_f32 (#30526)
2ce20d2 unicode : reject overlong UTF-8 and out-of-range codepoints (#30485)
68ac765 llama : split llama_prefetch() into merge and prefetch steps (#30532)
77c1f39 opencl: apply flash attn softcap before mask (#30546)
733f57a vulkan : copy strided f16 KV once on AMD so reads spread across memory channels (#27703)
5a638ae cpu: add F16 SWIGLU_OAI reference implementation and validation (#29200)
6e66cb5 metal : add BF16 variant of the tensor API flash attention kernel (#30491)
e467e5b kv-cache: honor PARTIAL_ONLY in the plain KV cache (#30514)
1ddc262 graph: keep the graph non empty without embeddings (#30522)
2639a3b server: save only restorable slot states to the prompt cache (#30498)
843e7dc spec : add lilicorr support (#30506)
3e390af vulkan: Use L2-friendly workgroup scheduling for cm2 mulmat (#30215)
a0e6dc7 opencl: support CLAMP on non-contiguous views (#30186)
23deec0 devops: incorrect COPY instruction (#30529)
683bbc0 gguf-py : detect nfc normalization (#30540)
529ac89 sycl: IQ3 code reorder (#29107)
685f708 ggml-cpu : keep the FP16->FP32 lookup table on x86 with F16C (#30342) (#30343)
c114bd4 docs: update IBM zDNN backend docs (#30527)
5cdadfc ggml-cpu : size set_rows conversion buffer for all threads (#30454)
62df181 cuda, hip: GDN chunked kernel (#29353)
37d6d65 skill: Update code-review skill for UI development (#30509)
6868a52 ggml: fix conv_1d result layout for batched input (#28738)
3fb4767 common : add --spec-draft-n-ubatch (#30459)
318a471 docs : clarify installation recommendation for Intel oneAPI Toolkit (#30407)
8c2134a ggml : add note about mul_mat_id + disable mul_mat_id_dup tests (#30501)
df18bee model: split layers evenly when no device reports free memory (#29677)
3eb1013 vendor : update cpp-httplib to 0.61.0 (#30494)
af0579c ggml : improve RPC tensor transfer logs (#30481)
62bacfa cuda : use SIMT implicit GEMM conv2d on AMD without WMMA (#30325)
77390ba jinja : write floats in tojson as Python does (#30362)
c5a9976 opencl: use buf+offset instead of subbuffer for adreno moe expert sort (#30418)
21a19cd opencl: fix q8_0 dp4a mul_mat_id and mark PREC_F32 mul_mat_id unsupported for adreno (#30365)
9cf967a models: drop the t_embd expand of the embedding graphs (#30461)
4dd6dd4 HIP: use 64-row MMQ tiles for some quant types on RDNA3.5 (#28195)
1431019 vulkan: fix compile error (#30495)
e7268bf llama : build the k-pool selection in the causal mask layout (#30480)
cdce056 vulkan: Add workaround for device free memory > total memory on Intel Windows (#29835)
d524bb6 vulkan: Define the shader count for Intel Arc Pro B65 + B70 (#30431)
7ec420b vulkan: support mulmat bf16 activations (#29069)
10da8c4 unicode : add opt-in NFC normalization for Unigram tokenizers (#30390)
eca5458 convert : export YaRN truncation config (#30288)
091b6a7 Enable OpenSSL in FP32/FP16 SYCL builds to restore HF HTTPS downloads (#30330)
fcac190 webgpu: (Fix CI) fix mul_mat_id with duplicate expert ids (#30451)
04f7226 server : escape the special tokens without std::regex (#30243)
ff026f8 chat: replace output string with parts (#30389)
1b70350 ggml : simplify backend search path error handling (#28367)
d71e324 docs : update zDNN supported ops (#30472)
45451c3 kleidiai: add SME2 Q4_K and Q6_K matmul support (#29219)
77c4540 vulkan: Optimize pool_2d when the pooling window is large (#30119)
ecdd29e meta: recreate all subgraphs when the arena is reallocated (#30453)
ec0bfac hexagon: add configurable HTP DCVS/HMX power mode (#30423)
ace20f6 graph: pad the KQ bias of the no-cache attention (#30446)
b9f3599 llama : do not map foreign ranges into a backend buffer (#30405)
f441d2d model: load YaRN beta metadata for laguna models (#30331)
cb55ffe graph: skip the LM head for pooled embeddings (#30445)
a17e94d tests : consolidate context state tests into test-llama-context (#30023)
b476d9a llama : fix log message (#30452)
e0bcacc vulkan: allow multiple devices to access gpu-visible host memory (#29741)
0a731cc ggml-cpu : add AVX2 dot product for Q2_0 (#30447)
f851e24 cuda : add GGML_CUDA_GRAPH_DEBUG and read env vars once (#30327)
bfe65e1 cuda : fix compiler warnings in mmq-load-tiles.cuh (#30443)
411d548 vulkan : split matmul dispatch when it would exceed maxComputeWorkGroupCount (#29533)
296538a spec : remove tokens assert from dsv4 graph_mtp (#30444)
7f51953 model : allow Qwen3.8 Flash Next to accept image embds for MTP (#30397)
882d671 cuda : fix warnings from dead breaks (#30441)
30f7df1 cuda : warnings cleanup (#30420)
9d7d504 convert : fix LoRA conversion with --outtype auto (#30433)
ed019cd llama : skip logits buffer allocation when graph produces no logits (#30255)
9880157 graph : avoid reallocations in the "no cache" path (#30439)
af50f2f ggml-zdnn : introduce Q8_0 mat mul (#29836)
071b553 models : remove redundant ggml_cont calls now supported by all unary kernels (#30198)
4413a19 hexagon: extend scalar DMA broadcasting support for binary ops (#30245)
8f574b0 ci : build OpenVINO releases with GGML_NATIVE=OFF and CPU backend variants (#30324)
a49f58d ci: fix OpenVINO download links (#30401)
cbe28bb model: fix vllm d3 multi seq case (#30408)
358a420 graph: pad the KV dimension of the no-cache attention to 256 (#30416)
48e9857 metal: fix metal tensor kernel_mul_mm error for large tensor (#28748)
8bb3cf0 hexagon: optimize CPY/CONCAT — round 3, short-rows edition (#30341)
0f701c8 vulkan: pack FMA for f16 accumulation, no dot product op (#29877)
efe3626 model: support vllm d3 models (#30383)
097cf33 model: support vllm decision 2 model (#30378)
ccdbe29 tests : link each test against only the libraries it uses (#30299)
073b740 metal : fix mul_mat_id with duplicate ids (#30373)
77757a3 examples : fix draft sampling and rejection handling (#30095)
972b5fc llama : report compute graph reallocations during inference (#30329)
2f160ba ui: fix text attachment preview overflow (#29898)
f9a95ae sycl: guard DMMV reads at row tails (#29338)
08ffba2 vulkan: use ternary expressions to avoid switch lowering for CM2 quant block size (#30164)
a05e58c ggml: Change default visibility of symbols to hidden (#30014)
b2f036c vulkan: fix buffer logging on 32-bit platforms after source split (#30326)
e937b17 hexagon: optimize q2_k bpw and activation (#30035)
b13a93a hexagon: add IM2COL_3D (#30305)
f2cc728 opencl: improve fa, allow dk512 for gemma-4, improve dk64 (#30266)
c83f305 opencl: fix image limit for q4_k dense bin kernels, q4_0 bcast and rms_norm (#30310)
5c8854f rpc : turn GGML_RPC_DEBUG into a verbosity level and add logs (#29544)
a9d27ac model : support for Prism Bonsai 2 27B (#29600)
1cf7767 cpu: fix AVX2 CPUs not using F16C when available (#30270)
966baae vulkan: handle mul_mat_id duplicates in the prepass rather than looping (#29998)
62a6f74 server: add component tests (#30312)
23b0202 server: leave a busy slot untouched when a request pins it (#30295)
69f201a model : support MiniCPM-V 4.7 (#29416)
abee0c8 cmake(s390x): disable z17 target for unsupported compilers (#30297)
aa94f20 args: add LLAMA_ARG_SLOT_SAVE_PATH env for --slot-save-path (#30272)
781dbc5 spec: properly handle mtmd input for mtp (#30257)
0fd868c mtmd: add build_inp_attn_mask (#30259)
1623d8c cuda: always use MMVQ for MUL_MAT_ID on sm_60 (#27828)
1bb2b9f CUDA/HIP: fix race in flash_attn_ext_f16_process_tile when nbatch_combine != DKQ/2 (#30103)
2bbca8f ggml-cpu: vectorize fp32 to fp16 conversion (#30157)
404f557 vulkan: use 4 rows for NVIDIA MUL_MAT_ID MMVQ (#29274)
b797c82 ggml: fix s390x all cpu build (#30140)
f2918ca opencl: add bin kernels kernel_gemm_moe_q4_k_q8_1_dp4a_bin, kernel_gemm_moe_q6_k_q8_1_dp4a_bin (#30187)
1e6f04a sycl : accelerate MXFP4 MoE with arithmetic decoding and weight reordering (#29809)
10a60cf vendor: apply deep nested json patch from upstream (#30253)
79e2e74 CUDA: fix round issue, under MSVC the CPU and GPU agree (#30229)
8e2d31e graph : reorder get_rows for embeddings (#30160)
baef3ed ui: Models Manager Follow-up Improvements (#30228)
f39148a llama-bench: respect -fitc if bigger than required benchmark size (#28331)
50e3e3e CUDA: Remove redundant CUDA copies after SSM_SCAN (#29807)
64df918 opencl: fix kernel compilation for a6x GPUs (#30176)
6184e92 model : use exact GELU for ModernBERT encoders (#30108)
8b54361 chat : refactor API (#30210)
a518119 llama: keep the backend sampling graph static across ubatches (#30223)
8ae3867 ggml: fix OOB write in ggml_acc with negative offset (#30135)
e60eff9 meta : handle host views (#30217)
ba6439a webgpu: use 2D workgroup dispatch for all the ops which use 1D dispatch (e.g., rms_norm) (#30219)
5e4878e vulkan: fix rms_norm workgroup count overflow (#30145)
609290b convert : support compressed-tensor mixed-precision NVFP4 checkpoint (#28636)
86a2835 musa: drop mp_21 from the default architectures (#30203)
e94acad ci: fix Models Backend webgpu by supporting GGML_OP_DUP (#30216)
5e1d740 ci : set run-name for publish release (#30214)
b42b7e6 server: use port 9931 by default (#30159)
b013e56 ui : add the models manager (#29583)
2c564f4 ci: fix HIP quality check by ignoring the 320/256 FA kernel spill (#30212)
1f8fa52 metal: add the 128/96 flash attention kernels, accept every compiled pair (#30209)
8a1a9b5 CUDA: pass src1 precision to host MMQ config helpers (#30168)
d4d82d6 hexagon: fix IM2COL patch-embed DMA ring overflow (#30189)
3d65c90 sycl : Q5_K reorder-layout MMVQ and fused GLU (#29375)
de7fa0a Musa FWHT fix (#30167)
71ad059 CUDA: improve top-k algorithm selection (#28713)
a11f57b model : fix DFlash output head sharing (#30111)
fc9ce6b CUDA: fix MMQ out-of-bounds reads (#29953)
c35b667 CUDA : looped PAD kernel for more than 65535 rows or slices (#30147)
1167d3f CUDA: fix CCCL version guard breaking on major version rollover (#29453)
4f92965 ui: apply ui_settings on first visit in router mode (#29668)
c811cb8 llama: support MoE cache over multiple GPUs (#30112)
033df86 server : preserve context checkpoints across slot save/restore (#26004)
ff5888f vulkan : fix TOP_K for +inf/NaN inputs and k = 1 on negative values (#30107)
dac3087 vulkan: extend sparse FA support to coopmat2 (#30003)
03aa006 vendor : update cpp-httplib to 0.60.1 (#30134)
08246a2 cuda : support arbitrary striding for unary ops on f16, f32, and bf16 (#29781)
46baf1f sycl: FWHT optimizations (#29605)
097f5b5 hex-mmadd: do not assume aligned read/write when bias-add is fused (#30133)
d888016 cuda : Use byte strides for roll to allow non-contiguous ROLL operations (#29547)
fda1866 CUDA: fix norm family kernels when ne[2]/ne[3] exceed grid dim limits (#28175)
ff30363 sycl: fuse the delta-net alpha gate (add + unary + mul) (#29687)
000bee5 sycl: stage bulk uploads (model loading) through a pinned ring buffer (#29608)
37ac634 model : support classifier_activation for rerankers (#29692)
24e4183 ggml-cuda: assign four GDN state columns per warp (#30087)
847f447 sycl: add grouped MoE XMX GEMM (#29245)
75118a3 convert : support Qwen3.5 embedding models (#27920)
9b4ed0c sycl: remove duplicate block-size defines from op headers (#29507)
9c2e0e4 hexagon: enable alloc_buffer_n (#30126)
06cad0b hexagon: Q6_K weight dequant speedup (#30121)
a657f7e model : add LiquidAI/d1-omni-600M decision model (#30114)
aa5e009 hexagon: support tiled Q4_K and Q6_K GET_ROWS (#30115)
7081510 hexagon: improved GELU accuracy (#30104)
bd4eeaa chat: fix jinja parser for TranslateGemma (#30096)
5de7334 chat : name tool and argument parser rules by index (#30088)
88dcc46 model : add LiquidAI/d1-3B decision model (#30110)
b86d2f0 cuda: FWHT kernels for block widths above 512 (#29100)
50a6c5c mtmd: add cohere2 vision support (#30062)
d6cf9ac llama : add a GPU cache for MoE experts kept in host memory (#29887)
42c787e cuda: update uncoalesced memory reads in pool2d (#29425)
18b5f8b server : accumulate generated text and tokens as parse input (#29876)
448147d llama: share the nextn tensor flags between models (#30097)
9881906 metal : few-row MMA mat-mul for the remaining src0 types (#30065)
7e8324f metal : fix MUL_MAT+ADD fusion when the residual is itself a MUL_MAT (#30100)
b9acf13 feat: add GLM5Next MTP, optimize (#29928)
48499d2 qwen3tts : guard speaker_encoder_config patch for CustomVoice variant (#29179)
d0b490f sampling : use greedy selection for eligible temperature-zero chains (#29797)
42b021b vocab : add plamo fim tokens (#30090)
7481354 convert : fix token configuration for PLaMo-3 (#29843)
ad21565 musa: use the tile lightning indexer kernel (#30080)
b7dafa0 vendor : update cpp-httplib to 0.60.0 (#30081)
2690873 imatrix : include clocale for std::setlocale (#30079)
36a7391 ggml-webgpu: fix flash_attn supports_op check for overlapping KV (#28205)
fa3c2fa tests : retain the anchor when testing recurrent rollback (#29923)
005a1e1 [SYCL] fix the issue in mixed different model GPUs in FA (#29071)
d2a79e6 sycl: accelerate GLM MLA prefill with MKL flash attention (#29171)
5e5b628 sycl : fattn_kv_buffers cleanup (#27689)
4d756bc vulkan: fix amd iGPU slow checkpoint read (#30049)
78651c4 sycl: add IQ3_S multi-column MMVQ (#29500)
f498f86 ggml-webgpu: no dawn native features on wasi (#27069)
c479922 hexagon: CPY/CONCAT/CONT/DUP overhaul to use DMA/HVX for all cases (#30067)
5ad1c5d cuda : add BF16 support for XIELU (#29955)
51ce9c1 ggml-cuda: use per-thread stream for buffer-init padding memset (#28782)
abeada3 vocab : implement PLaMo-3 tokenizer pre-segmentation (#30045)
4625240 model : add K2 Horizon dense and MoVA support (#29535)
3109914 llama: remove the gather path of the glm5-next sparse attention (#30042)
4fbc76d model: support embeddinggemma2 (text+vision+audio) (#30054)
2207c8e opencl: fix OOB read in adreno xmem GEMM (#30041)
a46709b RPC: add -sm tensor (#26610)
65840ed ggml: fix CLAMP on non-contiguous views (CPU, CUDA) (#29517)
ab09ea4 cuda: BF16/FP16 conversion to f32 chunking (#29442)
da263e7 models: support pplx-decider (#30044)
a043d38 metal : fix excess threadgroup memory in quantized flash attention (#29340)
58cb913 vulkan : check for null vkEnumerateInstanceVersion (#29872)
4f54067 HIP: use -O0 for host code in debug builds (#29795)
f0c41e0 models : consolidate nextn row cropping into shared helpers (#30017)
d7a695e scripts : limit apiabi checks to libllama and libmtmd (#30038)
6c73b3e convert : add text_config as fallback [transformers 5.18] (#30040)
1a3011c llama : re-reserve the sched when the nextn extraction flags change (#30020)
6753a03 ggml: refactor selective expert copying to user code (#29943)
cbb7d52 test-llama-archs : initialize backends before generating models (#30034)
63bef27 vendor : update LibreSSL to 4.3.3 [no ci] (#30019)
b9a5a00 ggml-openvino: fix CI tests; fix GPU regressions. (#30037)
43fe9c6 llama: fix k-pool scatter data race on shared sequences (#29994)
5e03bdd hexagon: ssm-conv updates (#29971)
50569eb hexagon: add pool op support (#29995)
7049ff0 ci : add 1accel label [no ci] (#30016)
c250304 ci : skip container re-tagging when Require Docker is disabled (#30008)
8345f33 hexagon: matmul and flash-atten scalability updates (#29974)