This development release adds Ling 3.0 Flash and Jina Reranker v3.5 support, enforces thinking budgets during VLM MTP, and fixes long-context memory admission, cache cleanup, reasoning parsing, and model reload behavior.
- Added Ling 3.0 Flash support for FP8, official mixed FP4/FP8 checkpoints, oQ/oQe conversion, variable-length batching, and SSD prefix-cache restores. Original implementation and FP4 support by @scaryrawr in #2526 and #2534.
- Added thinking-budget enforcement during VLM MTP speculative decoding for supported models. By @Maxim-Mazurok in #2456.
- Added Jina Reranker v3.5 support, including its projector format, sliding-window attention, dual matching, and block fusion. By @damascoemi in #2449 and #2494.
- Fixed Gemma 4 reasoning leaking into visible content after tool responses when the prompt had already opened a thought channel. By @jetztmalehrlich in #2533.
- Fixed Hermes context handling to use the context length reported by oMLX and refuse launch when the available context is below 64K. Reported by @dovil in #2538.
- Fixed false long-context HTTP 400 responses when the previous request's KV cache was still held during asynchronous SSD storage. oMLX now waits briefly for scheduler cleanup and checks memory again. Reported by @dovil in #2538.
- Fixed DeepSeek V4 prefill memory estimates by accounting for its hybrid attention and cache layout instead of applying the generic KV formula. Reported by @Letreguilly in #2521.
- Admin benchmarks no longer write generated KV caches to tiered storage, avoiding long cache-write delays after large-context runs. Reported by @zviratko in #2539.
- Changing load-time model settings now clears a cached load failure, so options such as
trust_remote_codecan be retried without restarting oMLX. Reported by @zviratko in #2532.