What's Changed
- Fix multimodal server prefill alignment by @Blaizzy in #1872
- Load pre-converted MLX Inkling checkpoints by @Lazarus-931 in #1880
- Skip conv transposes for pre-converted SAM 3.1 checkpoints (#1871) by @Lazarus-931 in #1877
- Add text and multimodal reranking endpoint by @Lazarus-931 in #1853
- Keep pending padding metadata aligned after filtering by @byoan in #1890
- Add PLaMo 2.1 VL support by @mitmul in #949
- Fix Idefics3/SmolVLM LoRA training crashes (#1830) by @Lazarus-931 in #1852
- Allow CacheList extraction with plain KVCache children by @byoan in #1870
- Add Nemotron-VoiceChat-11B full-duplex speech model by @lucasnewman in #1817
- Porting twenty four MLX-LM models by @Lazarus-931 in #1891
- Add native sequence classifier rerankers by @Lazarus-931 in #1893
- Add Nemotron-Parse (C-RADIO encoder + mBART decoder) model support by @axiom-of-choice in #1866
- Fix thinking_budget silently ignored for self-opening thinking models by @Lazarus-931 in #1912
- Fix SmolVLM inference with flattened image features by @Lazarus-931 in #1905
- Stop a short first prompt from disabling prefix caching by @Lazarus-931 in #1901
- Load text-only checkpoints of vision-language models by @Lazarus-931 in #1879
- Support per-generator prefill step size overrides by @byoan in #1895
- Fix zero-length rotating cache merge by @Lazarus-931 in #1916
- Add GOT-OCR 2.0 model support by @axiom-of-choice in #1908
- lfm2_vl: implement official image splitting (tiling) by @ivanfioravanti in #1885
- fix(rope): support per-batch array offsets in eager RoPE by @nazerim in #1883
- fix(molmo_point): honor point_color in draw_points_on_image by @Anai-Guo in #1887
- Fix SmolVLM split-image token expansion by @atirna in #1922
- feat(server): live runtime settings via /v1/settings (reload-on-change, no restart) by @Lazarus-931 in #1876
- fix(models): honor a caller-supplied attention mask in five language models by @Anai-Guo in #1913
- Use correct RoPE scaling for several models by @lucasnewman in #1927
- Add Ministral3 embedder: reuse backbone with bidirectional mask by @Aryagarg23 in #1851
- Add video subsampling to images fallback in the server by @lucasnewman in #1924
- Fix PoolingCache APC restoration by @byoan in #1929
- Fix EOS token for Idefics3 by @lucasnewman in #1936
New Contributors
- @mitmul made their first contribution in #949
- @axiom-of-choice made their first contribution in #1866
- @nazerim made their first contribution in #1883
- @Anai-Guo made their first contribution in #1887
- @atirna made their first contribution in #1922
Full Changelog: v0.6.13...v0.6.14