What's new in 1.8.0 (2025-07-20)

These are the changes in inference v1.8.0.

New features

FEAT: Embedding support llama.cpp backend by @codingl2k1 in #3730
FEAT: non-stream tool calling for sglang by @aniya105 in #3760
FEAT: support migrate from v1 to v2 for custom models by @qinxuye in #3810
FEAT: FLUX.1-Kontext-dev by @qinxuye in #3728
FEAT: support ERNIE 4.5 by @qinxuye in #3812
FEAT: [embedding] add support for jina-embeddings-v4 model by @Minamiyama in #3814
FEAT: [model] support glm-4.1v-thinking by @llyycchhee in #3756

ENH: Pin xllamacpp>=0.1.23 by @codingl2k1 in #3780
ENH: add modelscope for fish speech 1.5 by @qinxuye in #3750
REF: [V2 BREAK] Merge multiple JSON files into one for difference model download sources by @ChengjieLi28 in #3765

BUG: disable flash_attn for qwen3 embedding & rerank when no gpu available by @qinxuye in #3739
BUG: Fix bugs in del async_client by @zhcn000000 in #3753
BUG: add message preprocessing to ensure that content is not null by @amumu96 in #3791
BUG: pre check to prevent from list index out of range for FunASR family models by @leslie2046 in #3809
BUG: resolve issue where AI output was lost when no tool was selected for function call #3767 by @aniya105 in #3768
BUG: fix error in content output at reasoning_content, when using enable_thinking in chat_template_kwargs by @amumu96 in #3794

Full Changelog: v1.7.1...v1.8.0