litellm 1.108.7

1.108.7 (LTS)

on Python PyPI

Verify this release

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/e82a3c646908ba0a6ee0beddc4310d7a6cac4065/cosign.pub \
  ghcr.io/berriai/litellm:v1.108.7

Same command for litellm-database, litellm-non_root and the docker.io/litellm/* images

What's new in 1.108.7 (LTS)

14 PRs. 3 added, 8 fixed, 1 changed. 1 needs action

Action required

• Responses API: Set drop_params: true or stop sending Responses-only fields such as max_tool_calls to providers bridged through chat completions (#48655) ^{Also in 1.109.0}

Changes

• Azure: Added gpt-image edits on Azure AI Foundry deployments, including deployments under a custom name (#49650)
• AWS Bedrock: Added image search on Bedrock knowledge bases with query_image, including image hits in the results (#51062)
• Vertex AI and Gemini: Fixed Gemini image calls billing text, thinking and Vertex Priority tokens at the wrong rates (#51017)
• Vertex AI and Gemini: Fixed /gemini batchGenerateContent batches logging $0 with model unknown instead of billing the calling key (#51279)
• Other providers: Fixed reasoning_effort being dropped or rejected for Baseten models (#40152) ^{Also in 1.109.0}
• Other providers: Fixed baseten/* listing retired deployment IDs instead of the current Baseten Model APIs (#46945) ^{Also in 1.109.0}
• Responses API: Fixed missing or repeated sequence_number on bridged /v1/responses streaming events (#44944)
• Responses API: Fixed streamed MCP follow-ups keeping only the latest tool round, so models repeated tool calls (#47698) ^{Also in 1.109.0}
• Responses API: Fixed 400 on Bedrock when a previous_response_id chain contains a failed turn (#48647) ^{Also in 1.109.0}
• Responses API: Changed Responses-only fields such as max_tool_calls to answer 400 on bridged providers unless drop_params is on (#48655) ^{Also in 1.109.0}
• Batches and files: Added Gemini batches on /v1/batches, with output download through /v1/files and spend tracking (#51032)
• Routing and fallbacks: Fixed Decisions calls on a mixed model group hitting a Bedrock deployment and answering 400 (#48175) ^{Also in 1.109.0}

Backport #51262 · Backport #51266 · Backport #51271 · Backport #51340 · Full changelog