pypi litellm 1.108.12
1.108.12 (LTS)

one hour ago

Tip

The lts image tag always points to the latest LTS release. Pull ghcr.io/berriai/litellm:lts to stay on the newest LTS patch

Verify this release

cosign verify \
  --certificate-identity https://github.com/BerriAI/project-releaser/.github/workflows/release.yml@refs/heads/main \
  --certificate-oidc-issuer https://token.actions.githubusercontent.com \
  ghcr.io/berriai/litellm:v1.108.12

Same command for litellm-database, litellm-non_root and the docker.io/litellm/* images

What's new in 1.108.12 (LTS)

8 PRs. 6 fixed. No action needed to upgrade

Changes

  • OpenAI: Fixed GPT-6.2 prompt caching for system prompts sent to /v1/chat/completions or /v1/messages with store: false (#52621, #52739)
  • Azure: Fixed azure_ai/model_router on a Foundry /openai/v1 base failing on /v1/responses and /v1/responses/compact (#52474)
  • Vertex AI and Gemini: Fixed one json_schema row failing every other row in a Vertex batch file (#51790)
  • Messages API: Fixed 400 Tool reference '<name>' not found on /v1/messages when a guardrail sees a tool name over 64 characters (#47434)
  • Messages API: Fixed OpenAI models on /v1/messages that keep streaming upstream after the caller closes the stream (#52144)
  • Guardrails: Fixed tool_policy letting /v1/messages requests through when a blocked tool name is over 64 characters (#52717)

Backport #52476 · Backport #52666 · Backport #52725 · Full changelog

Don't miss a new litellm release

NewReleases is sending notifications on new releases.