BerriAI/litellm v1.110.0-dev.2 on GitHub

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. This release is signed with the key introduced in commit e82a3c6.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the published signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/e82a3c646908ba0a6ee0beddc4310d7a6cac4065/cosign.pub \
  ghcr.io/berriai/litellm:v1.110.0-dev.2

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.110.0-dev.2/cosign.pub \
  ghcr.io/berriai/litellm:v1.110.0-dev.2

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

fix(router): record retries and fallback hops past a request's first logged failure by @narmstrong-berri in #50445
feat(spend-logs): turn off prompt storage per key or team by @krrish-berri-2 in #50135
fix(proxy)!: preserve Responses SSE event framing by @HootRock in #47980
feat(azure_ai): add cohere-rerank-v5-pro and -fast from the Azure retail price feed by @devin-ai-integration[bot] in #50499
fix(caching): don't cache or replay a reply that has no output by @PyExtreme in #50057
fix(gemini): add Gemini 2.5 Pro flex cache price above 200k tokens by @devin-ai-integration[bot] in #50480
fix(azure): align chat-latest retirement metadata with its documented alias by @devin-ai-integration[bot] in #50509
fix(vertex_ai): authenticate Vertex AI pass-through requests once by @quietjules in #48942
fix(redis): share one native circuit breaker between RedisCache and the Rust stores by @yujonglee-berri in #50473
fix(azure): add data zone rows for gpt-realtime-2.1, gpt-realtime-2.1-mini and gpt-realtime-1.5 by @devin-ai-integration[bot] in #50519
fix(anthropic): preserve streamed tool argument fragments verbatim by @mateo-berri in #50470
fix(vertex_ai): return 400 instead of 500 when Gemini image edit has no image by @MukeshK17 in #50244
refactor: declare each lazy litellm attribute once and resolve them through one function by @mateo-berri in #50523
fix(cost-map): sync OpenAI fine-tune and Codestral 2405 shutdown dates by @devin-ai-integration[bot] in #50529
fix(utils): drop Anthropic-only output_config under drop_params on providers that do not read it by @ryan-crabbe-berri in #50542
feat(cost-map): read alias_of pointer rows in the catalog and the loader by @kerry-berri in #50512
feat(cost-map): add moonshot/kimi-k3.1-pro-highspeed pricing (#50521) by @thinhnx128 in #50538
refactor: read lazy attributes with getattr instead of a TypedDict wrapper by @mateo-berri in #50543
fix(chatgpt): round-trip encrypted reasoning through /v1/messages by @Hugo-DDT in #49076
feat(cost-map): move -latest model aliases into the cost map by @kerry-berri in #50491
fix(cost-map): update Together Qwen3.7-Max pricing and add Rnj-1 Instruct by @devin-ai-integration[bot] in #50548
feat(guardrails): add prebuilt credential patterns for OpenAI, Anthropic, and Gemini by @yogeshwaran10 in #50268
fix(anthropic): reasoning_effort "none" disables thinking on Claude models that think by default by @ryan-crabbe-berri in #50541
test(e2e): add a Codex row where a sub-agent must read the task its parent hands it by @ryan-crabbe-berri in #50494
feat(ui): set deployment weights in key and team router settings by @joshua-berri in #50552
fix(mcp): derive MCP bridge and session keys with the FIPS provider's KBKDF by @yucheng-berri in #50032
fix(responses): surface mid-stream upstream errors that arrive without an event type by @ryan-crabbe-berri in #50466
test(integration): give each kill-burst its own prompts so cached control replies cannot stand in for late traffic by @mateo-berri in #50569
test(integration): budget proxy restart tests from calibrated boot time by @mateo-berri in #49761
fix(otel): name the routed model on auto-router LLM spans by @yucheng-berri in #50498
fix(proxy): hold DB_RECONCILE_LOCK around credential create, update and delete by @kerry-berri in #50551
fix(anthropic): refresh the WIF bearer token on the connection error retry by @kerry-berri in #50570
test(translation): expect redacted thinking blocks on Azure and Bedrock Mantle messages after #49076 by @devin-ai-integration[bot] in #50576
refactor(ui): clear hardcoded English from dashboard JSX by @yuneng-berri in #50575
fix(anthropic): exchange Google identity tokens again on refresh and read oidc/ references out of ANTHROPIC_IDENTITY_TOKEN by @kerry-berri in #50583
test(proxy): delete 28 dead skipped tests in test_key_generate_prisma.py by @yuneng-berri in #50550
fix(router): a cancelled or retried attempt releases its io-token reservation and least-busy count by @joshua-berri in #50486
feat(proxy): per-request header opts a stream into usage.cost without the global include_cost_in_streaming_usage flag by @kerry-berri in #50574

New Contributors

@HootRock made their first contribution in #47980
@PyExtreme made their first contribution in #50057
@MukeshK17 made their first contribution in #50244
@thinhnx128 made their first contribution in #50538
@Hugo-DDT made their first contribution in #49076

Full Changelog: v1.110.0-dev.1...v1.110.0-dev.2