BerriAI/litellm v1.84.0-rc.1 on GitHub

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.84.0-rc.1

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.84.0-rc.1/cosign.pub \
  ghcr.io/berriai/litellm:v1.84.0-rc.1

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

What's Changed

merge main by @Sameerlite in #25521
merge litellm_internal_staging by @Sameerlite in #25949
merge main by @Sameerlite in #26304
merge main by @Sameerlite in #26379
merge main by @Sameerlite in #26437
fix(redis): cache GCP IAM token to prevent async event loop blocking by @harish-berri in #26441
litellm oss branch by @krrish-berri-2 in #26386
fix noma v2 deepcopy crashing in build scan payload - new PR by @omriShukrun08 in #26605
fix(ui): use stored-credentials endpoint for tools fetch on MCP edit page by @ryan-crabbe-berri in #26002
feat(proxy): add --timeout_worker_healthcheck flag for uvicorn worker triage by @ryan-crabbe-berri in #26622
fix(ci): support CircleCI rerun failed tests for local_testing jobs by @mateo-berri in #26461
docs: update pull_request_template to add Linear ticket mentioning by @mateo-berri in #26655
fix(pricing): GPT-5.5 Pro Pricing by @lmcdonald-godaddy in #26651
feat(proxy): Add cleanup job for expired LiteLLM dashboard session keys by @milan-berri in #26460
fix(ui): move 'Store Prompts in Spend Logs' toggle to Admin Settings by @ryan-crabbe-berri in #26631
fix(caching): preserve prompt_tokens_details through embedding cache round-trip by @michelligabriele in #26653
feat(logging): add retry settings for generic API logger by @milan-berri in #26645
fix(logging): backfill streaming hidden response cost by @milan-berri in #26606
fix(vertex-ai): reuse anthropic messages config instances by @Sameerlite in #26099
fix(vertex): preserve items on array branches in anyOf with null + de-flake test by @yuneng-berri in #26675
fix(tests): replace deprecated Bedrock Claude 3.7 Sonnet model ID by @ryan-crabbe-berri in #26721
[Fix] Cache LiteLLM_Config param reads in DualCache and batch by @Michael-RZ-Berri in #26469
[Feat] Lazy-load optional feature routers on first request by @Michael-RZ-Berri in #26534
[Fix] Unify cost calc in success_handler dict and typed branches by @Michael-RZ-Berri in #26629
Revert "[Feat] Lazy-load optional feature routers on first request" by @krrish-berri-2 in #26727
[Infra] Version Bump by @yuneng-berri in #26728
[Infra] Promote Internal Staging to main by @yuneng-berri in #26731
ci(release): accept PEP 440 tag forms in create-release workflow by @yuneng-berri in #26734
[Feat] Add gpt-image-2 support (#26644) by @ishaan-berri in #26705
feat(provider): add AIHubMix as an OpenAI-compatible provider by @xinrui-z in #24294
merge internal staging by @Sameerlite in #26737
merge main by @Sameerlite in #26742
merge mian by @Sameerlite in #26745
fix(test): scope ERROR log assertion to LiteLLM logger in test_model_alias_map by @mateo-berri in #26741
merge main by @Sameerlite in #26757
fix(bedrock, anthropic): translate OpenAI file content on tool-result path by @minznerjosh in #26710
remove /ui/chat page by @ishaan-berri in #26739
fix: add optional TCP SO_KEEPALIVE support to aiohttp's TCPConnector by @yassinkortam in #26730
feat(proxy): LiteLLM headers on Google native generateContent routes by @Sameerlite in #25500
feat(vector-stores): support Bedrock retrievalConfiguration passthrough by @Sameerlite in #26685
feat(mcp): opt-in short-ID tool prefix to keep MCP tool names under the 60-char limit by @mateo-berri in #26733
fix(proxy): self-heal Prisma read paths + harden reconnect state machine by @yuneng-berri in #26756
[Fix] Redact spend logs error message by @Michael-RZ-Berri in #26662
[Feat]Add support for azure entra discovery endpoint by @Sameerlite in #26584
[Fix] Proxy: reconnect Prisma DB without blocking the event loop by @yuneng-berri in #26225
feat(proxy): durable agent workflow run tracking via /v1/workflows/runs by @ishaan-berri in #26793
chore(auth): tighten clientside api_base handling by @stuxf in #26518
fix: drop sensitive locals from re-raised error messages by @ryan-crabbe-berri in #26823
test(vertex-batches): set is_redirect=False on mocked retrieve response by @yuneng-berri in #26844
chore(vector-stores): redact credentials in list/info/update responses; gate update by per-store access by @stuxf in #26489
chore(auth): substitute alias for master key on UserAPIKeyAuth by @stuxf in #26484
fix(mcp): tighten public-route detection and OAuth2 fallback gating by @stuxf in #26463
[Fix] Team member null budget fallback by @Michael-RZ-Berri in #26809
fix(proxy): inherit caller identity in passthrough batch managed-object by @ryan-crabbe-berri in #26831
fix(proxy/auth): tighten guardrail modification permission check by @ryan-crabbe-berri in #26821
[Fix] CI/Tooling: Correct min-release-age value in .npmrc files by @yuneng-berri in #26850
fix(bedrock): add 1-hour cache write pricing for Claude 4.5/4.6/4.7 (Global, US) by @mateo-berri in #26800
feat(proxy): add team-level search provider credentials by @Sameerlite in #26691
Litellm oss staging by @Sameerlite in #26759
fix(proxy/batches): forward model to retrieve_batch for bedrock by @sruthi-sixt-26 in #26814
fix(passthrough): track spend for interrupted Bedrock streams by @mateo-berri in #26719
merge main by @Sameerlite in #26855
Litellm oss staging by @Sameerlite in #26852
chore(team): audit-log team-callback admin mutations by @stuxf in #26859
chore(team): close authz bypass via the available-team check by @stuxf in #26854
chore(auth): harden invite-link onboarding token flow by @stuxf in #26843
chore(mcp): tighten OAuth root endpoint resolution by @stuxf in #26840
fix: validate aws region name by @yassin-berriai in #26906
fix: drop milvus dbName and partitionNames from MILVUS_OPTIONAL_PARAMS by @yassin-berriai in #26910
[Feat / Fix] Lazy loaded imports, lazy loaded front page by @Michael-RZ-Berri in #26802
chore(proxy): harden request control fields by @stuxf in #26862
chore(proxy): block env callback refs in key metadata by @stuxf in #26851
chore(mcp): encrypt user-scoped MCP credentials at rest by @stuxf in #26836
chore(mcp): SSRF guard on OAuth metadata discovery follow-up fetches by @stuxf in #26849
[Fix] Replace subprocess startup-import diff with static source scan by @Michael-RZ-Berri in #26934
chore(passthrough): default auth=True and drop enterprise gate on the safe option by @stuxf in #26827
chore(proxy): contain UI_LOGO_PATH / LITELLM_FAVICON_URL on unauthenticated asset endpoints by @stuxf in #26815
chore(cli): tighten CLI SSO session flow by @stuxf in #26835
[Test] Proxy E2E: Opt In To Client Mock Response For Model Access Tests by @yuneng-berri in #26941
[Fix] Responses API: Omit Empty Body On DELETE by @yuneng-berri in #26949
Run pre_call_hook on Google generateContent endpoints by @Michael-RZ-Berri in #26914
[Fix] Refresh Redis TTL on counter writes, skip stale in-memory in Redis by @Michael-RZ-Berri in #26829
Add pagination controls to model health status by @shivamrawat1 in #26826
feat(vertex_ai): propagate metadata labels to embedding, Imagen, rerank by @Sameerlite in #25499
fix(anthropic): json response_format + user tools non-streaming by @Sameerlite in #26222
[Infra] Bump Versions by @yuneng-berri in #26961
[Infra] Promote Internal Staging to main by @yuneng-berri in #26962
[Infra] Promote internal staging to main by @yuneng-berri in #27245

New Contributors

@omriShukrun08 made their first contribution in #26605
@lmcdonald-godaddy made their first contribution in #26651
@xinrui-z made their first contribution in #24294
@minznerjosh made their first contribution in #26710
@yassinkortam made their first contribution in #26730
@sruthi-sixt-26 made their first contribution in #26814

Full Changelog: v1.83.14-stable...v1.84.0-rc.1