BerriAI/litellm v1.80.5-nightly on GitHub

What's Changed

Add azure gpt-5.1 models by @Sameerlite in #16817
Add Vertex AI Image Edit Support by @Sameerlite in #16828
Fix for 16863 - openai conversion from responses to completions by @nkukard in #16864
MCP Hub - publish/discover MCP Servers within a company by @krrishdholakia in #16857
[Feature] UI - Model Compare by @yuneng-jiang in #16855
fix(perf): add missing shared_sessions to audio/transcriptions by @AlexsanderHamir in #16858
fix(gemini): Add reasoning_content to streaming responses with tools enabled by @Chesars in #16854
Fix optional param mapping by @alhuang10 in #16852
fix(vertex_ai): add includeThoughts=True for Gemini 3 reasoning_effort by @sebslight in #16838
[Fix] Security - Filter secret fields form Langfuse by @AlexsanderHamir in #16842
Add thought signature support to v1/messages api by @Sameerlite in #16812
Fix audio transcription cost tracking by @Sameerlite in #16478
[Fix] Standarize icon images by @yuneng-jiang in #16837
[Feat] Adds IAM role assumption support for AWS Secret Manager by @ishaan-jaff in #16887
[Feat] mcp resources support by @uc4w6c in #16800
[Fix] Key Model Alias Not Working by @yuneng-jiang in #16896
feat: allow custom violation message for tool-permission guardrail by @uc4w6c in #16916
feat(pricing): Add Gemini 3 Pro Preview for OpenRouter by @TsurumaruTsuyoshi in #16905
Upgrade pydantic to version 2.11.0 by @superpoussin22 in #16909
[Feat] UI - Prompt Management - Allow testing prompts with Chat UI by @ishaan-jaff in #16898
Investigate issue root cause by @ishaan-jaff in #16859
[Feat] Prompt Management - Allow viewing version history by @ishaan-jaff in #16901
fix images being dropped from tool results for bedrock by @cyberjunk in #16492
[stripe] gemini 3 thought signatures in tool call id by @colinlin-stripe in #16895
[Infra] CI/CD Fixes by @yuneng-jiang in #16937
[Feat] Prompt Versioning - Allow specifying prompt version in code by @ishaan-jaff in #16929
[Fix] Change /public fields to honor server root path by @yuneng-jiang in #16930
[Fix] Prompt Management - UI, allow seeing model, prompt id for Prompt by @ishaan-jaff in #16932
[Feat] UI - Show "get code" section for prompt management + minor polish of showing version history by @ishaan-jaff in #16941
fix: Cerebras GPT-OSS-120B model name by @Chesars in #16939
[New model] Add GLM 4.6 from together.ai by @ishaan-jaff in #16942
[Bug Fix]: Search APIs - error in firecrawl-search "Invalid request body" by @ishaan-jaff in #16943
docs: fix mcp url format by @uc4w6c in #16940
feat: Add support for Gemini 3 Pro Image model by @Chesars in #16938
Feat: add support for Grok 4.1 Fast models by @Chesars in #16936
[Fix] UI - Change Public Model Hub to use proxyBaseUrl by @yuneng-jiang in #16892
docs: fix anthropic pass-through endpoint by @sureshdsk in #16883
[Fix] Video download for veo3 by @eiliyaabedini in #16875
[Feat] New LLM Provider - Docker Model Runner by @ishaan-jaff in #16948
[Fix] Remove UI Session Token from user/info return by @yuneng-jiang in #16851
[Fix] Exclude litellm_credential_name from Sensitive Data Masker by @yuneng-jiang in #16950
[Refactor] UI - Remove console logs and errors from model tab by @yuneng-jiang in #16455
Docs for Model Compare UI and Org Usage by @yuneng-jiang in #16928
Remove cost tracking disabled tooltip in chat ui by @ishaan-jaff in #16953
Revert "[Fix] Exclude litellm_credential_name from Sensitive Data Masker" by @yuneng-jiang in #16956
fix: arize phoenix logging by @mubashir1osmani in #16301
feat(bedrock): Add Claude 4.5 to US Gov Cloud by @justin-tahara in #16957
[Fix] Exclude litellm_credential_name from Sensitive Data Masker (Updated) by @yuneng-jiang in #16958
fix: cache cooldown key generation by @AlexsanderHamir in #16954
fix: cache SSL contexts to prevent excessive memory allocation by @AlexsanderHamir in #16955
[Feature] Allow partial matches for user ID in User Table by @yuneng-jiang in #16952
[Fix] - Router's Cache: Fix routing for requests with same cacheable prefix but different user messages by @AlexsanderHamir in #16951
fix redis event loop closed at first call by @wangsoft in #16913
Gemini 3 Pro Image: capture image_tokens and support cost_per_output_image by @Dima-Mediator in #16912
fix: add mcp server ids by @mubashir1osmani in #16904
[Fix] UI - Change Bulk Invite User Roles to Match Backend by @yuneng-jiang in #16906
Grayswan guardrail passthrough on flagged by @dsduenas in #16891
Fix missing costs for gemini-2.5-flash-image by @jlan-nl in #16882
[Infra] Building UI for Testing by @yuneng-jiang in #16968
Revert "Remove deprecated embedding model" by @ishaan-jaff in #16970
Litellm sameer nov 3 stable branch by @Sameerlite in #16963
[Fix] Tests in CI/CD by @yuneng-jiang in #16972
[Perf] Fix bottlenecks degrading realtime endpoint performance by @AlexsanderHamir in #16670
Fix SSL test failures due to caching and test isolation issues by @AlexsanderHamir in #16973
fix: add missing mock attributes in websocket and realtime tests by @AlexsanderHamir in #16974
docs: Add mini-swe-agent to Projects built on LiteLLM by @Chesars in #16971
(feat) Anthropic - support Structured Outputs output_format for Claude 4.5 sonnet and Opus 4.1 + Arize Phoenix - root span logging by @krrishdholakia in #16949
Fix: prevent memory blowout in LoggingWorker by @AlexsanderHamir in #16559
[Fix] Team Permissions Update and List 404 on Non-existent Team by @yuneng-jiang in #16835
[Fix] Remove Expired proxy admin keys from cache by @yuneng-jiang in #16894

New Contributors

@nkukard made their first contribution in #16864
@alhuang10 made their first contribution in #16852
@sebslight made their first contribution in #16838
@TsurumaruTsuyoshi made their first contribution in #16905
@cyberjunk made their first contribution in #16492
@colinlin-stripe made their first contribution in #16895
@sureshdsk made their first contribution in #16883
@eiliyaabedini made their first contribution in #16875
@justin-tahara made their first contribution in #16957
@wangsoft made their first contribution in #16913
@dsduenas made their first contribution in #16891

Full Changelog: v1.80.0.dev6...v1.80.5-nightly