What's Changed
- Add azure gpt-5.1 models by @Sameerlite in #16817
- Add Vertex AI Image Edit Support by @Sameerlite in #16828
- Fix for 16863 - openai conversion from responses to completions by @nkukard in #16864
- MCP Hub - publish/discover MCP Servers within a company by @krrishdholakia in #16857
- [Feature] UI - Model Compare by @yuneng-jiang in #16855
- fix(perf): add missing shared_sessions to audio/transcriptions by @AlexsanderHamir in #16858
- fix(gemini): Add reasoning_content to streaming responses with tools enabled by @Chesars in #16854
- Fix optional param mapping by @alhuang10 in #16852
- fix(vertex_ai): add includeThoughts=True for Gemini 3 reasoning_effort by @sebslight in #16838
- [Fix] Security - Filter secret fields form Langfuse by @AlexsanderHamir in #16842
- Add thought signature support to v1/messages api by @Sameerlite in #16812
- Fix audio transcription cost tracking by @Sameerlite in #16478
- [Fix] Standarize icon images by @yuneng-jiang in #16837
- [Feat] Adds IAM role assumption support for AWS Secret Manager by @ishaan-jaff in #16887
- [Feat] mcp resources support by @uc4w6c in #16800
- [Fix] Key Model Alias Not Working by @yuneng-jiang in #16896
- feat: allow custom violation message for tool-permission guardrail by @uc4w6c in #16916
- feat(pricing): Add Gemini 3 Pro Preview for OpenRouter by @TsurumaruTsuyoshi in #16905
- Upgrade pydantic to version 2.11.0 by @superpoussin22 in #16909
- [Feat] UI - Prompt Management - Allow testing prompts with Chat UI by @ishaan-jaff in #16898
- Investigate issue root cause by @ishaan-jaff in #16859
- [Feat] Prompt Management - Allow viewing version history by @ishaan-jaff in #16901
- fix images being dropped from tool results for bedrock by @cyberjunk in #16492
- [stripe] gemini 3 thought signatures in tool call id by @colinlin-stripe in #16895
- [Infra] CI/CD Fixes by @yuneng-jiang in #16937
- [Feat] Prompt Versioning - Allow specifying prompt version in code by @ishaan-jaff in #16929
- [Fix] Change /public fields to honor server root path by @yuneng-jiang in #16930
- [Fix] Prompt Management - UI, allow seeing model, prompt id for Prompt by @ishaan-jaff in #16932
- [Feat] UI - Show "get code" section for prompt management + minor polish of showing version history by @ishaan-jaff in #16941
- fix: Cerebras GPT-OSS-120B model name by @Chesars in #16939
- [New model] Add GLM 4.6 from together.ai by @ishaan-jaff in #16942
- [Bug Fix]: Search APIs - error in firecrawl-search "Invalid request body" by @ishaan-jaff in #16943
- docs: fix mcp url format by @uc4w6c in #16940
- feat: Add support for Gemini 3 Pro Image model by @Chesars in #16938
- Feat: add support for Grok 4.1 Fast models by @Chesars in #16936
- [Fix] UI - Change Public Model Hub to use proxyBaseUrl by @yuneng-jiang in #16892
- docs: fix anthropic pass-through endpoint by @sureshdsk in #16883
- [Fix] Video download for veo3 by @eiliyaabedini in #16875
- [Feat] New LLM Provider - Docker Model Runner by @ishaan-jaff in #16948
- [Fix] Remove UI Session Token from user/info return by @yuneng-jiang in #16851
- [Fix] Exclude litellm_credential_name from Sensitive Data Masker by @yuneng-jiang in #16950
- [Refactor] UI - Remove console logs and errors from model tab by @yuneng-jiang in #16455
- Docs for Model Compare UI and Org Usage by @yuneng-jiang in #16928
- Remove cost tracking disabled tooltip in chat ui by @ishaan-jaff in #16953
- Revert "[Fix] Exclude litellm_credential_name from Sensitive Data Masker" by @yuneng-jiang in #16956
- fix: arize phoenix logging by @mubashir1osmani in #16301
- feat(bedrock): Add Claude 4.5 to US Gov Cloud by @justin-tahara in #16957
- [Fix] Exclude litellm_credential_name from Sensitive Data Masker (Updated) by @yuneng-jiang in #16958
- fix: cache cooldown key generation by @AlexsanderHamir in #16954
- fix: cache SSL contexts to prevent excessive memory allocation by @AlexsanderHamir in #16955
- [Feature] Allow partial matches for user ID in User Table by @yuneng-jiang in #16952
- [Fix] - Router's Cache: Fix routing for requests with same cacheable prefix but different user messages by @AlexsanderHamir in #16951
- fix redis event loop closed at first call by @wangsoft in #16913
- Gemini 3 Pro Image: capture image_tokens and support cost_per_output_image by @Dima-Mediator in #16912
- fix: add mcp server ids by @mubashir1osmani in #16904
- [Fix] UI - Change Bulk Invite User Roles to Match Backend by @yuneng-jiang in #16906
- Grayswan guardrail passthrough on flagged by @dsduenas in #16891
- Fix missing costs for gemini-2.5-flash-image by @jlan-nl in #16882
- [Infra] Building UI for Testing by @yuneng-jiang in #16968
- Revert "Remove deprecated embedding model" by @ishaan-jaff in #16970
- Litellm sameer nov 3 stable branch by @Sameerlite in #16963
- [Fix] Tests in CI/CD by @yuneng-jiang in #16972
- [Perf] Fix bottlenecks degrading realtime endpoint performance by @AlexsanderHamir in #16670
- Fix SSL test failures due to caching and test isolation issues by @AlexsanderHamir in #16973
- fix: add missing mock attributes in websocket and realtime tests by @AlexsanderHamir in #16974
- docs: Add mini-swe-agent to Projects built on LiteLLM by @Chesars in #16971
- (feat) Anthropic - support Structured Outputs
output_formatfor Claude 4.5 sonnet and Opus 4.1 + Arize Phoenix - root span logging by @krrishdholakia in #16949 - Fix: prevent memory blowout in LoggingWorker by @AlexsanderHamir in #16559
- [Fix] Team Permissions Update and List 404 on Non-existent Team by @yuneng-jiang in #16835
- [Fix] Remove Expired proxy admin keys from cache by @yuneng-jiang in #16894
New Contributors
- @nkukard made their first contribution in #16864
- @alhuang10 made their first contribution in #16852
- @sebslight made their first contribution in #16838
- @TsurumaruTsuyoshi made their first contribution in #16905
- @cyberjunk made their first contribution in #16492
- @colinlin-stripe made their first contribution in #16895
- @sureshdsk made their first contribution in #16883
- @eiliyaabedini made their first contribution in #16875
- @justin-tahara made their first contribution in #16957
- @wangsoft made their first contribution in #16913
- @dsduenas made their first contribution in #16891
Full Changelog: v1.80.0.dev6...v1.80.5-nightly