What's Changed
- fix(anthropic): preserve thinking.summary when routing to OpenAI Responses API by @Chesars in #21441
- docs: add thinking.summary field to /v1/messages and reasoning docs by @Chesars in #22823
- fix(gemini): resolve image token undercounting in usage metadata by @gustipardo in #22608
- feat(anthropic): add opt-out flag for default reasoning summary by @Chesars in #22904
- fix(anthropic): align translate_thinking_for_model with default summary injection + docs by @Chesars in #22909
- fix(fireworks): skip #transform=inline for base64 data URLs by @awais786 in #23729
- fix(langsmith): avoid no running event loop during sync init by @pandego in #23727
- fix(gemini): support images in tool_results for /v1/messages routing by @awais786 in #23724
- fix(model-prices): correct supported_regions for Vertex AI DeepSeek models by @Chesars in #23864
- fix(model-prices): restore gpt-4-0314 by @Chesars in #23753
- fix(cache): Fix Redis cluster caching by @cohml in #23480
- fix(proxy): convert max_budget to float when set via environment variable by @rstar327 in #23855
- Add Akto Guardrails to LiteLLM by @rzeta-10 in #23250
- fix(core): map Anthropic 'refusal' finish reason to 'content_filter' by @Chesars in #23899
- fix(vertex): streaming finish_reason='stop' instead of 'tool_calls' for gemini-3.1-flash-lite-preview by @Chesars in #23895
- fix: map Chat Completion file type to Responses API input_file by @gambletan in #23618
- fix(vertex): respect vertex_count_tokens_location for Claude count_tokens by @Chesars in #23907
- fix(anthropic): preserve cache directive on file-type content blocks by @Chesars in #23906
- fix(mistral): preserve diarization segments in transcription response by @Chesars in #23925
- fix(gemini): pass model to context caching URL builder for custom api_base by @Chesars in #23928
- fix(azure): auto-route gpt-5.4+ tools+reasoning to Responses API by @Chesars in #23926
- merge main by @Sameerlite in #24119
- [Test] UI: Add vitest coverage for 10 untested components by @yuneng-jiang in #24144
- [Refactor] UI - API Reference: Migrate to Path-Based Routing by @yuneng-jiang in #24155
- [Fix] UI: AntD Messages Not Rendering by @yuneng-jiang in #24192
- [Feature] UI - Teams: Modernize Teams Table by @yuneng-jiang in #24189
- [Refactor] Extract useChatHistory hook from ChatUI.tsx by @yuneng-jiang in #24172
- Day 0: gpt 5.4 mini and nano support by @Sameerlite in #23958
- [feat]Add prompt management support for responses api by @Sameerlite in #23999
- docs(vertex): add PayGo/Priority tutorial and cost tracking flow diagramLitellm vertex paygo tutorial by @Sameerlite in #24009
- feat(file_search): align emulated Responses behavior with native output by @Sameerlite in #23969
- fix(proxy): pass-through subpath auth for non-admin users by @Sameerlite in #24079
- fix(polling): check rate limits before creating polling ID by @Sameerlite in #24106
- docs: note min version for encrypted_content_affinity by @milan-berri in #23854
- feat(router): add per-model-group deployment affinity by @Sameerlite in #24110
- Litellm fix ensure alternating roles by @Sameerlite in #24015
- fix(bedrock): respect api_base and aws_bedrock_runtime_endpoint in count_tokens endpoint by @stias in #24199
- fix(gemini-embeddings): convert task_type to camelCase taskType for Gemini API by @christopherbaer in #24191
- fix(vertex-ai): support batch cancel via Vertex API by @Sameerlite in #23957
- fix(azure-ai-agents): preserve annotations in Bing Search grounding responses by @Sameerlite in #23939
- fix(logging): merge hidden_params into metadata for streaming requests by @milan-berri in #24220
- docs(pricing): add official source links for Azure DeepSeek & Cohere … by @Jayachander123 in #20181
- fix(transcription): fix cost_per_second calculation for audio transcription models by @gvioss in #23842
- fix(moonshot): preserve reasoning_content on Pydantic Message objects in multi-turn tool calls by @BillionClaw in #23828
- fix(proxy): add team_member_budget_duration to NewTeamRequest by @michelligabriele in #23484
- [Feature] Team MCP Server Manager Role by @yuneng-jiang in #24171
- [Docs] Add missing team_member_budget_duration param to new_team docstring by @yuneng-jiang in #24243
- feat: add control plane for multi-proxy worker management by @ryan-crabbe in #24217
- Revert "[Feature] Team MCP Server Manager Role" by @yuneng-jiang in #24255
- fix(test): mock get_auth_header instead of get_api_key in anthropic file content test by @joereyna in #24258
- [Infra] Merge internal dev branch with main by @yuneng-jiang in #24260
- [Feature] Add Audit Log Export to External Callbacks by @yuneng-jiang in #23167
- fix(adapter): add additionalProperties: false for OpenAI strict mode in Anthropic adapter by @Chesars in #24072
- feat(gemini): support context circulation for server-side tool combination by @Chesars in #24073
- feat(bedrock): support cache_control_injection_points for tool_config location by @Chesars in #24076
- Revert "fix(transcription): fix cost_per_second calculation for audio transcription models" by @Sameerlite in #24297
- Litellm fix create key tags dropdown by @ryan-crabbe in #24273
- Litellm oss staging 03 19 2026 by @krrishdholakia in #24174
- docs: add Gemini/Vertex AI prompt caching support to docs by @krrishdholakia in #24222
- fix: global secret redaction via root logger + key-name-based pattern matching by @ryan-crabbe in #24305
- polish: add click-to-copy icon on User ID in internal users table by @ryan-crabbe in #24315
- polish: remove required asterisks from v3 login form fields by @ryan-crabbe in #24318
- Litellm ishaan march 20 by @ishaan-jaff in #24303
- fix(fireworks): skip #transform=inline for base64 data URLs (#23729) by @krrishdholakia in #23818
- fix(proxy): restore per-entity breakdown in aggregated daily activity endpoint by @michelligabriele in #23471
- Litellm oss staging 03 05 2026 by @krrishdholakia in #22844
- Litellm dev sameer 16 march week by @Sameerlite in #24211
- litellm ryan march 20 by @ryan-crabbe in #24323
New Contributors
- @gustipardo made their first contribution in #22608
- @pandego made their first contribution in #23727
- @cohml made their first contribution in #23480
- @rstar327 made their first contribution in #23855
- @rzeta-10 made their first contribution in #23250
- @stias made their first contribution in #24199
- @christopherbaer made their first contribution in #24191
- @Jayachander123 made their first contribution in #20181
- @BillionClaw made their first contribution in #23828
Full Changelog: v1.82.3.dev.2...v1.82.6-nightly