What's Changed
- add azure gpt-5.2 models by @marty-sullivan in #17866
- fix: add semver prerelease suffix to helm chart versions by @Chesars in #17678
- fix: add speechConfig to GenerationConfig for Gemini TTS by @nlineback in #17851
- fix(prometheus): add 'exception_status' to prometheus logger by @vingiarrusso in #17847
- fix(cache): handle string content in is_cached_message by @peterkc in #17853
- [feat]: Add opt-in evidence results for Pillar Security guardrail during monitoring by @afogel in #17812
- fix(embeddings): fix handling token array input decoding for embeddings by @butnarurazvan in #17468
- fix(router): add minimum request threshold for error rate cooldown by @DevajMody in #17464
- Fix milvus client docs by @krrishdholakia in #17736
- enhance: create_litellm_branch tool to be more robust by @AlexsanderHamir in #17874
- Add health endpoint tests to CI with database and Redis support by @AlexsanderHamir in #17877
- [Fix]: use docker executor by @AlexsanderHamir in #17878
- revert CI changes by @AlexsanderHamir in #17879
- fix: remove dependency on database and redis from health test by @AlexsanderHamir in #17880
- refactor(router): replace time.perf_counter() with time.time() by @AlexsanderHamir in #17881
- Add support for expires after param in Files endpoint by @Sameerlite in #17860
- Fix x-litellm-key-spend header update by @Sameerlite in #17864
- fix: bedrock header forwarding with cutom api by @Sameerlite in #17872
- Add support for forwarding client headers in /rerank endpoint by @Sameerlite in #17873
- Add v0 support for target storage by @Sameerlite in #17758
- Add documentation for target storage by @Sameerlite in #17882
- [Feature] New Badge for Agent Usage by @yuneng-jiang in #17883
- [Feat] JWT Auth - auth allow selecting team_id from request header by @ishaan-jaff in #17884
- feat(otel): Add latency metrics (TTFT, TPOT, Total Generation Time) to OTEL payload by @AlexsanderHamir in #17888
- Add benchmark_proxy_vs_provider.py script by @AlexsanderHamir in #17889
- [Feat] UI - show UI version on top left near logo by @ishaan-jaff in #17891
- feat(openai): add reasoning_effort='xhigh' support for gpt-5.2 models by @Chesars in #17875
- [fix] UI playground - allow custom model name as option[0] by @ishaan-jaff in #17892
- feat: add support for using MCPs on /chat/completions by @uc4w6c in #17747
- [UI] - Re organize leftnav to have correct categories + get agents on root by @ishaan-jaff in #17890
- [Feature] Usage Entity labels by @yuneng-jiang in #17896
- feat(bedrock): add EU Claude Opus 4.5 model by @Chesars in #17897
- [Fix] Add All Proxy Models To Default User Settings by @yuneng-jiang in #17902
- [Fix] UI - Agent Usage Page Minor Issues by @yuneng-jiang in #17901
- Litellm fix mcp tool name prefix by @uc4w6c in #17908
- [A2a gateway] Add agent cost tracking on UI by @ishaan-jaff in #17899
- [Feat] A2A Gateway - allow adding Azure Foundry Agents on UI by @ishaan-jaff in #17909
- [Infra] bumping docusaurus/theme-mermaid to 3.9.0 by @yuneng-jiang in #17907
- Litellm docs a2a cost tracking by @ishaan-jaff in #17913
- [Fix] CI/CD - mypy & check_code_and_doc_quality & mcp_testing by @AlexsanderHamir in #17920
- [Infra] UI build by @yuneng-jiang in #17922
- [Fix] CI/CD - Fix failing proxy unit test and langfuse trace_id test by @AlexsanderHamir in #17924
- [Fix] CI/CD - Fix failing proxy and core integration tests by @AlexsanderHamir in #17926
- [Fix] CI/CD - Fix JWT authentication tests failing with KeyError: 'headers' by @AlexsanderHamir in #17927
- [Fix] UI - Request and Response in Logs by @yuneng-jiang in #17928
- Regex guardrails update by @yoshi-p27 in #17915
- [Docs] v1.80.10 draft by @yuneng-jiang in #17929
- [Fix] CI/CD - Fix Bedrock tool calling test failures with non-serializable objects and internal parameters by @AlexsanderHamir in #17930
- [Docs] Agent Usage Doc by @yuneng-jiang in #17931
- [QA] Cursor Integration x LiteLLM by @ishaan-jaff in #17855
- [Docs] Agent Usage doc fix by @yuneng-jiang in #17932
- [Docs] Merge Agent Usage with A2A Cost Tracking by @yuneng-jiang in #17934
- [Docs] Fixing links by @yuneng-jiang in #17935
- fix: add storage_backend and storage_url columns to schema.prisma files by @AlexsanderHamir in #17936
- [Docs] Add Import Image to A2A Docs by @yuneng-jiang in #17937
- fix: add agent_id field to GCS PubSub spend_logs_payload.json test expectation by @AlexsanderHamir in #17938
- [Docs] Cursor Integration by @ishaan-jaff in #17939
- [Fix] Filter internal params in fallback code by @AlexsanderHamir in #17941
- [Fix] Add extra_headers and allowed_tools to UpdateMCPServerRequest by @yuneng-jiang in #17940
- [Feature] Show progress and pause on hover for Notifications by @yuneng-jiang in #17942
- [Fixes] A2a Gateway - ensure azure foundry agents work by @ishaan-jaff in #17943
- Litellm 1 80 10 by @ishaan-jaff in #17945
New Contributors
- @nlineback made their first contribution in #17851
- @butnarurazvan made their first contribution in #17468
- @yoshi-p27 made their first contribution in #17915
Full Changelog: v1.80.9.dev6...v1.80.10-nightly