What's Changed
- merge main by @Sameerlite in #17408
- Guardrail API - support tool call checks on OpenAI
/chat/completions, OpenAI/responses, Anthropic/v1/messagesby @krrishdholakia in #17459 - docs: document responses and embedding api for github copilot by @codgician in #17456
- fix(openai): add clear error message for empty LLM endpoint responses by @DevajMody in #17445
- Fix: Skip empty text blocks in Anthropic system messages by @HaiyiMei in #17442
- feat: Basic Weave OTEL integration by @andrewtruong in #17439
- fix(ocr): add missing ocr and aocr to CallTypes enum by @Chesars in #17435
- fix(groq): check supports_response_schema before using json_tool_call workaround by @Chesars in #17438
- fix(pricing): add missing Moonshot turbo models and fix incorrect pricing by @Chesars in #17432
- fix: make bedrock converse messages respect modify_params as expected by @danielmklein in #17427
- Update docs to link agent hub by @krrishdholakia in #17462
- [Feature] Add Auto Redirect to SSO to New Login Page by @yuneng-jiang in #17451
- [Infra] UI - Change Credentials to use React Query by @yuneng-jiang in #17465
- Map output_tokens_details of responses API to completion_tokens_details by @Sameerlite in #17458
- Add support for bedrock qwen 2 imported model by @Sameerlite in #17461
- Add support for file content download for bedrock batches by @Sameerlite in #17470
- fix: test_default_api_base for ragfow by @Sameerlite in #17485
- feat - new model amazon.titan-image-generator-v2:0 by @ishaan-jaff in #17488
- Fix aim guardrail tests by @hxyannay in #17499
- fix: resolve ruff lint errors by @AnasAbdelR in #17490
- 🆕 feat: support routing to only websearch supported deployments by @raghav-stripe in #17500
- [Management endpoints] - Allow admin viewer to access global tag usage by @ishaan-jaff in #17501
- [Feat] Agent Access Control - Enforce Allowed agents by key, team + add agent access groups on backend by @ishaan-jaff in #17502
- [Feat] UI - Agent Gateway - set allowed agents by key, team by @ishaan-jaff in #17511
- [Docs] A2a - Permission management by @ishaan-jaff in #17515
- [Feat] Allow adding OpenAI compatible chat providers using .json + add public ai provider by @ishaan-jaff in #17448
- chore: add stack trace to mcp error message by @uc4w6c in #17269
- (fix): empty response + vllm streaming by @dominicfeliton in #17516
- fix(guardrails): mask all matching keywords in content filter by @DevajMody in #17521
- Enable detailed debugging for reference by @krrishdholakia in #17508
- fix(sql): Optimize SpendLogs queries to use timestamp filtering for index usage by @kristianmitk in #17504
- fix(gemini): handle partial JSON chunks after first valid chunk by @Chesars in #17496
- fix(unified_guardrail.py): support during_call event type for unified guardrails by @krrishdholakia in #17514
- Guardrails API - new
structured_messagesparam by @krrishdholakia in #17518 - [Feat] VertexAI - Add BGE Embeddings support by @Sameerlite in #17362
- [Fix] Select in Edit Membership Modal by @yuneng-jiang in #17524
- fix: code quality issues from ruff linter by @AlexsanderHamir in #17536
- Fix: Presidio guardrail test TypeError and license base64 decoding error by @AlexsanderHamir in #17538
- [fix] parse budget:thinking blocks for opus 4.5 by @colinlin-stripe in #17534
- Fix vector store configuration synchronization failure by @Sameerlite in #17525
- Add support for cursor BYOK with its own configuration by @Sameerlite in #17519
- Add background health checks to db by @Sameerlite in #17528
- Fix: Lack of None value checks & update publicai_chat_transformation tests by @AlexsanderHamir in #17539
- Remove hardcoded api key from test file by @krrishdholakia in #17540
- Make sure that media resolution is only for gemini 3 model by @Sameerlite in #17137
- [Bug fix] WatsonX audio transcriptions, don't force content type in request headers by @ishaan-jaff in #17546
- [Infra] Bump LiteLLM Enterprise Version by @yuneng-jiang in #17549
- Fix budget update to allow null max_budget by @ishaan-jaff in #17545
- fix failing vertex tests by @Sameerlite in #17542
- [Feature] Show all callbacks on UI by @yuneng-jiang in #16335
New Contributors
- @DevajMody made their first contribution in #17445
- @andrewtruong made their first contribution in #17439
- @AnasAbdelR made their first contribution in #17490
- @dominicfeliton made their first contribution in #17516
- @kristianmitk made their first contribution in #17504
Full Changelog: v1.80.7.dev.3...v1.80.7.dev.4