What's Changed
- [Bug Fix]: ErrorEvent ValidationError when OpenAI Responses API returns nested error structure by @ishaan-jaff in #15804
- [Fix] Azure AI Speech - Ensure
voiceis mapped from request body -> SSML body , allow sendingroleandstyleby @ishaan-jaff in #15810 - Use proper bedrock model name in health check by @nuernber in #15808
- [Feat] Add DataforSEO Search API by @ishaan-jaff in #15817
- [Feat] Add Google PSE Search Provider by @ishaan-jaff in #15816
- [Feat] Add cost tracking for Search API requests - Google PSE, Tavily, Parallel AI, Exa AI by @ishaan-jaff in #15821
- (feat) Vector Stores: support Vertex AI Search API as vector store through LiteLLM by @krrishdholakia in #15781
- fix(responses-api): simplify reasoning item handling for gpt-5-codex by @AlexsanderHamir in #15815
- fix: replace deprecated gemini-1.5-pro-preview-0514 by @AlexsanderHamir in #15852
- [Bug Fix]: Hooks broken on /bedrock passthrough due to missing metadata by @ishaan-jaff in #15849
- [Bug Fix] Exa Search API - ensure request params are sent to Exa AI by @ishaan-jaff in #15855
- fix(vertex-ai): cost tracking for search spend by @mythral in #15859
- fix(ui/): fix routing for custom server root path by @krrishdholakia in #15701
- [fix] Pass user-defined headers and extra_headers to image-edit calls by @byrongrogan in #15811
- [Feat] - [Backend] Search APIs - Allow storing configured Search APIs in DB by @ishaan-jaff in #15862
- [Feat] UI - Search Tools, allow adding search tools on UI + testing search by @ishaan-jaff in #15871
- [Feat] UI - Add logos for search providers by @ishaan-jaff in #15872
- docs: add responses api on openai docs by @mubashirosmani in #15866
- docs: add OpenAI responses api by @mubashirosmani in #15868
- feat(proxy): support absolute RPM/TPM in priority_reservation by @AlexsanderHamir in #15813
- Add documentation for
enable_caching_on_provider_specific_optional_paramssetting by @Sameerlite in #15885 - Implement Bedrock Guardrail apply_guardrail endpoint support by @Sameerlite in #15892
- Lasso Security Guardrail: Add v3 API Support by @oroxenberg in #12452
- Litellm sameer oct staging by @Sameerlite in #15806
- fix: minimize the occurrence of deadlocks by @CAFxX in #15281
- Fix MLFlow tags - split request_tags into (key, val) if request_tag has colon by @reflection in #15914
- Add mistral medium 3 and Codestral 2 on vertex by @superpoussin22 in #15887
- fixed lasso import config, redis cluster hash tags for test keys by @shadielfares in #15917
- update vertex ai gemini costs by @otaviofbrito in #15911
- [Feat] New Guardrail - Dynamo AI Guardrail by @ishaan-jaff in #15920
- (feat) Organizations: allow org admins to create teams on UI + (feat) IBM Guardrails by @krrishdholakia in #15924
- fix(managed_files.py): don't raise error if managed object is not found + (Feat) Azure AI - Search Vector Stores + (Fix) Batches - “User default_user_id does not have access to the object” when object not in db + (fix) Vector Stores - show config.yaml vector stores on UI by @krrishdholakia in #15873
- Responses API - support tags in metadata by @krrishdholakia in #15867
- VertexAI Search Vector Store - Passthrough endpoint support + Vector store search Cost tracking support by @krrishdholakia in #15824
- Guardrails - Responses API, Image Gen, Text completions, Audio transcriptions, Audio Speech, Rerank, Anthropic Messages API support via the unified
apply_guardrailsfunction by @krrishdholakia in #15706 - Org level tpm/rpm limits + Team tpm/rpm validation when assigned to org by @krrishdholakia in #15549
- (security) Responses API - prevent User A from retrieving User B's response, if response.id is leaked by @krrishdholakia in #15757
- fix(opentelemetry.py): fix issue where headers were not being split correctly + feat(bedrock): add titan image generations w/ cost tracking by @krrishdholakia in #15916
New Contributors
- @mythral made their first contribution in #15859
- @mubashirosmani made their first contribution in #15866
- @CAFxX made their first contribution in #15281
- @reflection made their first contribution in #15914
- @shadielfares made their first contribution in #15917
Full Changelog: v1.78.7-nightly...v1.79.0-nightly