BerriAI/litellm v1.79.1-nightly on GitHub

What's Changed

1-79-0 docs by @ishaan-jaff in #15936
feat(lasso): Upgrade to Lasso API v3 and fix ULID generation by @oroxenberg in #15941
Enable OpenTelemetry context propagation by external tracers by @eycjur in #15940
Fix documentation for videos by @Sameerlite in #15937
Fix duplicate trace in langfuse_otel by @eycjur in #15931
[Feat] add support for dynamic client registration by @uc4w6c in #15921
Update IBM Guardrails to correctly use SSL Verify argument by @RobGeada in #15975
feat: support during_call for model armor guardrails by @bjornjee in #15970
docs(openrouter): add base_url config with environment variables by @shanto12 in #15946
[Buf fix] - Azure OpenAI, fix ContextWindowExceededError is not mapped from Azure openai errors by @ishaan-jaff in #15981
[Fix] DD logging - ensure key's metadata + guardrail is logged on DD by @ishaan-jaff in #15980
[Feat] OTEL - Ensure error information is logged on OTEL by @ishaan-jaff in #15978
[Fix] Minor fix proxy - ensure User API key and team id and user id missing from custom callback is not misfiring by @ishaan-jaff in #15982
[Fix] Azure OpenAI - Add handling for v1 under azure api versions by @ishaan-jaff in #15984
Fix: Respect LiteLLM-Disable-Message-Redaction header for Responses API by @Sameerlite in #15966
[Feat] UI - Changed API Base from Select to Input in New LLM Credentials by @yuneng-jiang in #15987
[Bug Fix] Remove limit from admin UI numerical input fix by @yuneng-jiang in #15991
[Feature] UI - Key Already Exist Error Notification by @yuneng-jiang in #15993
[Fix] - Responses API - add /openai routes for responses API. (Azure OpenAI SDK Compatibility) by @ishaan-jaff in #15988
Add deprecation dates for models by @dima-hx430 in #15976
docs(guardrails/ibm_guardrails): add additional detail to ibm_guardrails.md by @m-misiura in #15971
Perf speed up pytest by @uc4w6c in #15951
fix: Preserve Bedrock inference profile IDs in health checks by @ylgibby in #15947
Fix: Support tool usage messages with Langfuse OTEL integration by @eycjur in #15932
Add Haiku 4.5 pricing for open router by @Somtom in #15909
fix(opik): enhance requester metadata retrieval from API key auth by @Thomas-Mildner in #15897
[feat]: graceful degradation for pillar service when using litellm by @afogel in #15857
Add GitlabPromptCache and enable subfolder access by @deepanshululla in #15712
Add OpenAI client usage documentation for videos and fix navigation visibility by @Sameerlite in #15996
[Feature] Config Models should not be editable by @yuneng-jiang in #16020
[Fix] Guardrails - Ensure Key Guardrails are applied by @ishaan-jaff in #16025
[UI] Feature - Add Apply Guardrail Testing Playground by @ishaan-jaff in #16030
[Fix] SQS Logger - Add Base64 handling by @ishaan-jaff in #16028
Fix mutation of original request for gemini request by @Sameerlite in #16002
Fix: Redact reasoning summaries in ResponsesAPI output when message logging is disabled by @Sameerlite in #15965
fix: Support text.format parameter in Responses API for providers without native ResponsesAPIConfig by @rodolfo-nobrega in #16023
Remove unnecessary model variable assignment by @Mte90 in #16008
Add license metadata to health/readiness endpoint. by @bernata in #15997
chore(deps): bump hono from 4.9.7 to 4.10.3 in /litellm-js/spend-logs by @dependabot[bot] in #15915
docs: improve Grayswan guardrail documentation by @TeddyAmkie in #15875
fix(apscheduler): prevent memory leaks from jitter and frequent job intervals by @jatorre in #15846
Python entry-point for CustomLLM subclasses by @AlbertDeFusco in #15881
Allow using ARNs when generation images via Bedrock by @komarovd95 in #15789
Added fallback logic for detecting file content-type when S3 returns generic by @langpingxue in #15635
fix: prevent httpx DeprecationWarning memory leak in AsyncHTTPHandler by @AlexsanderHamir in #16024
[Feat] Add FAL AI Image Generations on LiteLLM by @ishaan-jaff in #16067
Feat: Mistral API - add codestral-embed-2505 by @ishaan-jaff in #16071
Fix spend tracking for OCR/aOCR requests (log pages_processed + recognize OCRResponse) by @OrionCodeDev in #16070
[Feat] Add support for Batch API Rate limiting - PR1 adds support for input based rate limits by @ishaan-jaff in #16075
[Feature] UI - Validation for Proxy Base URL in SSO Settings by @yuneng-jiang in #16082
[Feature] UI - Test Key UI Embeddings by @yuneng-jiang in #16065
[Feature] UI - Add Key Type Select in Key Settings by @yuneng-jiang in #16034
feat(guardrails): Add per-request profile overrides to PANW Prisma AIRS by @jroberts2600 in #16069
docs: use custom-llm-provider header in examples by @tlecomte in #16055
Improve(mcp): respect X-Forwarded- headers in OAuth endpoints by @talalryz in #16036
Add OpenAI-compatible annotations support for Cohere v2 citations by @Sameerlite in #16038
Opik user auth key metadata Documentation by @Thomas-Mildner in #16004
[Fix] Circle CI UI E2E Test Fix by @yuneng-jiang in #16100
Fix: Moderations endpoint now respects api_base configuration parameter by @Sameerlite in #16087
[Infra] Litellm Backend SSO Changes by @yuneng-jiang in #16029
Litellm docs readme fixes by @ishaan-jaff in #16107
[Docs] readme fixes add supported providers by @ishaan-jaff in #16109
Add gemini/gemini-embedding-001 pricing entry for Google GenAI API by @sbinnee in #16078
Add supports vision field, to qwen-vl models, in model_prices_and_context_window.json by @JetoPistola in #16106
feat: handle Deepgram detected language when available by @gvioss in #16093
Fix vercel_ai_gateway entry for glm-4.6 by @pale-aura in #16084
Add OCI Signer Authentication. Closes #16048, Closes #15654 by @gotsysdba in #16064
Changes to fix frequency_penalty and presence_penalty issue for gemini-2.5-pro model by @tanvithakur94 in #16041
Add Add per model group header forwarding for Bedrock Invoke API by @Sameerlite in #16042
fix: Handle multiple rate limit types per descriptor and prevent IndexError by @orolega in #16039
prompt_caching.md: Fix wrong prompt_tokens definition by @li-boxuan in #16044
Add Xai websearch cost by @Sameerlite in #16001
Don't add "accounts/fireworks/models" prefix for Fireworks Provider by @1stprinciple in #15938
fix: make debug log debug by @raghav-stripe in #16137
[Feat] UI + Management - Allow setting all routing strategies, tag filtering on UI by @ishaan-jaff in #16139
[Feature] UI - Add tags in model creation by @yuneng-jiang in #16138
[Feature] UI - Add Tags to update model by @yuneng-jiang in #16140
[Feature] UI - Config Guardrails should not be editable and guardrail info fix by @yuneng-jiang in #16142
[Feat] UI - Allow setting cache settings on UI by @ishaan-jaff in #16143
build(deps): bump starlette from 0.47.2 to 0.49.1 by @dependabot[bot] in #16027
requirements update by @RoniGurvichCycode in #16054
[Infra] Building UI by @yuneng-jiang in #16158

New Contributors

@RobGeada made their first contribution in #15975
@shanto12 made their first contribution in #15946
@dima-hx430 made their first contribution in #15976
@m-misiura made their first contribution in #15971
@ylgibby made their first contribution in #15947
@Somtom made their first contribution in #15909
@rodolfo-nobrega made their first contribution in #16023
@bernata made their first contribution in #15997
@AlbertDeFusco made their first contribution in #15881
@komarovd95 made their first contribution in #15789
@langpingxue made their first contribution in #15635
@OrionCodeDev made their first contribution in #16070
@sbinnee made their first contribution in #16078
@JetoPistola made their first contribution in #16106
@gvioss made their first contribution in #16093
@pale-aura made their first contribution in #16084
@tanvithakur94 made their first contribution in #16041
@li-boxuan made their first contribution in #16044
@1stprinciple made their first contribution in #15938
@raghav-stripe made their first contribution in #16137

Full Changelog: v1.79.0-nightly...v1.79.1-nightly