BerriAI/litellm v1.74.3-stable-draft on GitHub

What's Changed

Sticky session for Test Key page by @NANDINI-star in #12365
Truncate long labels and improve tooltip in Top API Keys chart by @NANDINI-star in #12371
[Bug Fix] s3 config.yaml file - ensure yaml safe load is used by @ishaan-jaff in #12373
[Feat] Bump langfuse python SDK version and LANGFUSE_TRACING_ENVIRONMENT by @ishaan-jaff in #12376
[Security] Bump mcp version on docker img by @ishaan-jaff in #12362
fix: make TextCompletionStreamWrapper conversion retain reasoning_content by @aholmberg in #12377
Bump mcp from 1.9.3 to 1.10.0 by @dependabot[bot] in #12388
[Feat] Add MCP Cost Tracking by @ishaan-jaff in #12385
feat: add image support for Responses API when falling back on Chat Completions by @ryan-castner in #12204
Add 'thinking blocks' to stream chunk builder + remove experimental 'by_tag' metrics on prometheus (fix cardinality issue) by @krrishdholakia in #12395
Add audit logs on model update by @krrishdholakia in #12396
Improve Chart Readability for Tags by @NANDINI-star in #12378
Fix API base url for Github Copilot provider by @kanaka in #12418
fix(proxy/mcp): Error handling MCP request: Task group is not initialized by @juancarlosm in #12411
style: update sambanova logos by @jhpiedrahitao in #12431
[Bug fix] MCP MCP_TOOL_PREFIX_SEPARATOR to work with claude code by @jugaldb in #12430
Prevent navigation reset after team member operations by @NANDINI-star in #12424
Fix guardrails_ai.md documentation page by @DmitriyAlergant in #12356
[Bug fix] Multiple API Keys Created on Startup When max_budget is Enabled by @ishaan-jaff in #12436
[Feat] Add XInference Image Generation API Provider by @ishaan-jaff in #12439
[Feat] Bedrock Guardrails - Raise Bedrock output text on 'BLOCKED' actions from guardrail by @ishaan-jaff in #12435
MCP - usage tracking by @krrishdholakia in #12397
fix(utils.py): rollback faulty security check on files by @krrishdholakia in #12441
Fix: Properly close aiohttp client sessions to prevent resource leaks by @colesmcintosh in #12251
Remove temporary test files by @colesmcintosh in #12442
(Router) don't add invalid deployment to router pattern match by @krrishdholakia in #12459
[Feat] MCP Gateway - Allow customizing what client side header to use by @ishaan-jaff in #12460
[Bug Fix] Ensure supported bedrock/converse/ params = bedrock/ params by @ishaan-jaff in #12466
Litellm mcp internal users by @jugaldb in #12458
[Feat] SSO - Allow users to run a custom sso login handler by @ishaan-jaff in #12465
[Bug Fix] DataDogLLMObsLogger push total_cost by @ishaan-jaff in #12467
[MCP Gateway] - Allow using custom post call MCP hook for cost tracking by @ishaan-jaff in #12469
DB Spend Update Writer: fix query + Allow anthropic-beta header when forward_client_headers_to_llm_api is true by @krrishdholakia in #12462
OTEL - OTEL_RESOURCE_ATTRIBUTES support + Model Hub - new model hub table view, new /public/model_hub endpoint, fix duplicates in /model_group/info by @krrishdholakia in #12468
Resolve model group alias on Auth + /v1/messages Fallback support by @krrishdholakia in #12440
add grok-4 configs to table by @fcakyon in #12476
fix slack alerts by @jugaldb in #12464
Add devstral-small-2507 and devstral-medium-2507 models by @xingyaoww in #12484
[Bug Fix] fix parsing environment_variables from config.yaml (arize logger integration fix) by @ishaan-jaff in #12482
[Chore] Don't emit warning for Max in memory queue flush count by @ishaan-jaff in #12489
Add Azure OpenAI o3-deep-research model pricing support by @neubig in #12493
Feat(bedrock): support api key authentication for AWS Bedrock API by @ishaan-jaff in #12495
Added validate payload error by @jugaldb in #12494
[MCP Gateway] - Add custom cost configuration for each MCP tool by @ishaan-jaff in #12499
[Feat] Add support for editing MCP cost per tool by @ishaan-jaff in #12501
[docs]: Fix typo and import required types for proxy call hooks by @Rayshard in #12487
fix: handle reasoning parameters and response in responses bridge by @aholmberg in #12433
Added dashscope (alibaba's cloud - qwen) as a provider by @minghao51 in #12361
feat: improve user dropdown UI with premium badge and cleaner layout by @colesmcintosh in #12502
fix bedrock cost calculation for cached tokens by @jdietzsch91 in #12488
Fix tool call handling in Anthropic pass-through adapter by @iwinux in #12473
Guardrails AI - pre-call + logging only guardrail (pii detection/competitor names) support by @krrishdholakia in #12506
Litellm mcp access group on UI by @jugaldb in #12470
[Enterprise] Support tag based mode for guardrails by @krrishdholakia in #12508
Litellm mcp access group by @jugaldb in #12514
Add Build and push litellm-non_root to docker-hub-deploy CICD workflow by @andresC98 in #12413
Validation to mcp server name by @jugaldb in #12515
[Feat] - New guardrail - OpenAI Moderations API by @ishaan-jaff in #12519
[MCP Gateway] QA - MCP Tool Testing Playground by @ishaan-jaff in #12520
[Security Fix] - Dont show pure JWT in "Logs" page on UI by @ishaan-jaff in #12524
[Bug Fix] - QA for MCP Gateway - show the cost config on the root of MCP Settings by @ishaan-jaff in #12526
[MCP Gateway] access group UI object permission fix by @jugaldb in #12523
[MCP Gateway] UI Quality check fixes by @jugaldb in #12521
[MCP Gateway] Allow using stdio MCPs with LiteLLM by @ishaan-jaff in #12530
docs: Update github.md by @EmaSuriano in #12509
🐛 Remove deprecated pydantic class Config by @strawgate in #12528
Team Members - reset budget, if duration set + Prometheus - support tag based metrics by @krrishdholakia in #12534
Consistent layout for Create and Back buttons on all the pages by @NANDINI-star in #12542
Fix e2e test by @NANDINI-star in #12544
Align Show Password with Checkbox by @NANDINI-star in #12538
chore: Update Vertex AI Model Garden LiteLLM integration tutorial by @lizzij in #12428
[Bug Fix] xai/ translation fix - ensure finish_reason includes tool calls when xai responses with tool calls by @ishaan-jaff in #12545
Prevent writing default user setting updates to yaml (error in non-root env) + Use central team member budget when max_budget_in_team set on UI by @krrishdholakia in #12533
[MCP Gateway] Allow mcp access groups on test key and tool calls by @jugaldb in #12529
[MCP Gateway] UI headers groups example on connect tab by @jugaldb in #12550
Fix e2e test by @NANDINI-star in #12549
Integration: Bytez as a model provider by @inf3rnus in #12121
[CI/CD fix] test_redis_caching_multiple_namespaces by @ishaan-jaff in #12552
[MCP Gateway] access group fixes on UI for keys and teams by @jugaldb in #12556
UI - Model Hub Page - minor fixes + improvements (+ Make Model Hub OSS 🚀) by @krrishdholakia in #12553
UI - Model Hub - refactor 'Make Public' to have a select + confirm form by @krrishdholakia in #12555

New Contributors

@kanaka made their first contribution in #12418
@juancarlosm made their first contribution in #12411
@DmitriyAlergant made their first contribution in #12356
@Rayshard made their first contribution in #12487
@minghao51 made their first contribution in #12361
@jdietzsch91 made their first contribution in #12488
@iwinux made their first contribution in #12473
@andresC98 made their first contribution in #12413
@EmaSuriano made their first contribution in #12509
@strawgate made their first contribution in #12528
@inf3rnus made their first contribution in #12121

Full Changelog: v1.74.0-stable...v1.74.3-stable-draft