BerriAI/litellm v1.77.7.dev-gemma

on GitHub

What's Changed

• Fix litellm_param based costing by @Sameerlite in #15336
• Fix parallel tool calls in the Anthropic passthrough adapter by @lcfyi in #15315
• fix: redact AWS credentials when redact_user_api_key_info enabled by @timelfrink in #15321
• Add new Azure AI models with pricing details by @emerzon in #15387
• [Feat] Add EnkryptAI Guardrails on LiteLLM by @ishaan-jaff in #15390
• [Fix] Fix dynamic Rate limiter v3 - inserting litellm_model_saturation by @ishaan-jaff in #15394
• [Fix] - Sessions not being shared by @AlexsanderHamir in #15388
• fix: Prevents DB from accidentally overriding config file values if they are empty in DB by @ARajan1084 in #15340
• Temporarily relax ResponsesAPIResponse parsing to support custom backends (e.g., vLLM) by @ashengstd in #15362
• Fix - OpenRouter cache_control to only apply to last content block by @ishaan-jaff in #15395
• [Fix]: remove panic from hot path by @AlexsanderHamir in #15396

New Contributors

• @lcfyi made their first contribution in #15315
• @ashengstd made their first contribution in #15362

Full Changelog: v1.77.7.dev9...v1.77.7.dev-gemma

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.77.7.dev-gemma

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.77.7.dev-gemma

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results