BerriAI/litellm v1.41.4

on GitHub

What's Changed

• fix(router.py): disable cooldowns by @krrishdholakia in #4497
• fix(slack_alerting.py): use in-memory cache for checking request status by @krrishdholakia in #4520
• feat(vertex_httpx.py): Support cachedContent. by @Manouchehri in #4492
• [Fix+Test] /audio/transcriptions - use initialized OpenAI / Azure OpenAI clients by @ishaan-jaff in #4519
• [Fix-Proxy] Background health checks use deep copy of model list for _run_background_health_check by @ishaan-jaff in #4518
• refactor(azure.py): move azure dall-e calls to httpx client by @krrishdholakia in #4523
• feat(dynamic_rate_limiter.py): support dynamic rate limiting on rpm by @krrishdholakia in #4502
• [Enterprise] Check if Key should run secret_detection callback by @ishaan-jaff in #4524
• [Feat] Control Lakera AI per Request by @ishaan-jaff in #4525

Full Changelog: v1.41.3...v1.41.4

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.41.4

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.41.4

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results