BerriAI/litellm v1.40.5

on GitHub

What's Changed

• Table format fix and Typo by @SujanShilakar in #4037
• feat: add langfuse metadata via proxy request headers by @ndrsfel in #3990
• Add Ollama as a provider in proxy ui by @sha-ahammed in #4020
• modified docs proxy->logging->langfuse by @syGOAT in #4035
• fix tool usage null content using vertexai by @themrzmaster in #4039
• Fixed openai token counter bug by @Raymond1415926 in #4036
• feat(router.py): enable settting 'order' for a deployment in model list by @krrishdholakia in #4046
• docs: add llmcord.py to projects by @jakobdylanc in #4060
• Fix log message in Custom Callbacks doc by @iwamot in #4061
• refactor: replace 'traceback.print_exc()' with logging library by @krrishdholakia in #4049
• feat(aws_secret_manager.py): Support AWS KMS for Master Key encrption by @krrishdholakia in #4054
• [Feat] Enterprise - Enforce Params in request to LiteLLM Proxy by @ishaan-jaff in #4043
• feat - OTEL set custom service names and custom tracer names by @ishaan-jaff in #4048

New Contributors

• @ndrsfel made their first contribution in #3990
• @sha-ahammed made their first contribution in #4020
• @syGOAT made their first contribution in #4035
• @Raymond1415926 made their first contribution in #4036
• @jakobdylanc made their first contribution in #4060
• @iwamot made their first contribution in #4061

Full Changelog: v1.40.4...v1.40.5

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.40.5

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results