BerriAI/litellm v1.42.2

on GitHub

🔥 LiteLLM now supports using with Anthropic Python SDK and Mistral AI Python SDK with LiteLLM Proxy 👉 View reference here:

🐛 Fix logfire - don't load_dotenv()

📚 Docs Proxy - add example usage with mistral SDK with Proxy

📚 Docs add example using anthropic sdk with litellm proxy

✨ [Feat] Support proxying all models from providers without adding them to config.yaml

[Feat] - Add mistral/mistral-large 2

🔧 [Fix] OpenAI STT, TTS Health Checks on LiteLLM Proxy

📚 Docs - add info about routing strategy on load balancing docs

What's Changed

• [Feat] - Add mistral/mistral-large 2 by @ishaan-jaff in #4873
• [Fix] OpenAI STT, TTS Health Checks on LiteLLM Proxy by @ishaan-jaff in #4889
• docs - add info about routing strategy on load balancing docs by @ishaan-jaff in #4890
• feat(custom_llm.py): Support Custom LLM Handlers by @krrishdholakia in #4887
• Add Single-Token predictions support for Replicate by @fracapuano in #4879
• Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock by @Manouchehri in #4884
• Add Llama 3.1 405b & Tool Calling for Amazon Bedrock by @Manouchehri in #4883
• feat(auth_check.py): support using redis cache for team objects by @krrishdholakia in #4870
• fix logfire - don't load_dotenv by @ishaan-jaff in #4894
• Docs Proxy - add example usage with mistral SDK with Proxy by @ishaan-jaff in #4896
• Docs add example using anthropic sdk with litellm proxy by @ishaan-jaff in #4897
• [Feat] Support /* for multiple providers by @ishaan-jaff in #4891

New Contributors

• @fracapuano made their first contribution in #4879

Full Changelog: v1.42.1...v1.42.2

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.42.2

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results