BerriAI/litellm v1.73.7.dev1

on GitHub

What's Changed

• Update management_cli.md by @wildcard in #12157
• fix: support Cursor IDE tool_choice format {"type": "auto"} by @colesmcintosh in #12168
• [Feat] Add new AWS SQS Logging Integration by @ishaan-jaff in #12176
• [Bug Fix] Allow passing litellm_params when using generateContent API endpoint by @ishaan-jaff in #12177
• Use the -d flag in docs instead of -D by @szafranek in #12179
• [Bug Fix] Using /messages with lowest latency routing by @ishaan-jaff in #12180
• [Bug Fix] Fix Error code: 307 for LlamaAPI Streaming Chat by @seyeong-han in #11946
• Fix client function to support anthropic_messages call type and implement max tokens check by @dinggh in #12162
• Fix - handle empty config.yaml + Fix gemini /models - replace models/ as expected, instead of using 'strip' by @krrishdholakia in #12189
• VertexAI Anthropic - streaming cost tracking w/ prompt caching fixes by @krrishdholakia in #12188
• Fix: correct user_id validation logic in Anthropic… by @raz-alon in #11432
• Fix allow strings in calculate cost by @tofarr in #12200
• Fix: Flaky test_keys_delete_error_handling test by @colesmcintosh in #12209
• added changes to mcp url wrapping by @jugaldb in #12207

New Contributors

• @wildcard made their first contribution in #12157
• @szafranek made their first contribution in #12179
• @dinggh made their first contribution in #12162
• @tofarr made their first contribution in #12200

Full Changelog: v1.73.6.rc.1...v1.73.7.dev1

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.73.7.dev1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results