BerriAI/litellm v1.41.2

on GitHub

What's Changed

• [Feat] /spend/report by API Key by @ishaan-jaff in #4471
• fix(utils.py): new supports_response_schema() function to check if provider/model supports the param by @krrishdholakia in #4476
• [Feature] Support aws_session_token for bedrock client. [https://github.com//issues/4346] by @bschulth in #4371
• [Fix] - Error str in OpenAI, Azure exception by @ishaan-jaff in #4477
• [Fix] DALL-E connection error bug on litellm proxy by @ishaan-jaff in #4480
• [Fix] Proxy ErrorLogs store raw exception in error log by @ishaan-jaff in #4474
• fix(langfuse.py): use clean metadata instead of deepcopy by @krrishdholakia in #4413
• [Fix] Admin UI - fix error users we're seeing when logging in (use correct user_id when creating key for admin ui) by @ishaan-jaff in #4479
• feat(vertex_httpx.py): support the 'response_schema' param for older vertex ai models by @krrishdholakia in #4478
• Vertex anthropic json mode by @krrishdholakia in #4482

New Contributors

• @bschulth made their first contribution in #4371

Full Changelog: v1.41.1...v1.41.2

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.41.2

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results