BerriAI/litellm v1.39.3

on GitHub

What's Changed

• fix: Log errors in Traceloop Integration (reverts previous revert) by @nirga in #3846
• Added support for Triton chat completion using trtlllm generate endpo… by @giritatavarty-8451 in #3895
• Revert "Added support for Triton chat completion using trtlllm generate endpo…" by @ishaan-jaff in #3900
• [Feat] Implement Logout Admin UI by @ishaan-jaff in #3901
• Revert "fix: Log errors in Traceloop Integration (reverts previous revert)" by @krrishdholakia in #3908
• feat(proxy_server.py): emit webhook event whenever customer spend is tracked by @krrishdholakia in #3906
• fix(openai.py): only allow 'user' as optional param if openai model by @krrishdholakia in #3902
• [Feat] UI update analytics tab to show human friendly usage vals by @ishaan-jaff in #3894
• ui - fix latency analytics on completion_tokens by @ishaan-jaff in #3897
• [Admin UI] Edit Internal Users by @ishaan-jaff in #3904
• fix(proxy_server.py): fix end user object check when master key used by @krrishdholakia in #3910
• [UI] Fix bug on Model analytics by @ishaan-jaff in #3913
• feat - langfuse use key_alias as generation name on litellm proxy by @ishaan-jaff in #3911
• fix pricing / price tracking for vertex_ai/claude-3-opus@20240229 by @ishaan-jaff in #3915

New Contributors

• @giritatavarty-8451 made their first contribution in #3895

Full Changelog: v1.39.2...v1.39.3

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.39.3

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results