What's Changed
- (UI) Fixes for managing Internal Users by @ishaan-jaff in #8786
- Litellm contributor prs 02 24 2025 by @krrishdholakia in #8781
- (UI) Allow adding MSFT SSO on UI by @ishaan-jaff in #8779
- (UI) Minor fix, clear new team form after adding a new team by @ishaan-jaff in #8776
- [ui] Icons on navbar profile dropdown by @Mte90 in #8792
- fix(UI): model name overflow in model hub cards by @Aditya-A-G in #8749
- fix vertex_ai claude 3.7 naming by @emerzon in #8807
- (Router) - If
allowed_fails
orallowed_fail_policy
set, use that for single deployment cooldown logic by @ishaan-jaff in #8668 - (Bug fix) - reading /parsing request body when on hypercorn by @ishaan-jaff in #8734
- (Bug fix) - running litellm proxy on wndows by @ishaan-jaff in #8735
- Anthropic model cost map updates by @krrishdholakia in #8816
- Adding Azure Phi-4 by @emerzon in #8808
- (Bug Fix) Using LiteLLM Python SDK with model=
litellm_proxy/
for embedding, image_generation, transcription, speech, rerank by @ishaan-jaff in #8815 - (Bug fix) - allow using Assistants GET, DELETE on
/openai
pass through routes by @ishaan-jaff in #8818 - (Bug fix) dd-trace used by default on litellm proxy by @ishaan-jaff in #8817
- Adding openrouter claude-3.7-sonnet by @fengjiajie in #8826
- (UI) - Create Key flow for existing users by @ishaan-jaff in #8844
New Contributors
- @Mte90 made their first contribution in #8792
- @Aditya-A-G made their first contribution in #8749
Full Changelog: v1.61.16-nightly...v1.61.17-nightly
Docker Run LiteLLM Proxy
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.61.17-nightly
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
---|---|---|---|---|---|---|---|---|---|
/chat/completions | Failed ❌ | 150.0 | 173.78373966719144 | 6.358949904314281 | 6.358949904314281 | 1902 | 1902 | 125.8689129999766 | 3022.732839000014 |
Aggregated | Failed ❌ | 150.0 | 173.78373966719144 | 6.358949904314281 | 6.358949904314281 | 1902 | 1902 | 125.8689129999766 | 3022.732839000014 |