What's Changed
- [Testing-Proxy] Add E2E Admin UI testing by @ishaan-jaff in #5845
- [UI Fix] List all teams on UI when user is Admin by @ishaan-jaff in #5851
- [Feat] SSO - add
providerin the OpenID field for custom sso by @ishaan-jaff in #5849 - [Feat-Proxy] add service accounts backend by @ishaan-jaff in #5852
- [Feat UI sso] store 'provider' in user metadata by @ishaan-jaff in #5856
- [Feat] Admin UI - Add Service Accounts by @ishaan-jaff in #5855
- [Docker-Security Fix] - handle debian issue on docker builds by @ishaan-jaff in #5752
Full Changelog: v1.47.2...v1.48.0
Docker Run LiteLLM Proxy
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.48.0
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 150.0 | 175.2223238286623 | 6.325709388512502 | 0.0 | 1891 | 0 | 120.55964699999322 | 5241.7233159999905 |
| Aggregated | Passed ✅ | 150.0 | 175.2223238286623 | 6.325709388512502 | 0.0 | 1891 | 0 | 120.55964699999322 | 5241.7233159999905 |