What's Changed
- [UI] View Number of Keys, Members in a team by @ishaan-jaff in #3300
- fix Llama models messages to prompt conversion for AWS Bedrock by @aswny in #3298
- [UI] Show Tooltip when editing models by @ishaan-jaff in #3296
- [UI] fix end users tab by @ishaan-jaff in #3306
- [Backend-Alerting] Separate alerting for different channels by @ishaan-jaff in #3307
- [FEAT - UI + Backend] Proxy - set unique webhooks per alert by @ishaan-jaff in #3309
- (requirements.txt) - Update gunicorn to 22.0.0 for CVE-2024-1135 by @Manouchehri in #3265
- build(deps): bump hono from 4.1.5 to 4.2.7 in /litellm-js/spend-logs by @dependabot in #3239
New Contributors
Full Changelog: 1.35.26.dev3...v1.35.28
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 83 | 90.47377557849362 | 1.553283816541804 | 0.0 | 465 | 0 | 76.9804239999985 | 1407.7624669999977 |
| /health/liveliness | Passed ✅ | 66 | 68.11714478811162 | 15.22886219271846 | 0.0 | 4559 | 0 | 63.024813999959406 | 764.0456139999969 |
| /health/readiness | Passed ✅ | 66 | 69.1427847725483 | 15.258925750457978 | 0.0 | 4568 | 0 | 63.323490000016136 | 1336.527273999991 |
| Aggregated | Passed ✅ | 66 | 69.68938798728121 | 32.04107175971824 | 0.0 | 9592 | 0 | 63.024813999959406 | 1407.7624669999977 |