What's Changed
- fix - stop using imghdr by @ishaan-jaff in #2956
- Litellm UI add fallback-login by @ishaan-jaff in #2958
- fix - issue when loading models through ui by @ishaan-jaff in #2959
Full Changelog: v1.35.1...v1.35.1.dev1
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 82 | 86.6558457665302 | 1.6164814475091074 | 0.0 | 484 | 0 | 76.2494670000251 | 542.1880830000134 |
| /health/liveliness | Passed ✅ | 66 | 70.34536579173033 | 15.346554238232125 | 0.0 | 4595 | 0 | 63.30649199998106 | 1351.602527999944 |
| /health/readiness | Passed ✅ | 66 | 69.74445617801939 | 15.346554238232125 | 0.0 | 4595 | 0 | 63.31506999998737 | 1339.7237620000055 |
| Aggregated | Passed ✅ | 66 | 70.8759728449454 | 32.309589923973355 | 0.0 | 9674 | 0 | 63.30649199998106 | 1351.602527999944 |