What's Changed
- ui - pass extra litellm params by @ishaan-jaff in #2900
Full Changelog: v1.34.34.dev1...v1.34.35
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 91 | 96.13553076973712 | 1.5233025728555512 | 0.0 | 456 | 0 | 86.62122199996247 | 482.4095380000131 |
| /health/liveliness | Passed ✅ | 76 | 79.2783738783157 | 15.236366304373178 | 0.0 | 4561 | 0 | 74.1453349999972 | 1484.2781819999686 |
| /health/readiness | Passed ✅ | 76 | 79.9449014786066 | 15.537018127963089 | 0.0 | 4651 | 0 | 74.1601340000102 | 1323.9347329999873 |
| Aggregated | Passed ✅ | 76 | 80.39410447527911 | 32.296687005191814 | 0.0 | 9668 | 0 | 74.1453349999972 | 1484.2781819999686 |