What's Changed
- feat(proxy/utils.py): return api base for request hanging alerts by @krrishdholakia in #2880
Full Changelog: 1.34.2...v1.34.33
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 93 | 96.96510066880384 | 1.5634829556893368 | 0.0 | 468 | 0 | 86.43016700000317 | 463.10457399999905 |
| /health/liveliness | Passed ✅ | 77 | 80.00998962632444 | 15.457768452937097 | 0.0 | 4627 | 0 | 73.85146199999326 | 1299.2101319999847 |
| /health/readiness | Passed ✅ | 77 | 80.26552238425697 | 15.066897714014763 | 0.0 | 4510 | 0 | 73.70257700000593 | 1044.845262000024 |
| Aggregated | Passed ✅ | 77 | 80.95610568110362 | 32.0881491226412 | 0.0 | 9605 | 0 | 73.70257700000593 | 1299.2101319999847 |