Full Changelog: v1.34.17...v1.34.18
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 95 | 98.99946042212315 | 1.4798141591944631 | 0.0 | 443 | 0 | 87.83134200001541 | 516.7399519999947 |
| /health/liveliness | Passed ✅ | 78 | 80.24621814689517 | 15.599846779770074 | 0.0 | 4670 | 0 | 74.0505100000064 | 1447.6485150000258 |
| /health/readiness | Passed ✅ | 78 | 81.60481963803868 | 15.052014901422687 | 0.006680876565212023 | 4506 | 2 | 74.04748900000868 | 1498.5097569999652 |
| Aggregated | Passed ✅ | 78 | 81.74632674935023 | 32.131675840387224 | 0.006680876565212023 | 9619 | 2 | 74.04748900000868 | 1498.5097569999652 |