Full Changelog: v1.34.26...v1.34.27
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 93 | 109.87938594267533 | 1.5730803323619171 | 0.003339873317116597 | 471 | 1 | 86.13480499997195 | 1296.3781700000254 |
| /health/liveliness | Passed ✅ | 78 | 80.21681031098781 | 15.046129293610269 | 0.0 | 4505 | 0 | 73.91940100001193 | 1017.9840530000206 |
| /health/readiness | Passed ✅ | 78 | 82.1807569235042 | 15.630607124105673 | 0.010019619951349791 | 4680 | 3 | 68.7019019999866 | 3399.4434679999586 |
| Aggregated | Passed ✅ | 78 | 82.61556168517045 | 32.24981675007786 | 0.013359493268466388 | 9656 | 4 | 68.7019019999866 | 3399.4434679999586 |