Full Changelog: v1.34.19...v1.34.20
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 78 | 82.77907037711888 | 1.5764725188758335 | 0.0 | 472 | 0 | 72.8318520000073 | 463.46175899998343 |
| /health/liveliness | Passed ✅ | 62 | 64.35756584088988 | 15.617765886151266 | 0.0 | 4676 | 0 | 59.69151200002898 | 1073.4929960000272 |
| /health/readiness | Passed ✅ | 62 | 64.7144725812361 | 15.13012820022781 | 0.0033399841501606646 | 4530 | 1 | 59.79837799998222 | 1565.471099999968 |
| Aggregated | Passed ✅ | 62 | 65.42304813835499 | 32.32436660525491 | 0.0033399841501606646 | 9678 | 1 | 59.69151200002898 | 1565.471099999968 |