Full Changelog: v1.33.0...v1.33.1
Load Test LiteLLM Proxy Results
Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
---|---|---|---|---|---|---|---|---|---|
/chat/completions | Passed ✅ | 82 | 92.66200379295492 | 1.5164045977482197 | 0.0 | 454 | 0 | 77.81299100003025 | 1358.0287479999242 |
/health/liveliness | Passed ✅ | 62 | 64.67198939252287 | 15.367791969690657 | 0.0 | 4601 | 0 | 59.934072999908494 | 1474.2977180000025 |
/health/readiness | Passed ✅ | 62 | 64.67469893723987 | 15.27426921916874 | 0.003340098232925594 | 4573 | 1 | 59.5637709999437 | 1446.6621210000312 |
Aggregated | Passed ✅ | 62 | 65.99312122528015 | 32.158465786607614 | 0.003340098232925594 | 9628 | 1 | 59.5637709999437 | 1474.2977180000025 |