Full Changelog: v.1.32.34-stable...v1.34.23-stable
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 83 | 98.39840399774896 | 1.4831160494372213 | 0.0 | 444 | 0 | 76.62480600004073 | 1318.882416000065 |
| /health/liveliness | Passed ✅ | 67 | 68.70456653985288 | 15.505911489836896 | 0.0 | 4642 | 0 | 63.61812900001951 | 865.8068830000047 |
| /health/readiness | Passed ✅ | 67 | 68.8459329603138 | 15.318851807925896 | 0.0 | 4586 | 0 | 63.58104399998865 | 1370.0413990000015 |
| Aggregated | Passed ✅ | 67 | 70.13471234584335 | 32.307879347200014 | 0.0 | 9672 | 0 | 63.58104399998865 | 1370.0413990000015 |