Full Changelog: v.1.32.34-stable...1.34.20-stable
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 57 | 69.32998340591962 | 1.58002534336049 | 0.0 | 473 | 0 | 50.500976000023456 | 1186.5837280000164 |
| /health/liveliness | Passed ✅ | 41 | 42.8901468894407 | 15.469550454762006 | 0.0 | 4631 | 0 | 38.469768000027216 | 926.7342310000117 |
| /health/readiness | Passed ✅ | 41 | 44.07258347254378 | 15.573103912783518 | 0.0 | 4662 | 0 | 38.527541999997084 | 1424.2580939999812 |
| Aggregated | Passed ✅ | 41 | 44.73517679141943 | 32.62267971090601 | 0.0 | 9766 | 0 | 38.469768000027216 | 1424.2580939999812 |