Full Changelog: v1.34.41...1.34.40.dev1
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 77 | 81.173657764966 | 1.5063339924614734 | 0.0 | 451 | 0 | 71.93741999998338 | 766.846145000045 |
| /health/liveliness | Passed ✅ | 62 | 65.36667029825317 | 15.487518232913198 | 0.003339986679515462 | 4637 | 1 | 59.801646999972036 | 1681.3968060000093 |
| /health/readiness | Passed ✅ | 62 | 66.13317987362252 | 15.460798339477074 | 0.0 | 4629 | 0 | 59.8357880000151 | 1439.9600270000406 |
| Aggregated | Passed ✅ | 62 | 66.4654790017493 | 32.45465056485175 | 0.003339986679515462 | 9717 | 1 | 59.801646999972036 | 1681.3968060000093 |