Full Changelog: v1.33.3...v1.33.4
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Failed ❌ | 85 | 93.98301701746783 | 1.5302020467054798 | 0.1403242051563977 | 458 | 42 | 63.60682199999701 | 802.5505589999966 |
| /health/liveliness | Failed ❌ | 66 | 69.3704888863688 | 15.318725729573416 | 1.867648349581579 | 4585 | 559 | 63.33905499997172 | 1172.7252800000088 |
| /health/readiness | Failed ❌ | 66 | 69.7621130132432 | 15.388887832151616 | 1.7373473019363526 | 4606 | 520 | 63.29959000004237 | 1177.4286550000284 |
| Aggregated | Failed ❌ | 66 | 70.7256923906102 | 32.23781560843051 | 3.745319856674329 | 9649 | 1121 | 63.29959000004237 | 1177.4286550000284 |