Full Changelog: v1.35.2...v1.35.2.dev1
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 80 | 86.73186911441704 | 1.459704341578128 | 0.0 | 437 | 0 | 76.22928200001411 | 968.069651999997 |
| /health/liveliness | Passed ✅ | 66 | 69.20286019714665 | 15.452156256614234 | 0.0 | 4626 | 0 | 63.52887100001681 | 1439.3287229999885 |
| /health/readiness | Passed ✅ | 66 | 69.76840435106551 | 15.508941093700797 | 0.0 | 4643 | 0 | 63.739710999982435 | 1511.5879589999963 |
| Aggregated | Passed ✅ | 66 | 70.2626168840921 | 32.42080169189316 | 0.0 | 9706 | 0 | 63.52887100001681 | 1511.5879589999963 |