Full Changelog: v1.34.36.dev2...1.34.35-stable
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 82 | 85.9205370193538 | 1.5532033800118876 | 0.0 | 465 | 0 | 75.86904800001548 | 290.69797300002165 |
| /health/liveliness | Passed ✅ | 65 | 68.7640741313527 | 15.511992466183239 | 0.0033402223226062103 | 4644 | 1 | 63.21401899998591 | 1120.7676690000312 |
| /health/readiness | Passed ✅ | 65 | 68.20540649619821 | 15.375043350956386 | 0.0033402223226062103 | 4603 | 1 | 63.38805799998681 | 1236.8685650000089 |
| Aggregated | Passed ✅ | 65 | 69.32072653233155 | 32.44023919715151 | 0.006680444645212421 | 9712 | 2 | 63.21401899998591 | 1236.8685650000089 |