Full Changelog: v1.34.40...1.34.39.dev1
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 80 | 82.05284844933918 | 1.5163375404027182 | 0.0 | 454 | 0 | 74.30707200001052 | 202.55287200001248 |
| /health/liveliness | Passed ✅ | 65 | 68.21450552862387 | 15.460631001154587 | 0.0 | 4629 | 0 | 63.24671999999509 | 1301.691882 |
| /health/readiness | Passed ✅ | 65 | 67.96381959687382 | 15.170055305086224 | 0.0 | 4542 | 0 | 63.33682399997542 | 1160.9531469999865 |
| Aggregated | Passed ✅ | 65 | 68.74894627501315 | 32.14702384664353 | 0.0 | 9625 | 0 | 63.24671999999509 | 1301.691882 |