Full Changelog: 1.35.1.dev1...v1.35.1
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 56 | 61.27676192407882 | 1.5397730909671428 | 0.0 | 461 | 0 | 50.1638559999833 | 1107.1635870000023 |
| /health/liveliness | Passed ✅ | 40 | 42.92388506183409 | 15.664936652138612 | 0.0 | 4690 | 0 | 38.05782500000987 | 1342.833737000035 |
| /health/readiness | Passed ✅ | 40 | 42.76369572825589 | 15.437811771041506 | 0.0 | 4622 | 0 | 38.10779999997749 | 1072.7217620000147 |
| Aggregated | Passed ✅ | 40 | 43.71384527197392 | 32.64252151414726 | 0.0 | 9773 | 0 | 38.05782500000987 | 1342.833737000035 |