Full Changelog: v1.34.10.dev1...v1.34.10
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Failed ❌ | 1800.0 | 1761.8447134606747 | 1.4863563301473084 | 1.4863563301473084 | 445 | 445 | 280.82297299999937 | 3158.9710640000135 |
| /health/liveliness | Passed ✅ | 40 | 42.90798184780657 | 15.077331402887529 | 0.0 | 4514 | 0 | 38.579956000035054 | 1139.8761570000033 |
| /health/readiness | Passed ✅ | 40 | 42.83725997510891 | 15.297779757471174 | 0.0 | 4580 | 0 | 38.62827400007518 | 1062.1358200000373 |
| Aggregated | Passed ✅ | 40 | 123.06344252405925 | 31.86146749050601 | 1.4863563301473084 | 9539 | 445 | 38.579956000035054 | 3158.9710640000135 |