Full Changelog: v1.34.34...v1.34.34.dev1
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 40 | 44.63567630967619 | 1.5531698625084285 | 0.0 | 465 | 0 | 34.3844149999768 | 947.8966600000263 |
| /health/liveliness | Passed ✅ | 25 | 28.492204595294115 | 15.615202381133125 | 0.0 | 4675 | 0 | 23.249706000001424 | 1367.5765010000305 |
| /health/readiness | Passed ✅ | 25 | 28.254767451092132 | 15.742128090327363 | 0.0033401502419536096 | 4713 | 1 | 23.426859999972294 | 1369.3040239999732 |
| Aggregated | Passed ✅ | 25 | 29.140501873946636 | 32.91050033396891 | 0.0033401502419536096 | 9853 | 1 | 23.249706000001424 | 1369.3040239999732 |