Full Changelog: v1.35.2.dev2...v1.35.2.dev3
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 92 | 94.82537635214605 | 1.4798351719920857 | 0.0 | 443 | 0 | 85.5501070000173 | 463.2571589999941 |
| /health/liveliness | Passed ✅ | 78 | 81.72600641305303 | 15.406320120152369 | 0.0033404857155577557 | 4612 | 1 | 74.07127199996921 | 1523.1907680000063 |
| /health/readiness | Passed ✅ | 78 | 79.81057775310516 | 15.329488948694541 | 0.0 | 4589 | 0 | 74.00314199998093 | 2597.186700000009 |
| Aggregated | Passed ✅ | 78 | 81.41629247304068 | 32.215644240839 | 0.0033404857155577557 | 9644 | 1 | 74.00314199998093 | 2597.186700000009 |