Full Changelog: v1.35.2.dev1...v1.35.2.dev2
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 39 | 43.49570516775706 | 1.5334542654677854 | 0.0 | 459 | 0 | 35.536331000002974 | 672.7238769999815 |
| /health/liveliness | Passed ✅ | 25 | 27.633547701502316 | 15.568402782309107 | 0.0 | 4660 | 0 | 23.23066200000312 | 1111.8675150000001 |
| /health/readiness | Passed ✅ | 25 | 28.841449343583456 | 15.645242538530805 | 0.0 | 4683 | 0 | 23.37774900001932 | 1315.0456060000124 |
| Aggregated | Passed ✅ | 25 | 28.95341442940254 | 32.7470995863077 | 0.0 | 9802 | 0 | 23.23066200000312 | 1315.0456060000124 |