Full Changelog: v1.34.5...v1.34.6
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 39 | 43.494775435583094 | 1.633318116162535 | 0.0 | 489 | 0 | 34.97501599997577 | 1143.8180330000023 |
| /health/liveliness | Passed ✅ | 25 | 27.179221879552216 | 15.50149156873277 | 0.0 | 4641 | 0 | 23.14285799997151 | 989.7288989999993 |
| /health/readiness | Passed ✅ | 25 | 27.2245580989883 | 15.521532281814519 | 0.010020356540874447 | 4647 | 3 | 23.04965500002254 | 1015.2391109999712 |
| Aggregated | Passed ✅ | 25 | 28.016798140227166 | 32.656341966709824 | 0.010020356540874447 | 9777 | 3 | 23.04965500002254 | 1143.8180330000023 |