What's Changed
- created defaults for response["eval_count"] by @gregnwosu in #2892
New Contributors
- @gregnwosu made their first contribution in #2892
Full Changelog: v1.35.1.dev1...v1.35.1.dev2
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 41 | 45.19059934868436 | 1.5226733311145824 | 0.0 | 456 | 0 | 35.54072000000019 | 345.4370799999822 |
| /health/liveliness | Passed ✅ | 25 | 27.884267815168553 | 15.717595108676182 | 0.006678391803134133 | 4707 | 2 | 23.136004999969373 | 1308.393284000033 |
| /health/readiness | Passed ✅ | 25 | 28.57209173287544 | 15.550635313597828 | 0.0 | 4657 | 0 | 23.403158000007807 | 1314.1930079999895 |
| Aggregated | Passed ✅ | 25 | 29.014092984623147 | 32.79090375338859 | 0.006678391803134133 | 9820 | 2 | 23.136004999969373 | 1314.1930079999895 |