🚨 Stable Release: v1.34.1
What's Changed
- fix(utils.py): ensure last chunk is always empty delta w/ finish reason by @krrishdholakia in #2692
Full Changelog: v1.34.3...v1.34.4
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 79 | 86.86407849777704 | 1.5030779352423005 | 0.0 | 450 | 0 | 76.59221099999058 | 810.1544369999942 |
| /health/liveliness | Passed ✅ | 66 | 67.84189000257825 | 15.545166023594815 | 0.0 | 4654 | 0 | 63.235345999999026 | 1230.5323950000115 |
| /health/readiness | Passed ✅ | 66 | 68.87319157398417 | 15.124304201726972 | 0.0 | 4528 | 0 | 63.490915999977915 | 1336.0227140000234 |
| Aggregated | Passed ✅ | 66 | 69.21540727190579 | 32.172548160564084 | 0.0 | 9632 | 0 | 63.235345999999026 | 1336.0227140000234 |