What's Changed
- [FEAT] add azure command-r-plus by @ishaan-jaff in #2861
- Add Azure Command-r-plus on litellm proxy by @ishaan-jaff in #2868
Full Changelog: v1.34.28...1.34.28.dev3
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 78 | 88.97897695127786 | 1.439020394655568 | 0.0 | 431 | 0 | 72.44136000002754 | 1086.1761080000178 |
| /health/liveliness | Passed ✅ | 62 | 64.66624318546471 | 15.481989721619184 | 0.00333879441915445 | 4637 | 1 | 59.66580900008012 | 1100.8825230000525 |
| /health/readiness | Passed ✅ | 62 | 65.49718522473842 | 15.331743972757234 | 0.0 | 4592 | 0 | 59.93165399996769 | 1353.8260570000489 |
| Aggregated | Passed ✅ | 62 | 66.14600240879912 | 32.25275408903199 | 0.00333879441915445 | 9660 | 1 | 59.66580900008012 | 1353.8260570000489 |