What's Changed
- Support latest Anthropic Tools Use (2024-04-04) by @lazyhope in #2856
- [FEAT] add azure command-r-plus by @ishaan-jaff in #2861
https://docs.litellm.ai/docs/providers/azure_ai - Add Azure Command-r-plus on litellm proxy by @ishaan-jaff in #2868
- [CI/CD] Use specific commit hash on docker builds by @ishaan-jaff in #2869
- CI/CD deploy stable releases by @ishaan-jaff in #2871
- feat(prisma.schema): UI improvements for tracking spend for users by @krrishdholakia in #2870
Full Changelog: v1.34.28.dev12...v1.34.29
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 93 | 109.58477577729985 | 1.5598872259349816 | 0.0 | 467 | 0 | 86.14991300001407 | 1266.8051839999919 |
| /health/liveliness | Passed ✅ | 78 | 79.6745395084596 | 15.201384936252895 | 0.003340229605856492 | 4551 | 1 | 73.84244000002127 | 1081.535916000007 |
| /health/readiness | Passed ✅ | 78 | 80.26678459095872 | 15.294911365216876 | 0.0 | 4579 | 0 | 73.68360599997459 | 1256.5205770000034 |
| Aggregated | Passed ✅ | 78 | 81.41257958038933 | 32.05618352740475 | 0.003340229605856492 | 9597 | 1 | 73.68360599997459 | 1266.8051839999919 |