What's Changed
- Add command-r-plus by @themrzmaster in #2847
- Fix: Remove non-existent gemini-1.5-pro-vision model. by @Manouchehri in #2841
- feat(vertex_ai_anthropic.py): Add support for claude 3 on vertex ai by @krrishdholakia in #2665
- feat: add gemini-experimental to vertex ai by @cheahjs in #2859
- Support latest Anthropic Tools Use (2024-04-04) by @lazyhope in #2856
New Contributors
- @themrzmaster made their first contribution in #2847
- @cheahjs made their first contribution in #2859
Full Changelog: v1.34.27...v1.34.28
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 40 | 53.3972479797162 | 1.6466886940720966 | 0.0 | 493 | 0 | 35.56440799999905 | 1050.790050000046 |
| /health/liveliness | Passed ✅ | 25 | 27.134720360847133 | 15.458164860376598 | 0.0 | 4628 | 0 | 23.121685999967667 | 1016.2047730000268 |
| /health/readiness | Passed ✅ | 25 | 26.557904771140425 | 15.879022417076566 | 0.0 | 4754 | 0 | 23.183289999963108 | 737.5355639999839 |
| Aggregated | Passed ✅ | 25 | 28.168162872506542 | 32.983875971525265 | 0.0 | 9875 | 0 | 23.121685999967667 | 1050.790050000046 |