What's Changed
- fix(_types.py): hash api key in UserAPIKeyAuth by @krrishdholakia in #3105
- Fix missing comma in Gemini document. by @kittinan in #3123
- [FIX] - show vertex_project, vertex_location in Vertex AI exceptions by @ishaan-jaff in #3130
- [Fix] Slack Alerting - trim messages to first 100 chars by @ishaan-jaff in #3140
- [Fix] Show
modelpassed on"400: {'error': 'Invalid model name passed in modeerrors 👻 by @ishaan-jaff in #3142 - (feat) - Add seed to Cohere Chat. by @Manouchehri in #3136
- [Feat] Allow user to select slack alert types to Opt In to by @ishaan-jaff in #3112
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Internal Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
New Contributors
Full Changelog: v1.35.12...v1.35.13
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 93 | 98.68926357872152 | 1.5698647166764488 | 0.0 | 470 | 0 | 86.12066500000992 | 777.2846080000022 |
| /health/liveliness | Passed ✅ | 78 | 80.06604596943863 | 15.301170781052791 | 0.0066802753901125484 | 4581 | 2 | 73.94863899997972 | 1522.7241400000366 |
| /health/readiness | Passed ✅ | 78 | 80.77921167615287 | 15.140844171690091 | 0.0 | 4533 | 0 | 73.96055500004195 | 1365.2821910000057 |
| Aggregated | Passed ✅ | 78 | 81.31663992028369 | 32.01187966941933 | 0.0066802753901125484 | 9584 | 2 | 73.94863899997972 | 1522.7241400000366 |