What's Changed
- Fixed typo in token_usage.md by @andeplane in #3289
New Contributors
- @andeplane made their first contribution in #3289
Full Changelog: v1.35.26.dev1...1.35.26.dev3
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 82 | 89.29392581584473 | 1.5598100175990155 | 0.0 | 467 | 0 | 74.95227900000145 | 302.8643650000049 |
| /health/liveliness | Passed ✅ | 66 | 72.03278793199252 | 15.2741139410713 | 0.0 | 4573 | 0 | 63.32584099999394 | 913.2293100000197 |
| /health/readiness | Passed ✅ | 66 | 72.97123943137227 | 15.671581590095462 | 0.006680128555027903 | 4692 | 2 | 63.26687699998956 | 1357.0392919999676 |
| Aggregated | Passed ✅ | 66 | 73.31352835809702 | 32.505505548765775 | 0.006680128555027903 | 9732 | 2 | 63.26687699998956 | 1357.0392919999676 |