Full Changelog: v1.35.36-dev2...v1.35.37
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 40 | 45.927794851771 | 1.5098661209108717 | 0.0 | 452 | 0 | 34.30683700000259 | 1060.4514910000091 |
| /health/liveliness | Passed ✅ | 25 | 28.087583800042648 | 15.686573680967816 | 0.0 | 4696 | 0 | 23.097278999955506 | 1512.7727469999854 |
| /health/readiness | Passed ✅ | 25 | 27.44702863919547 | 15.442723621617167 | 0.0 | 4623 | 0 | 23.009613999988687 | 1090.2711250000152 |
| Aggregated | Passed ✅ | 25 | 28.609791239074898 | 32.63916342349586 | 0.0 | 9771 | 0 | 23.009613999988687 | 1512.7727469999854 |