Full Changelog: v1.35.20...v1.35.15-stable
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 43 | 49.55053653586523 | 1.583453330366775 | 0.0 | 474 | 0 | 35.98067499999047 | 1311.9795399999816 |
| /health/liveliness | Passed ✅ | 26 | 28.40283839727455 | 15.690886693528993 | 0.0 | 4697 | 0 | 23.32956700001887 | 1245.456331000014 |
| /health/readiness | Passed ✅ | 26 | 29.229367997202925 | 15.527196370347617 | 0.0 | 4648 | 0 | 23.27850199998238 | 1275.4970010000193 |
| Aggregated | Passed ✅ | 26 | 29.814969825949255 | 32.801536394243385 | 0.0 | 9819 | 0 | 23.27850199998238 | 1311.9795399999816 |