Full Changelog: v1.35.33.dev1...v1.35.34
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 56 | 60.59063693520661 | 1.5464062051613479 | 0.0 | 463 | 0 | 50.10197399997196 | 776.683281000004 |
| /health/liveliness | Passed ✅ | 40 | 43.5946980195155 | 15.574281068396036 | 0.0 | 4663 | 0 | 37.752785000009226 | 1280.8077110000227 |
| /health/readiness | Passed ✅ | 40 | 43.24365085222429 | 15.617700681067953 | 0.0 | 4676 | 0 | 37.88299199999301 | 1433.2260259999998 |
| Aggregated | Passed ✅ | 40 | 44.23004010926335 | 32.73838795462534 | 0.0 | 9802 | 0 | 37.752785000009226 | 1433.2260259999998 |