Full Changelog: 1.35.13.dev1...v1.35.14
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Internal Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 61 | 69.02272031568172 | 1.639857453056782 | 0.0 | 491 | 0 | 54.20590699998229 | 1289.3331660000058 |
| /health/liveliness | Passed ✅ | 45 | 48.200781280805096 | 15.74730731397704 | 0.0 | 4715 | 0 | 42.47953600008714 | 1189.913727999965 |
| /health/readiness | Passed ✅ | 45 | 48.80195884177193 | 15.303109673943329 | 0.0 | 4582 | 0 | 42.55265799997687 | 1153.1860230000461 |
| Aggregated | Passed ✅ | 45 | 49.52670768563471 | 32.69027444097715 | 0.0 | 9788 | 0 | 42.47953600008714 | 1289.3331660000058 |