github BerriAI/litellm v1.34.16

latest releases: 1.35.19.dev1, v1.35.19, v1.35.18...
23 days ago

What's Changed

New Contributors

Full Changelog: v1.34.14...v1.34.16

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Failed ❌ 1800.0 1804.1266242200957 1.3962453502626808 1.3962453502626808 418 418 379.11375700002736 3296.3548129999936
/health/liveliness Passed ✅ 78 79.54824791932579 14.864334470499832 0.0 4450 0 73.51694799999109 1067.832205000002
/health/readiness Passed ✅ 78 80.41093312383722 15.07811366288455 0.0 4514 0 73.90703699996948 1273.2291260000181
Aggregated Passed ✅ 78 156.79914562843686 31.338693483647063 1.3962453502626808 9382 418 73.51694799999109 3296.3548129999936

Don't miss a new litellm release

NewReleases is sending notifications on new releases.