github BerriAI/litellm v1.34.18

latest releases: v1.35.26, v1.35.25, 1.35.24.dev6...
25 days ago

Full Changelog: v1.34.17...v1.34.18

Group 209

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 95 98.99946042212315 1.4798141591944631 0.0 443 0 87.83134200001541 516.7399519999947
/health/liveliness Passed ✅ 78 80.24621814689517 15.599846779770074 0.0 4670 0 74.0505100000064 1447.6485150000258
/health/readiness Passed ✅ 78 81.60481963803868 15.052014901422687 0.006680876565212023 4506 2 74.04748900000868 1498.5097569999652
Aggregated Passed ✅ 78 81.74632674935023 32.131675840387224 0.006680876565212023 9619 2 74.04748900000868 1498.5097569999652

Don't miss a new litellm release

NewReleases is sending notifications on new releases.