github BerriAI/litellm v1.33.1

latest releases: v1.37.16-stable, v1.37.16, v1.37.14...
one month ago

Full Changelog: v1.33.0...v1.33.1

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 82 92.66200379295492 1.5164045977482197 0.0 454 0 77.81299100003025 1358.0287479999242
/health/liveliness Passed ✅ 62 64.67198939252287 15.367791969690657 0.0 4601 0 59.934072999908494 1474.2977180000025
/health/readiness Passed ✅ 62 64.67469893723987 15.27426921916874 0.003340098232925594 4573 1 59.5637709999437 1446.6621210000312
Aggregated Passed ✅ 62 65.99312122528015 32.158465786607614 0.003340098232925594 9628 1 59.5637709999437 1474.2977180000025

Don't miss a new litellm release

NewReleases is sending notifications on new releases.