github BerriAI/litellm v1.34.36

latest releases: v1.46.8, v1.46.7, v1.46.6...
5 months ago

What's Changed

Full Changelog: v1.34.35...v1.34.36

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 56 58.54507118736945 1.5868012769087811 0.0 475 0 51.17489700000988 232.30003899999474
/health/liveliness Passed ✅ 41 43.45138590815679 15.276720503797593 0.0 4573 0 38.588892000007036 1389.35812699998
/health/readiness Passed ✅ 41 43.670719167233 15.721024861332051 0.0 4706 0 38.73415000003888 1430.30149599997
Aggregated Passed ✅ 41 44.29223918115643 32.584546642038426 0.0 9754 0 38.588892000007036 1430.30149599997

Don't miss a new litellm release

NewReleases is sending notifications on new releases.