github BerriAI/litellm v1.34.37

latest releases: v1.48.5.dev1, v1.48.5-stable, v1.48.5...
5 months ago

What's Changed

Full Changelog: 1.34.35-stable...v1.34.37

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 77 89.62353590672491 1.5398411467131836 0.0033402194071869493 461 1 72.80556299997443 1240.0245009999935
/health/liveliness Passed ✅ 62 65.6125592886622 15.054368868191581 0.0 4507 0 59.63998400000037 1280.983823999975
/health/readiness Passed ✅ 62 65.78019976622576 15.64558770326367 0.0 4684 0 59.52258299998903 1236.3295840000035
Aggregated Passed ✅ 62 66.8407283953587 32.23979771816843 0.0033402194071869493 9652 1 59.52258299998903 1280.983823999975

Don't miss a new litellm release

NewReleases is sending notifications on new releases.