github BerriAI/litellm v1.34.37.dev1

latest releases: v1.48.5.dev1, v1.48.5-stable, v1.48.5...
5 months ago

What's Changed

Full Changelog: v1.34.37...v1.34.37.dev1

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 77 80.51407646458344 1.603350507385046 0.0 480 0 71.92962899995337 539.6768960000031
/health/liveliness Passed ✅ 62 64.73594564058693 15.241850760829095 0.0066806271141043585 4563 2 59.78436700002021 1552.9094980000195
/health/readiness Passed ✅ 62 63.946665819295596 15.268573269285511 0.0033403135570521793 4571 1 59.93750400000408 1245.6787830000167
Aggregated Passed ✅ 62 65.14843833170362 32.11377453749965 0.010020940671156537 9614 3 59.78436700002021 1552.9094980000195

Don't miss a new litellm release

NewReleases is sending notifications on new releases.