github BerriAI/litellm v1.34.23-stable

latest releases: v1.40.14, v1.40.13.dev1, v1.40.13...
2 months ago

Full Changelog: v.1.32.34-stable...v1.34.23-stable

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 83 98.39840399774896 1.4831160494372213 0.0 444 0 76.62480600004073 1318.882416000065
/health/liveliness Passed ✅ 67 68.70456653985288 15.505911489836896 0.0 4642 0 63.61812900001951 865.8068830000047
/health/readiness Passed ✅ 67 68.8459329603138 15.318851807925896 0.0 4586 0 63.58104399998865 1370.0413990000015
Aggregated Passed ✅ 67 70.13471234584335 32.307879347200014 0.0 9672 0 63.58104399998865 1370.0413990000015

Don't miss a new litellm release

NewReleases is sending notifications on new releases.