github BerriAI/litellm v1.34.40

latest releases: v1.40.9-stable, v1.40.9, 1.40.8.dev1...
2 months ago

What's Changed

Full Changelog: v1.34.39...v1.34.40

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 55 59.38243058163271 1.636716795176527 0.0 490 0 50.21895799995946 823.0557899999837
/health/liveliness Passed ✅ 40 43.38840214425958 15.652356943259601 0.003340238357503116 4686 1 38.32955799998672 1505.0786130000233
/health/readiness Passed ✅ 40 43.678412320061014 15.351735491084321 0.0 4596 0 38.477973999988535 1445.2507309999874
Aggregated Passed ✅ 40 44.32679353827271 32.64080922952045 0.003340238357503116 9772 1 38.32955799998672 1505.0786130000233

Don't miss a new litellm release

NewReleases is sending notifications on new releases.