github BerriAI/litellm v1.34.13

latest releases: v1.52.5, v1.52.4, v1.52.0-stable...
7 months ago

What's Changed

New Contributors

Full Changelog: v1.34.12...v1.34.13

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Failed ❌ 1700.0 1720.6599296916486 1.5597691501485915 1.5597691501485915 467 467 319.8903159999986 3570.9275919999754
/health/liveliness Passed ✅ 40 42.81475298526769 14.963095915772357 0.0 4480 0 38.02822300002617 1332.4513609999826
/health/readiness Passed ✅ 40 42.222838855951075 15.210254196523953 0.0 4554 0 38.3152320000022 716.6715859999897
Aggregated Passed ✅ 40 125.00169336806573 31.7331192624449 1.5597691501485915 9501 467 38.02822300002617 3570.9275919999754

Don't miss a new litellm release

NewReleases is sending notifications on new releases.