github BerriAI/litellm v1.34.10

latest releases: v1.35.17, v1.35.16, v1.35.15...
24 days ago

Full Changelog: v1.34.10.dev1...v1.34.10

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Failed ❌ 1800.0 1761.8447134606747 1.4863563301473084 1.4863563301473084 445 445 280.82297299999937 3158.9710640000135
/health/liveliness Passed ✅ 40 42.90798184780657 15.077331402887529 0.0 4514 0 38.579956000035054 1139.8761570000033
/health/readiness Passed ✅ 40 42.83725997510891 15.297779757471174 0.0 4580 0 38.62827400007518 1062.1358200000373
Aggregated Passed ✅ 40 123.06344252405925 31.86146749050601 1.4863563301473084 9539 445 38.579956000035054 3158.9710640000135

Don't miss a new litellm release

NewReleases is sending notifications on new releases.