github BerriAI/litellm v1.34.8.dev1

latest releases: v1.42.3-stable, v1.42.3, v1.42.2-stable...
4 months ago

What's Changed

Full Changelog: v1.34.8...v1.34.8.dev1

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Failed ❌ 90 95.18066933991201 1.5231486048986131 0.5477990596565188 456 164 73.70403299995587 1227.018284000053
/health/liveliness Failed ❌ 78 85.42985518872867 15.291610336021602 5.230812972086027 4578 1566 73.2654260000345 1335.0114459999531
/health/readiness Failed ❌ 78 85.73612634587776 15.355074861225711 5.284256782784223 4597 1582 73.44564999999648 1525.4359269999895
Aggregated Failed ❌ 78 86.03771519935606 32.16983380214593 11.06286881452677 9631 3312 73.2654260000345 1525.4359269999895

Don't miss a new litellm release

NewReleases is sending notifications on new releases.