github BerriAI/litellm 1.35.19.dev1

latest releases: v1.52.9, v1.52.8.dev1, v1.52.8...
6 months ago

What's Changed

  • [UI] round up team spend to 2 decimals + diversify legend for team spend by @ishaan-jaff in #3210
  • UI - increase default session time to 2 hours by @ishaan-jaff in #3212

Full Changelog: v1.35.19...1.35.19.dev1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 82 87.0113330723138 1.6168236628153883 0.0 484 0 76.49579799999628 688.3324790000245
/health/liveliness Passed ✅ 66 69.47131877358837 15.32975989392524 0.0033405447578830337 4589 1 63.48388399999294 1317.9960030000188
/health/readiness Passed ✅ 66 70.14140744272815 15.136008297968026 0.0 4531 0 63.27464200001032 1354.6154009999896
Aggregated Passed ✅ 66 70.67139568742188 32.08259185470865 0.0033405447578830337 9604 1 63.27464200001032 1354.6154009999896

Don't miss a new litellm release

NewReleases is sending notifications on new releases.