pypi litellm 1.59.1
v1.59.1

latest releases: 1.85.0.dev1, 1.84.0rc1, 1.84.0.dev2...
15 months ago

What's Changed

  • fix(admins.tsx): fix logic for getting base url and create common get… by @krrishdholakia in #7854
  • Fix: Problem with langfuse_tags when using litellm proxy with langfus… by @yuu341 in #7825
  • (UI - View Logs Table) - Show country of origin for logs by @ishaan-jaff in #7856
  • (UI Logs) - add pagination + filtering by key name/team name by @ishaan-jaff in #7860
  • Revert "Remove UI build output" by @ishaan-jaff in #7861
  • (Security) Add grype security scan to ci/cd pipeline by @ishaan-jaff in #7864
  • LiteLLM Minor Fixes & Improvements (01/18/2025) - p1 by @krrishdholakia in #7857
  • feat(health_check.py): set upperbound for api when making health check call by @krrishdholakia in #7865
  • add new bedrock stability models & versions to model_prices_and_context_window.json by @marty-sullivan in #7869
  • Auth checks on invalid fallback models by @krrishdholakia in #7871
  • JWT Auth - enforce_rbac support + UI team view, spend calc fix by @krrishdholakia in #7863
  • Fix typo Update alerting.md by @MonkeyKing44 in #7880
  • typo fix README.md by @VitalikBerashvili in #7879
  • feat: add new together_ai models by @theGitNoob in #7882
  • fix(fireworks_ai/): fix global disable flag with transform messages h… by @krrishdholakia in #7847
  • (Feat) datadog_llm_observability callback - emit request_tags on logs by @ishaan-jaff in #7883
  • Litellm dev 01 20 2025 p1 by @krrishdholakia in #7884

New Contributors

Full Changelog: v1.59.0...v1.59.1

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.59.1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 250.0 295.7613582714676 6.034086428263315 0.0 1805 0 224.12125900001456 3576.6714410000304
Aggregated Passed ✅ 250.0 295.7613582714676 6.034086428263315 0.0 1805 0 224.12125900001456 3576.6714410000304

Don't miss a new litellm release

NewReleases is sending notifications on new releases.