What's Changed
- fix(admins.tsx): fix logic for getting base url and create common get… by @krrishdholakia in #7854
- Fix: Problem with langfuse_tags when using litellm proxy with langfus… by @yuu341 in #7825
- (UI - View Logs Table) - Show country of origin for logs by @ishaan-jaff in #7856
- (UI Logs) - add pagination + filtering by key name/team name by @ishaan-jaff in #7860
- Revert "Remove UI build output" by @ishaan-jaff in #7861
- (Security) Add grype security scan to ci/cd pipeline by @ishaan-jaff in #7864
- LiteLLM Minor Fixes & Improvements (01/18/2025) - p1 by @krrishdholakia in #7857
- feat(health_check.py): set upperbound for api when making health check call by @krrishdholakia in #7865
- add new bedrock stability models & versions to model_prices_and_context_window.json by @marty-sullivan in #7869
- Auth checks on invalid fallback models by @krrishdholakia in #7871
- JWT Auth -
enforce_rbac
support + UI team view, spend calc fix by @krrishdholakia in #7863 - Fix typo Update alerting.md by @MonkeyKing44 in #7880
- typo fix README.md by @VitalikBerashvili in #7879
- feat: add new together_ai models by @theGitNoob in #7882
- fix(fireworks_ai/): fix global disable flag with transform messages h… by @krrishdholakia in #7847
- (Feat)
datadog_llm_observability
callback - emitrequest_tags
on logs by @ishaan-jaff in #7883 - Litellm dev 01 20 2025 p1 by @krrishdholakia in #7884
New Contributors
- @yuu341 made their first contribution in #7825
- @marty-sullivan made their first contribution in #7869
- @MonkeyKing44 made their first contribution in #7880
- @VitalikBerashvili made their first contribution in #7879
- @theGitNoob made their first contribution in #7882
Full Changelog: v1.59.0...v1.59.1
Docker Run LiteLLM Proxy
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.59.1
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
---|---|---|---|---|---|---|---|---|---|
/chat/completions | Passed ✅ | 250.0 | 295.7613582714676 | 6.034086428263315 | 0.0 | 1805 | 0 | 224.12125900001456 | 3576.6714410000304 |
Aggregated | Passed ✅ | 250.0 | 295.7613582714676 | 6.034086428263315 | 0.0 | 1805 | 0 | 224.12125900001456 | 3576.6714410000304 |