What's Changed
- Litellm doc fixes 05 31 2025 by @krrishdholakia in #11305
- Converted action buttons to sticky footer action buttons by @NANDINI-star in #11293
- Add support for DataRobot as a provider in LiteLLM by @mjnitz02 in #10385
- fix: remove dupe server_id MCP config servers by @wagnerjt in #11327
- Add unit tests for Cohere Embed v4.0 model by @colesmcintosh in #11329
- Add presidio_language yaml configuration support for guardrails by @colesmcintosh in #11331
- [Fix] Fix SCIM running patch operation case sensitivity by @ishaan-jaff in #11335
New Contributors
Full Changelog: v1.72.0.rc...v1.72.0.dev1
Docker Run LiteLLM Proxy
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.72.0.dev1
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 200.0 | 219.56366307474462 | 6.258606219963298 | 0.0 | 1873 | 0 | 180.63117100007275 | 1544.1692160000002 |
| Aggregated | Passed ✅ | 200.0 | 219.56366307474462 | 6.258606219963298 | 0.0 | 1873 | 0 | 180.63117100007275 | 1544.1692160000002 |