What's Changed
- [Fix] raise exception when creating team_id for existing team_id on
/team/newby @ishaan-jaff in #3791
Full Changelog: v1.38.0...v1.38.1
Docker Run LiteLLM Proxy
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.38.1
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Failed ❌ | 8 | 9.746596574514632 | 1.5463887881502736 | 1.5463887881502736 | 463 | 463 | 6.58207899999752 | 165.79881100000193 |
| /health/liveliness | Failed ❌ | 8 | 10.11517365815204 | 15.69100329747297 | 15.69100329747297 | 4698 | 4698 | 6.299295000019356 | 755.4609530000107 |
| /health/readiness | Failed ❌ | 8 | 11.074278653607022 | 15.600825117602435 | 15.600825117602435 | 4671 | 4671 | 6.339177999961976 | 1489.8524319999638 |
| Aggregated | Failed ❌ | 8 | 10.553469858726283 | 32.83821720322568 | 32.83821720322568 | 9832 | 9832 | 6.299295000019356 | 1489.8524319999638 |