What's Changed
- Litellm dev 11 11 2024 by @krrishdholakia in #6693
- Add docs to export logs to Laminar by @dinmukhamedm in #6674
- (Feat) Add langsmith key based logging by @ishaan-jaff in #6682
- (fix) OpenAI's optional messages[].name does not work with Mistral API by @ishaan-jaff in #6701
- (feat) add xAI on Admin UI by @ishaan-jaff in #6680
- (docs) add benchmarks on 1K RPS by @ishaan-jaff in #6704
- (feat) add cost tracking stable diffusion 3 on Bedrock by @ishaan-jaff in #6676
- fix raise correct error 404 when /key/info is called on non-existent key by @ishaan-jaff in #6653
New Contributors
- @dinmukhamedm made their first contribution in #6674
Full Changelog: v1.52.4...v1.52.5
Docker Run LiteLLM Proxy
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.52.5
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 200.0 | 216.13288200000045 | 6.215294300193555 | 0.0 | 1859 | 0 | 166.97629999998753 | 1726.1806539999611 |
| Aggregated | Passed ✅ | 200.0 | 216.13288200000045 | 6.215294300193555 | 0.0 | 1859 | 0 | 166.97629999998753 | 1726.1806539999611 |