What's Changed
- fix: remove aws params from bedrock embedding request body (#8618) by @ishaan-jaff in #8696
- Add anthropic3-7-sonnet by @dragosMC91 in #8766
- fix incorrect variable name in reliability section of docs by @niinpatel in #8753
- Litellm contributor prs 02 24 2025 by @krrishdholakia in #8775
- Add anthropic thinking + reasoning content support by @krrishdholakia in #8778
New Contributors
- @niinpatel made their first contribution in #8753
Full Changelog: v1.61.15-nightly...v1.61.16-nightly
## Docker Run LiteLLM Proxy
```
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.61.16-nightly
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
---|---|---|---|---|---|---|---|---|---|
/chat/completions | Failed ❌ | 150.0 | 173.09079325414655 | 6.248259928705226 | 6.248259928705226 | 1869 | 1869 | 131.67032300003711 | 1529.8640780000028 |
Aggregated | Failed ❌ | 150.0 | 173.09079325414655 | 6.248259928705226 | 6.248259928705226 | 1869 | 1869 | 131.67032300003711 | 1529.8640780000028 |