What's Changed
- Docs: Miscellaneous cleanup of
docs/my-website/docs/proxy/logging.md
by @msabramo in #4651 - Proxy: Add
x-litellm-call-id
HTTP response header by @msabramo in #4650 - Update Helicone Docs by @colegottdank in #4612
- Helicone Headers & Cohere support by @maamalama in #4607
- feat(vertex_httpx.py): Add seed parameter by @Manouchehri in #4588
- Flag for PII masking on Logging only by @krrishdholakia in #4669
New Contributors
- @colegottdank made their first contribution in #4612
- @maamalama made their first contribution in #4607
Full Changelog: v1.41.18...v1.41.19
Docker Run LiteLLM Proxy
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.41.19
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Docker Run LiteLLM Proxy
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.41.19
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Docker Run LiteLLM Proxy
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.41.19
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Docker Run LiteLLM Proxy
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.41.19
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
---|---|---|---|---|---|---|---|---|---|
/chat/completions | Passed ✅ | 140.0 | 162.29828288616181 | 6.400667074458538 | 0.0 | 1915 | 0 | 115.81288100001075 | 1323.0728789999944 |
Aggregated | Passed ✅ | 140.0 | 162.29828288616181 | 6.400667074458538 | 0.0 | 1915 | 0 | 115.81288100001075 | 1323.0728789999944 |