BerriAI/litellm v1.43.19

on GitHub

What's Changed

• feat: Bedrock pass-through endpoint support (All endpoints) by @krrishdholakia in #5264
• Update helm repo to v0.2.3 by @lowjiansheng in #5280
• [Feat] V2 aporia guardrails litellm by @ishaan-jaff in #5288
• [Feat] run aporia guardrail as post call success hook by @ishaan-jaff in #5281
• [Feat-Proxy] Allow accessing data in post call success hook by @ishaan-jaff in #5282
• [Feat-Proxy] Return applied guardrails in response headers as x-litellm-applied-guardrails by @ishaan-jaff in #5283
• [Doc-Tutorial] use litellm proxy with aporia by @ishaan-jaff in #5286
• [Fix] Proxy - send slack alerting spend reports by @ishaan-jaff in #5289
• [Feat] - control guardrails per API Key by @ishaan-jaff in #5294

Full Changelog: v1.43.18...v1.43.19

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.43.19

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.43.19

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results