🚀 LiteLLM Proxy - Proxy 100+ LLMs, Set Budgets and Auto-Scale with the LiteLLM CloudFormation Stack 👉Start here: https://docs.litellm.ai/docs/proxy/deploy#aws-cloud-formation-stack
⚡️ Load Balancing - View Metrics about selected deployments in server logs
🔎 Proxy view better debug prisma logs / slack alerts
📖 Docs: setting load balancing config https://docs.litellm.ai/docs/proxy/configs
⭐️ PR for using cross account ARN with Bedrock, Sagemaker: #2179
https://github.com/BerriAI/litellm/releases/tag/v1.30.2
What's Changed
- test: reintegrate s3 testing by @krrishdholakia in #2386
- (docs) setting load balancing config by @ishaan-jaff in #2388
- feat: add realease details to discord notification message by @DanielChico in #2387
- [FIX] Proxy better debug prisma logs by @ishaan-jaff in #2390
- [Feat] Load Balancing - View Metrics about selected deployments in server logs by @ishaan-jaff in #2393
- (feat) LiteLLM AWS CloudFormation Stack Template by @ishaan-jaff in #2391
Full Changelog: v1.30.1...v1.30.2