BerriAI/litellm v1.75.8-nightly

on GitHub

What's Changed

• [Feat] UI - Add Confirmation Modal Before Deleting Keys by @ishaan-jaff in #13655
• [Bug Fix] Using stream=True + background=True with Responses API by @ishaan-jaff in #13654
• Chore: update boto3 version to 1.37.38 for Bedrock Integration by @0x-fang in #13656
• Fix LangfuseOtelSpanAttributes constants to match expected values at langfuse by @willfinnigan in #13659
• Fixed incorrect key info endpoint by @dcbark01 in #13633
• trivy/secrets false positives by @javacruft in #13631
• [Feat] Team Member Rate Limits - show team member tpm/rpm limits by @ishaan-jaff in #13662
• [Feat] UI QA for Team Member Rate Limits by @ishaan-jaff in #13664
• Chore: update boto3 to 1.36.0 and aioboto3 to 13.4.0 for Bedrock Integration by @0x-fang in #13665
• [Feat] UI - Allow editing team member rpm/tpm limits by @ishaan-jaff in #13669
• [Bug Fix] Add cachePoint support for assistant and tool messages in Bedrock by @yytdfc in #13640
• [Docs] v1.75.8-stable by @ishaan-jaff in #13676
• Edit Budget Duration + Other Improvements in User Settings by @NANDINI-star in #13629

New Contributors

• @willfinnigan made their first contribution in #13659
• @dcbark01 made their first contribution in #13633
• @javacruft made their first contribution in #13631

Full Changelog: v1.75.7-nightly...v1.75.8-nightly

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.75.8-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results