BerriAI/litellm v1.74.0-nightly

on GitHub

What's Changed

• [Feat] Add failure logging support for s3 logger by @ishaan-jaff in #12299
• Comma separated spend and budget by @NANDINI-star in #12317
• Segregate MCP tools on connections using headers by @jugaldb in #12296
• [Bug Fix] /generateContent API - Only pass supported params when using OpenAI models by @ishaan-jaff in #12297
• Fix: Fix custom ca bundle support in aiohttp transport by @JoostvDoorn in #12281
• [Feat] Add github co-pilot as a new LLM API provider by @ishaan-jaff in #12325
• Fix SSL certificate error by @jugaldb in #12327
• Feat - add new banner on startup by @ishaan-jaff in #12328
• [Security Bug Fix] Ensure only LLM API route fails get logged on Langfuse (and other loggers) by @ishaan-jaff in #12308
• Ensure message redaction works for responses API logging by @jugaldb in #12291
• [Feat] UI - Allow Viewing/Editing Team Based Callbacks by @ishaan-jaff in #12329
• [Feat] QA - Arize Team based logging by @ishaan-jaff in #12331
• [Feat] UI - Allow setting Logging Callback Setting per Key by @ishaan-jaff in #12333

New Contributors

• @JoostvDoorn made their first contribution in #12281

Full Changelog: v1.73.7-nightly...v1.74.0-nightly

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.74.0-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.74.0-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results