BerriAI/litellm v1.72.1-nightly

on GitHub

What's Changed

• [Feat]: Performance add DD profiler to monitor python profile of LiteLLM CPU% by @ishaan-jaff in #11375
• [Fix]: Performance - Don't run auth on /health/liveliness by @ishaan-jaff in #11378
• [Bug Fix] Create/Update team member api 500 errror by @hagan in #10479
• add gemini-embeddings-001 model prices and context window by @marty-sullivan in #11332
• [Performance]: Add debugging endpoint to track active /asyncio-tasks by @ishaan-jaff in #11382
• Add Claude 4 Sonnet & Opus, DeepSeek R1, and fix Llama Vision model pricing configurations by @colesmcintosh in #11339
• [Feat] Performance - Don't create 1 task for every hanging request alert by @ishaan-jaff in #11385
• UI / SSO - Update proxy admin id role in DB + Handle SSO redirects with custom root path by @krrishdholakia in #11384
• Anthropic - pass file url's as Document content type + Gemini - cache token tracking on streaming calls by @krrishdholakia in #11387
• Anthropic - Token tracking for Passthrough Batch API calls by @krrishdholakia in #11388

New Contributors

• @hagan made their first contribution in #10479

Full Changelog: v1.72.1.dev1...v1.72.1-nightly

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.72.1-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.72.1-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.72.1-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results