BerriAI/litellm v1.55.4

on GitHub

What's Changed

• (feat) Add Azure Blob Storage Logging Integration by @ishaan-jaff in #7265
• (feat) Add Bedrock knowledge base pass through endpoints by @ishaan-jaff in #7267
• docs(input.md): document 'extra_headers' param support by @krrishdholakia in #7268
• fix(utils.py): fix openai-like api response format parsing by @krrishdholakia in #7273
• LITELLM: Remove requests library usage by @krrishdholakia in #7235
• Litellm dev 12 17 2024 p2 by @krrishdholakia in #7277
• Litellm dev 12 17 2024 p3 by @krrishdholakia in #7279
• LiteLLM Minor Fixes & Improvements (12/16/2024) - p1 by @krrishdholakia in #7263
• Add Azure Llama 3.3 by @emerzon in #7283
• (feat) proxy Azure Blob Storage - Add support for AZURE_STORAGE_ACCOUNT_KEY Auth by @ishaan-jaff in #7280
• Correct max_tokens on Model DB by @emerzon in #7284
• (fix) unable to pass input_type parameter to Voyage AI embedding mode by @ishaan-jaff in #7276

Full Changelog: v1.55.3...v1.55.4

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.55.4

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.55.4

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results