BerriAI/litellm v1.69.2-nightly

on GitHub

What's Changed

• Fixed Ollama Structured Response not working #10616 by @imdigitalashish in #10617
• fix(factory.py): Add reasoning content handling for missing assistant… by @LouisShark in #10688
• [Feat] Add tools support for Nvidia NIM by @ishaan-jaff in #10763
• [Fix]: /messages - allow using dynamic AWS params by @ishaan-jaff in #10769
• fix: pass application/json for GenericAPILogger by @ishaan-jaff in #10772
• [Docs] Using litellm with Google ADK by @ishaan-jaff in #10777
• Update Nscale model providers to point to website by @OscarSavNS in #10764
• [Fix] Allow using dynamic aws_region with /messages on Bedrock by @ishaan-jaff in #10779
• [Feat] Option to force/always use the litellm proxy (#10559) (#10633) by @ishaan-jaff in #10773
• feat: Addded EU Anthropic Inference profile for Claude 3.7 by @wagnerjt in #10767
• Add new model provider Novita AI (#7582) by @krrishdholakia in #9527
• Support Anthropic web search tool + Add more google finish reason mapping by @krrishdholakia in #10785
• Fix azure dall e 3 call with custom model name + Handle Bearer $LITELLM_API_KEY in x-litellm-api-key custom header by @krrishdholakia in #10776
• [Refactor] Move LLM Guard, Secret Detection to Enterprise Pip packagea by @ishaan-jaff in #10782

New Contributors

• @imdigitalashish made their first contribution in #10617
• @LouisShark made their first contribution in #10688
• @OscarSavNS made their first contribution in #10764

Full Changelog: v1.69.1-nightly...v1.69.2-nightly

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.69.2-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.69.2-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results