BerriAI/litellm v1.74.5.dev1

on GitHub

What's Changed

• [Feat] New Vector Store - PG Vector by @ishaan-jaff in #12667
• [Liveness/Liveliness probe] add separate health app for liveness probes in files by @jugaldb in #12669
• Add Claude Code LiteLLM tutorial by @colesmcintosh in #12650
• Fix incorrect environment variable names in Claude code docs by @colesmcintosh in #12686
• [Feat] Bedrock Guardrails - Allow disabling exception on 'BLOCKED' action by @ishaan-jaff in #12693
• [Feat] Proxy - New LLM API Routes /v1/vector_stores and /v1/vector_stores/vs_abc123/search by @ishaan-jaff in #12699
• [Refactor] Use Existing config structure for bedrock vector stores by @ishaan-jaff in #12672
• [Bug Fix] Always include tool calls in output of trim_messages by @rgambee in #11517
• [Refactor] Vector Stores - Use class VectorStorePreCallHook for all Vector Store Integrations by @ishaan-jaff in #12715
• [MCP Gateway] added docs for mcp namespacing by URL by @jugaldb in #12700
• [MCP Gateway] add fix to update object permission on update/delete key/team by @jugaldb in #12701
• MCP Gateway Change name for all servers to all available servers for Internal Users by @jugaldb in #12702
• Litellm encrypt admin UI values - ensures SSO keys work on UI by @krrishdholakia in #12675

New Contributors

• @rgambee made their first contribution in #11517

Full Changelog: v1.74.4-nightly...v1.74.5.dev1

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.74.5.dev1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results