BerriAI/litellm v1.65.2.dev1

on GitHub

What's Changed

• Openrouter streaming fixes + Anthropic 'file' message support by @krrishdholakia in #9667
• fix(cost_calculator.py): allows checking received + sent model name w… by @krrishdholakia in #9669
• Revert "Revert "Correct Databricks llama3.3-70b endpoint and add databricks c…" by @krrishdholakia in #9676
• Update model_prices_and_context_window.json add gemini-2.5-pro-exp-03-25 by @superpoussin22 in #9650
• fix(proxy_server.py): Fix "Circular reference detected" error when max_parallel_requests = 0 by @krrishdholakia in #9671
• UI (new_usage.tsx): Report 'total_tokens' + report success/failure calls by @krrishdholakia in #9675
• [Reliability] - Ensure new Redis + DB architecture tracks spend accurately by @ishaan-jaff in #9673
• [Bug fix] - Service accounts - only apply service_account_settings.enforced_params on service accounts by @ishaan-jaff in #9683
• UI - New Usage Tab fixes by @krrishdholakia in #9696
• [Reliability Fixes] - Ensure no deadlocks occur when updating DailyUserSpendTransaction by @ishaan-jaff in #9690
• Virtual key based policies in Aim Guardrails by @hxtomer in #9499
• fix(streaming_handler.py): fix completion start time tracking + Anthropic 'reasoning_effort' param mapping by @krrishdholakia in #9688

Full Changelog: v1.65.1-nightly...v1.65.2.dev1

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.65.2.dev1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results