BerriAI/litellm v1.62.4-nightly

on GitHub

What's Changed

• Fix deepseek 'reasoning_content' error by @krrishdholakia in #8963
• (UI) Fix session handling with cookies by @ishaan-jaff in #8969
• (UI) - Improvements to session handling logic by @ishaan-jaff in #8970
• fix(route_llm_request.py): move to using common router, for client-side credentials by @krrishdholakia in #8966
• Litellm dev 03 01 2025 p2 by @krrishdholakia in #8944
• Support caching on reasoning content + other fixes by @krrishdholakia in #8973
• fix(common_utils.py): handle $id in response schema when calling vert… by @krrishdholakia in #8991
• (bug fix) - Fix Cache Health Check for Redis when redis_version is float by @ishaan-jaff in #8979
• (UI) - Security Improvement, move to JWT Auth for Admin UI Sessions by @ishaan-jaff in #8995
• Litellm dev 03 04 2025 p3 by @krrishdholakia in #8997
• fix(base_aws_llm.py): remove region name before sending in args by @krrishdholakia in #8998

Full Changelog: v1.62.1-nightly...v1.62.4-nightly

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.62.4-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results