BerriAI/litellm v1.63.6-nightly

on GitHub

What's Changed

• pricing for jamba new models by @themrzmaster in #9032
• build(deps): bump jinja2 from 3.1.4 to 3.1.6 by @dependabot in #9014
• (docs) add section for contributing to litellm by @ishaan-jaff in #9107
• build: Add Makefile for LiteLLM project with test targets by @colesmcintosh in #8948
• (Docs) - Contributing to litellm by @ishaan-jaff in #9110
• Added tags, user_feedback and model_options to additional_keys which can be sent to athina by @vivek-athina in #8845
• fix missing comma by @niinpatel in #8746
• Update model_prices_and_context_window.json by @mounta11n in #8757
• Fix triton streaming completions bug by @minwhoo in #8386
• (docs) Update vertex.md old code example by @santibreo in #7736
• (Feat) - Allow adding Text-Completion OpenAI models through UI by @ishaan-jaff in #9102
• docs(pr-template): update unit test command in checklist by @colesmcintosh in #9119
• [UI SSO Bug fix] - Correctly use PROXY_LOGOUT_URL when set by @ishaan-jaff in #9117
• Validate model_prices_and_context_window.json with a test, clarify possible mode values + ensure consistent use of mode by @utkashd in #8956
• JWT Auth Fix - [Bug]: JWT access with Groups not working when team is assigned All Proxy Models access by @ishaan-jaff in #8934

New Contributors

• @mounta11n made their first contribution in #8757
• @minwhoo made their first contribution in #8386
• @santibreo made their first contribution in #7736
• @utkashd made their first contribution in #8956

Full Changelog: v1.63.3.dev1...v1.63.6-nightly

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.63.6-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results