BerriAI/litellm v1.59.8-dev1

on GitHub

What's Changed

• Fix custom pricing - separate provider info from model info by @krrishdholakia in #7990
• Litellm dev 01 25 2025 p4 by @krrishdholakia in #8006
• (UI) - Adding new models enhancement - show provider logo by @ishaan-jaff in #8033
• (UI enhancement) - allow onboarding wildcard models on UI by @ishaan-jaff in #8034
• add openrouter/deepseek/deepseek-r1 by @paul-gauthier in #8038
• (UI) - allow assigning wildcard models to a team / key by @ishaan-jaff in #8041
• Add smolagents by @aymeric-roucher in #8026
• (UI) fixes to add model flow by @ishaan-jaff in #8043
• github - run stale issue/pr bot by @ishaan-jaff in #8045
• (doc) Add nvidia as provider by @raspawar in #8023
• feat(handle_jwt.py): initial commit adding custom RBAC support on jwt… by @krrishdholakia in #8037
• fix(utils.py): handle failed hf tokenizer request during calls by @krrishdholakia in #8032

New Contributors

• @aymeric-roucher made their first contribution in #8026
• @raspawar made their first contribution in #8023

Full Changelog: v1.59.8...v1.59.8-dev1

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.59.8-dev1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results