BerriAI/litellm v1.61.20.dev1

on GitHub

What's Changed

• Allow team/org filters to be searchable on the Create Key Page + Show team alias on Keys Table by @krrishdholakia in #8881
• Add created_by and updated_by fields to Keys table by @krrishdholakia in #8885
• (Proxy improvement) - Raise BadRequestError when unknown model passed in request by @ishaan-jaff in #8886
• (Improvements) use /openai/ pass through with OpenAI Ruby for Assistants API by @ishaan-jaff in #8884
• Update model path and documentation for Cerebras API call by @marscod in #8862
• docs: update sambanova docs by @jhpiedrahitao in #8875
• Update model settings data by @yurchik11 in #8871
• (security fix) - Enforce model access restrictions on Azure OpenAI route by @krrishdholakia in #8888
• Show 'user_email' on key table on UI by @krrishdholakia in #8887
• fix: ollama chat async stream error propagation by @Tomas2D in #8870

New Contributors

• @marscod made their first contribution in #8862
• @jhpiedrahitao made their first contribution in #8875
• @Tomas2D made their first contribution in #8870

Full Changelog: v1.61.20.rc...v1.61.20.dev1

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.61.20.dev1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results