BerriAI/litellm v1.58.4

on GitHub

What's Changed

• build(pyproject.toml): bump uvicorn depedency requirement + Azure o1 model check fix + Vertex Anthropic headers fix by @krrishdholakia in #7773
• Add gemini/ frequency_penalty + presence_penalty support by @krrishdholakia in #7776
• feat(helm): add securityContext and pull policy values to migration job by @Hexoplon in #7652
• fix confusing save button label by @yujonglee in #7778
• [integrations/lunary] Improve Lunary documentaiton by @hughcrt in #7770
• Fix wrong URL for internal user invitation by @yujonglee in #7762
• Update instructor tutorial by @Winston-503 in #7784
• (helm) - allow specifying envVars on values.yaml + add helm lint test by @ishaan-jaff in #7789
• Fix anthropic pass-through end user tracking + add gemini-2.0-flash-thinking-exp by @krrishdholakia in #7772
• Add back in non root image fixes (#7781) by @krrishdholakia in #7795
• test: initial test to enforce all functions in user_api_key_auth.py h… by @krrishdholakia in #7797
• test: initial commit enforcing testing on all anthropic pass through … by @krrishdholakia in #7794
• build: bump certifi version - see if that fixes asyncio ssl issue on … by @krrishdholakia in #7800
• (datadog llm observability) - fixes + improvements for using datadog llm observability logging integration by @ishaan-jaff in #7824
• (fix) IBM Watsonx using ZenApiKey by @ishaan-jaff in #7821
• (Fix + Testing) - Add dd-trace-run to litellm ci/cd pipeline + fix bug caused by dd-trace patching OpenAI sdk by @ishaan-jaff in #7820
• (security fix) - remove hf model with exposed security token by @ishaan-jaff in #7810

New Contributors

• @Winston-503 made their first contribution in #7784

Full Changelog: v1.58.2...v1.58.4

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.58.4

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results