BerriAI/litellm v1.61.7

on GitHub

What's Changed

• docs(perplexity.md): removing return_citations documentation by @miraclebakelaser in #8527
• (docs - cookbook) litellm proxy x langfuse by @ishaan-jaff in #8541
• UI Fixes and Improvements (02/14/2025) p1 by @krrishdholakia in #8546
• (Feat) - Add /bedrock/meta.llama3-3-70b-instruct-v1:0 tool calling support + cost tracking + base llm unit test for tool calling by @ishaan-jaff in #8545
• fix(general_settings.tsx): filter out empty dictionaries post fallbac… by @krrishdholakia in #8550
• (perf) Fix memory leak on /completions route by @ishaan-jaff in #8551
• Org Flow Improvements by @krrishdholakia in #8549
• feat(openai/o_series_transformation.py): support native streaming for o1 by @krrishdholakia in #8552
• fix(team_endpoints.py): fix team info check to handle team keys by @krrishdholakia in #8529
• build: ui build update by @krrishdholakia in #8553
• Optimize Alpine Dockerfile by removing redundant apk commands by @PeterDaveHello in #5016
• fix(main.py): fix key leak error when unknown provider given by @krrishdholakia in #8556
• (Feat) - return x-litellm-attempted-fallbacks in responses from litellm proxy by @ishaan-jaff in #8558
• Add remaining org CRUD endpoints + support deleting orgs on UI by @krrishdholakia in #8561
• Enable update/delete org members on UI by @krrishdholakia in #8560
• (Bug Fix) - Add Regenerate Key on Virtual Keys Tab by @ishaan-jaff in #8567
• (Bug Fix + Better Observability) - BudgetResetJob: for reseting key, team, user budgets by @ishaan-jaff in #8562
• (Patch/bug fix) - UI, filter out litellm ui session tokens on Virtual Keys Page by @ishaan-jaff in #8568
• refactor(teams.tsx): refactor to display all teams, across all orgs by @krrishdholakia in #8565
• docs: update README.md API key and model example typos by @colesmcintosh in #8590
• Fix typo in main readme by @scosman in #8574
• (UI) Allow adding models for a Team by @ishaan-jaff in #8598
• feat(ui): alert when adding model without STORE_MODEL_IN_DB by @Aditya8840 in #8591
• Revert "(UI) Allow adding models for a Team" by @ishaan-jaff in #8600
• Litellm stable UI 02 17 2025 p1 by @krrishdholakia in #8599

New Contributors

• @PeterDaveHello made their first contribution in #5016
• @colesmcintosh made their first contribution in #8590
• @scosman made their first contribution in #8574
• @Aditya8840 made their first contribution in #8591

Full Changelog: v1.61.3...v1.61.7

## Docker Run LiteLLM Proxy

```
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.61.7

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

## Docker Run LiteLLM Proxy

```
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.61.7

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results