pypi litellm 1.61.7
v1.61.7

latest releases: 1.83.13, 1.83.12, 1.83.11...
14 months ago

What's Changed

  • docs(perplexity.md): removing return_citations documentation by @miraclebakelaser in #8527
  • (docs - cookbook) litellm proxy x langfuse by @ishaan-jaff in #8541
  • UI Fixes and Improvements (02/14/2025) p1 by @krrishdholakia in #8546
  • (Feat) - Add /bedrock/meta.llama3-3-70b-instruct-v1:0 tool calling support + cost tracking + base llm unit test for tool calling by @ishaan-jaff in #8545
  • fix(general_settings.tsx): filter out empty dictionaries post fallbac… by @krrishdholakia in #8550
  • (perf) Fix memory leak on /completions route by @ishaan-jaff in #8551
  • Org Flow Improvements by @krrishdholakia in #8549
  • feat(openai/o_series_transformation.py): support native streaming for o1 by @krrishdholakia in #8552
  • fix(team_endpoints.py): fix team info check to handle team keys by @krrishdholakia in #8529
  • build: ui build update by @krrishdholakia in #8553
  • Optimize Alpine Dockerfile by removing redundant apk commands by @PeterDaveHello in #5016
  • fix(main.py): fix key leak error when unknown provider given by @krrishdholakia in #8556
  • (Feat) - return x-litellm-attempted-fallbacks in responses from litellm proxy by @ishaan-jaff in #8558
  • Add remaining org CRUD endpoints + support deleting orgs on UI by @krrishdholakia in #8561
  • Enable update/delete org members on UI by @krrishdholakia in #8560
  • (Bug Fix) - Add Regenerate Key on Virtual Keys Tab by @ishaan-jaff in #8567
  • (Bug Fix + Better Observability) - BudgetResetJob: for reseting key, team, user budgets by @ishaan-jaff in #8562
  • (Patch/bug fix) - UI, filter out litellm ui session tokens on Virtual Keys Page by @ishaan-jaff in #8568
  • refactor(teams.tsx): refactor to display all teams, across all orgs by @krrishdholakia in #8565
  • docs: update README.md API key and model example typos by @colesmcintosh in #8590
  • Fix typo in main readme by @scosman in #8574
  • (UI) Allow adding models for a Team by @ishaan-jaff in #8598
  • feat(ui): alert when adding model without STORE_MODEL_IN_DB by @Aditya8840 in #8591
  • Revert "(UI) Allow adding models for a Team" by @ishaan-jaff in #8600
  • Litellm stable UI 02 17 2025 p1 by @krrishdholakia in #8599

New Contributors

Full Changelog: v1.61.3...v1.61.7

## Docker Run LiteLLM Proxy

```
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.61.7

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

## Docker Run LiteLLM Proxy

```
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.61.7

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Failed ❌ 180.0 206.98769618433857 6.145029010811349 6.145029010811349 1839 1839 146.21495699998377 3174.8161250000067
Aggregated Failed ❌ 180.0 206.98769618433857 6.145029010811349 6.145029010811349 1839 1839 146.21495699998377 3174.8161250000067

Don't miss a new litellm release

NewReleases is sending notifications on new releases.