BerriAI/litellm v1.64.1.dev1

on GitHub

What's Changed

• Nova Canvas complete image generation tasks (#9177) by @krrishdholakia in #9525
• [Feature]: Support for Fine-Tuned Vertex AI LLMs by @ishaan-jaff in #9542
• feat(prisma-migrations): add baseline db migration file by @krrishdholakia in #9565
• Add Daily User Spend Aggregate view - allows UI Usage tab to work > 1m rows by @krrishdholakia in #9538
• Support Gemini audio token cost tracking + fix openai audio input token cost tracking by @krrishdholakia in #9535
• [Reliability Fixes] - Gracefully handle exceptions when DB is having an outage by @ishaan-jaff in #9533
• [Reliability Fix] - Allow Pods to startup + passing /health/readiness when allow_requests_on_db_unavailable: True and DB is down by @ishaan-jaff in #9569
• Add OpenAI gpt-4o-transcribe support by @krrishdholakia in #9517
• Allow viewing keyinfo on request logs by @krrishdholakia in #9568
• Allow team admins to add/update/delete models on UI + show api base and model id on request logs by @krrishdholakia in #9572

Full Changelog: v1.64.1-nightly...v1.64.1.dev1

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.64.1.dev1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.64.1.dev1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.64.1.dev1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results