BerriAI/litellm v1.40.16

on GitHub

Codestral API : https://docs.litellm.ai/docs/providers/codestral

What's Changed

• Langfuse Integration ignore Embedding Output by @hburrichter in #4226
• [Refactor Proxy] - refactor proxy place internal user, customer endpoints in separate file by @ishaan-jaff in #4223
• Add Gemini context window pricing by @krrishdholakia in #4243
• Update utils.py (fix dangerous code) by @CodeVigilanteOfficial in #4228
• fix: lunary callback tags by @hughcrt in #4141
• build(deps): bump urllib3 from 2.2.1 to 2.2.2 by @dependabot in #4251
• build(deps): bump ws from 7.5.9 to 7.5.10 in /docs/my-website by @dependabot in #4252
• VertexAI/Gemini: Calculate cost based on context window by @krrishdholakia in #4245
• [Feat] Add Codestral FIM API by @ishaan-jaff in #4247
• [Feat] - Add Codestral Chat API by @ishaan-jaff in #4242
• build(deps): bump sharp from 0.30.7 to 0.32.6 in /docs/my-website by @dependabot in #4253
• [SECURITY] /model/info: strip out llm credential before returning by @ushuz in #4244
• [New Feature] Add mock_tool_calls to main.py by @jacquesyvesgl in #4195
• Fix file type handling of uppercase extensions by @nick-rackauckas in #4182
• [Fix] Refactor Logfire to use LiteLLM OTEL Class by @ishaan-jaff in #4254
• feat(main.py): Gemini (Google AI Studio) - Support Function Calling, Inline images, etc. by @krrishdholakia in #4246

New Contributors

• @CodeVigilanteOfficial made their first contribution in #4228
• @hughcrt made their first contribution in #4141
• @jacquesyvesgl made their first contribution in #4195

Full Changelog: v1.40.15...v1.40.16

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.40.16

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results