Control your companies LLM spend with budgets, call 100+ LLMs
What's Changed
- [FEAT] Track spend per model (for Key, User and Team) by @ishaan-jaff in #2022
- Add safety_settings parameter to gemini generate_content calls by @afbarbaro in #2013
- [FIX] Spend Tracking bug for Keys made on Admin UI (when role = proxy_admin) by @ishaan-jaff in #2047
- feat(presidio_pii_masking.py): allow request level controls for turning on/off pii masking by @krrishdholakia in #2037
- [FEAT] UI- reload key spend info by @ishaan-jaff in https://github.com/BerriAI/lite
llm/pull/2048 - [FEAT] Budgets per Model (for a key) by @ishaan-jaff in #2029
New Contributors
- @afbarbaro made their first contribution in #2013
Full Changelog: v1.25.1...v1.25.2