What's Changed
- ui - setup sso on admin ui 👩🚀 by @ishaan-jaff in #2934
- [UI] Fix SSO Error - user not allowed to access info by @ishaan-jaff in #2939
- Fix - Embedding Caching - allow base 64 embedding cache hits by @ishaan-jaff in #2943
- Feature: add gemini-1.0-pro-001 and gemini-1.0-pro-002 to models list by @Manouchehri in #2940
- fix - return stack trace on failing /health checks - first 1000 chars by @ishaan-jaff in #2923
- fix - /config/update setting env variables by @ishaan-jaff in #2946
- Router Async Improvements by @krrishdholakia in #2942
- [FIX] - Security issue Server-Side Template Injection in /completions endpoint in by @ishaan-jaff in #2941
Full Changelog: 1.34.40.dev1...v1.34.42
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 41 | 45.62665910765985 | 1.6134726654854352 | 0.0 | 483 | 0 | 35.47842400001855 | 1423.002457999985 |
| /health/liveliness | Passed ✅ | 25 | 27.266815498923485 | 15.506708308868303 | 0.0 | 4642 | 0 | 23.460693000004085 | 1011.4049249999653 |
| /health/readiness | Passed ✅ | 25 | 28.117354577288825 | 15.797333820042699 | 0.0 | 4729 | 0 | 23.34315000001652 | 1129.9532500000282 |
| Aggregated | Passed ✅ | 25 | 28.574914115181734 | 32.91751479439644 | 0.0 | 9854 | 0 | 23.34315000001652 | 1423.002457999985 |