What's Changed
- fix(utils.py): initial commit for aws secret manager support by @krrishdholakia in #2556
- Add functions and tools to input for langfuse by @webkonstantin in #2460
- Admin UI - view team based spend by @ishaan-jaff in #2560
New Contributors
- @webkonstantin made their first contribution in #2460
Full Changelog: v1.31.17...v1.32.1
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 100.0 | 107.18687626744044 | 1.4363402664466636 | 0.0 | 430 | 0 | 94.8806760000025 | 798.0420060000029 |
| /health/liveliness | Passed ✅ | 78 | 79.6030075775465 | 15.442328027402151 | 0.0 | 4623 | 0 | 73.78508599998668 | 1082.178856999974 |
| /health/readiness | Passed ✅ | 78 | 80.91262149559073 | 15.151719647911781 | 0.0033403262010387523 | 4536 | 1 | 73.9213740000082 | 1344.059859999959 |
| Aggregated | Passed ✅ | 78 | 81.45945478464874 | 32.030387941760594 | 0.0033403262010387523 | 9589 | 1 | 73.78508599998668 | 1344.059859999959 |