What's Changed
- UI - fix - adding azure OpenAI on admin ui by @ishaan-jaff in #3004
- [test] - Test /health endpoints by @ishaan-jaff in #3003
- [Fix] Load proxy models when proxy starts up by @ishaan-jaff in #3005
- UI - edit Langfuse vars on ui by @ishaan-jaff in #3006
- [UI] Show Errors for 20s by @ishaan-jaff in #3008
- UI - test langfuse callbacks on Admin UI by @ishaan-jaff in #3007
- [UI] QA fixes adding langfuse callback by @ishaan-jaff in #3010
- [UI] Add / Test Slack Alerting by @ishaan-jaff in #3011
- Admin UI -run /health check through admin ui by @ishaan-jaff in #3014
- Litellm prometheus service metrics by @krrishdholakia in #3017
Full Changelog: v1.35.4...1.35.5.dev2
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 80 | 85.68544724824264 | 1.4263860259563899 | 0.0 | 427 | 0 | 75.07200899999589 | 949.8076319999882 |
| /health/liveliness | Passed ✅ | 65 | 68.0963399051023 | 15.38292189585287 | 0.0 | 4605 | 0 | 63.464997000096446 | 851.2580190000563 |
| /health/readiness | Passed ✅ | 65 | 68.89657557841379 | 15.506519748219116 | 0.0 | 4642 | 0 | 63.50266200001897 | 1345.5118699999957 |
| Aggregated | Passed ✅ | 65 | 69.25669165526033 | 32.315827670028376 | 0.0 | 9674 | 0 | 63.464997000096446 | 1345.5118699999957 |