What's Changed
- Delete node_modules directory by @w3bdesign in #2791
- [UI] Edit Keys by @ishaan-jaff in #2795
- [UI] Quality Improvements - show correct team based usage, add litellm favicon by @ishaan-jaff in #2797
- fix(openai.py): return logprobs for text completion calls by @krrishdholakia in #2799
- [UI] use all_models alias by @ishaan-jaff in #2801
- UI - use all-team-models as an alias by @ishaan-jaff in #2807
- (fix) Include gemini models in
model_listby @foragerr in #2806 - [feat] use
all-proxy-modelsandall-team-modelswith Admin UI by @ishaan-jaff in #2808 - [UI] QA Fix Edit Key flow - return
token_idin /key/generate respose by @ishaan-jaff in #2809
New Contributors
- @w3bdesign made their first contribution in #2791
- @foragerr made their first contribution in #2806
Full Changelog: v1.34.21...v1.34.22
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 83 | 94.11182962381028 | 1.4027733713580515 | 0.0 | 420 | 0 | 76.28952499999286 | 1063.0291819999798 |
| /health/liveliness | Passed ✅ | 66 | 69.01898528408572 | 15.236790762227216 | 0.0 | 4562 | 0 | 63.48201800000197 | 1289.3061539999735 |
| /health/readiness | Passed ✅ | 67 | 68.88402493579531 | 15.554084739082013 | 0.0 | 4657 | 0 | 63.672586999985015 | 1306.7071749999855 |
| Aggregated | Passed ✅ | 67 | 70.04715047556802 | 32.19364887266728 | 0.0 | 9639 | 0 | 63.48201800000197 | 1306.7071749999855 |