What's Changed
- UI Bug fix - Unable to generate keys / start UI by @ishaan-jaff in #2816
- 🐞 fix: djl vllm support by @YiShiYiYuan in #2711
New Contributors
- @YiShiYiYuan made their first contribution in #2711
Full Changelog: v1.34.22...v1.34.21-stable
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 91 | 102.5918621880962 | 1.4029417350715316 | 0.0 | 420 | 0 | 85.96236899998644 | 1014.7036280000066 |
| /health/liveliness | Passed ✅ | 75 | 78.02074284171394 | 15.278703562421871 | 0.0 | 4574 | 0 | 73.55678400000443 | 1169.6191089999957 |
| /health/readiness | Passed ✅ | 75 | 78.85698015806669 | 15.342169974246534 | 0.0 | 4593 | 0 | 73.44218299999739 | 1358.9573880000216 |
| Aggregated | Passed ✅ | 75 | 79.49781680849058 | 32.023815271739934 | 0.0 | 9587 | 0 | 73.44218299999739 | 1358.9573880000216 |