What's Changed
- [UI] QA Improvements to adding callbacks, models by @ishaan-jaff in #2912
Full Changelog: v1.34.37...v1.34.37.dev1
Load Test LiteLLM Proxy Results
Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
---|---|---|---|---|---|---|---|---|---|
/chat/completions | Passed ✅ | 77 | 80.51407646458344 | 1.603350507385046 | 0.0 | 480 | 0 | 71.92962899995337 | 539.6768960000031 |
/health/liveliness | Passed ✅ | 62 | 64.73594564058693 | 15.241850760829095 | 0.0066806271141043585 | 4563 | 2 | 59.78436700002021 | 1552.9094980000195 |
/health/readiness | Passed ✅ | 62 | 63.946665819295596 | 15.268573269285511 | 0.0033403135570521793 | 4571 | 1 | 59.93750400000408 | 1245.6787830000167 |
Aggregated | Passed ✅ | 62 | 65.14843833170362 | 32.11377453749965 | 0.010020940671156537 | 9614 | 3 | 59.78436700002021 | 1552.9094980000195 |