Full Changelog: v1.33.1...v1.33.2
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 44 | 51.45205149667403 | 1.5062946961373946 | 0.0 | 451 | 0 | 39.71838399996841 | 920.8826870000166 |
| /health/liveliness | Passed ✅ | 25 | 27.315770033354834 | 15.520513199446725 | 0.010019698643929455 | 4647 | 3 | 23.040685000012218 | 894.733567000003 |
| /health/readiness | Passed ✅ | 25 | 27.144077305639076 | 15.517173299898749 | 0.0 | 4646 | 0 | 23.28338799998164 | 1520.0081569999497 |
| Aggregated | Passed ✅ | 25 | 28.351051080870196 | 32.54398119548287 | 0.010019698643929455 | 9744 | 3 | 23.040685000012218 | 1520.0081569999497 |