What's Changed
- fix - use copy.deepcopy on /model/info endpoints by @ishaan-jaff in #2997
Full Changelog: v1.35.2.dev4...v1.35.3
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 81 | 86.15952575669651 | 1.4964555491804343 | 0.0 | 448 | 0 | 75.1446659999715 | 912.2716670000273 |
| /health/liveliness | Passed ✅ | 66 | 69.61895297303029 | 15.729484779220236 | 0.0 | 4709 | 0 | 63.55963599997949 | 1172.4433609999778 |
| /health/readiness | Passed ✅ | 66 | 69.02371470551194 | 15.392114220141611 | 0.0 | 4608 | 0 | 63.66152200001807 | 1251.2778020000042 |
| Aggregated | Passed ✅ | 66 | 70.0969169945723 | 32.61805454854228 | 0.0 | 9765 | 0 | 63.55963599997949 | 1251.2778020000042 |