What's Changed
- (fix) - update user error by @ishaan-jaff in #2524
- Exclude /docs to reduce Docker image size by @Hitro147 in #2534
- feat(utils.py): add native fireworks ai support by @krrishdholakia in #2535
- (fix) Proxy - fix error message raised on passing invalid tokens by @ishaan-jaff in #2540
New Contributors
Full Changelog: v1.31.14...v1.31.15
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 51 | 56.56456498532438 | 1.5930134738840243 | 0.0 | 477 | 0 | 45.269316999991815 | 622.420634000008 |
| /health/liveliness | Passed ✅ | 25 | 27.461155180352375 | 15.536055933980043 | 0.0 | 4652 | 0 | 23.3922579999728 | 1113.6097229999962 |
| /health/readiness | Passed ✅ | 87 | 93.05384415144268 | 15.282242466442966 | 0.0 | 4576 | 0 | 82.33251799998698 | 1043.947385000024 |
| Aggregated | Passed ✅ | 52 | 59.81916354806835 | 32.41131187430703 | 0.0 | 9705 | 0 | 23.3922579999728 | 1113.6097229999962 |