What's Changed
- Athina docs updated with information about additional fields and a minor fix in the callback by @vivek-athina in #2659
Full Changelog: v1.33.7...v1.33.8
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 78 | 83.18319155529923 | 1.4500632067856818 | 0.0 | 434 | 0 | 75.45461099999784 | 865.6005609999511 |
| /health/liveliness | Passed ✅ | 65 | 68.45390179128916 | 15.112064249519905 | 0.0 | 4523 | 0 | 63.496340999961376 | 1392.5121589999776 |
| /health/readiness | Passed ✅ | 65 | 67.99550030012846 | 15.529709182349883 | 0.0 | 4648 | 0 | 63.460964000000786 | 1175.6870899999967 |
| Aggregated | Passed ✅ | 65 | 68.89761461030682 | 32.09183663865547 | 0.0 | 9605 | 0 | 63.460964000000786 | 1392.5121589999776 |