What's Changed
- (feat) add groq/gemma-7b-it by @snekkenull in #2529
New Contributors
- @snekkenull made their first contribution in #2529
Full Changelog: v1.31.13...v1.31.14
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 88 | 97.8719389956135 | 1.5238205426081837 | 0.0 | 456 | 0 | 80.47983800003067 | 1042.1901939999998 |
| /health/liveliness | Passed ✅ | 62 | 64.17129267745518 | 15.178054615189408 | 0.0 | 4542 | 0 | 59.447291000026325 | 1284.6712140000136 |
| /health/readiness | Passed ✅ | 180.0 | 180.3285143601241 | 14.967526777065908 | 0.0 | 4479 | 0 | 123.18138000000545 | 1374.4275610000045 |
| Aggregated | Passed ✅ | 90 | 120.690833738736 | 31.6694019348635 | 0.0 | 9477 | 0 | 59.447291000026325 | 1374.4275610000045 |