What's Changed
- feat(openmeter.py): add support for user billing by @krrishdholakia in #3389
- [chore] Improve type-safety in Message & Delta classes by @elisalimli in #3379
- docs: add .github/pull_request_template.md by @nobu007 in #3349
- Update contributing instructions in README.md by @DomMartin27 in #3217
- build(deps): bump @hono/node-server from 1.9.0 to 1.10.1 in /litellm-js/spend-logs by @dependabot in #3169
- build(deps): bump idna from 3.6 to 3.7 by @dependabot in #2967
- Fix Greenscale Documentation by @greenscale-nandesh in #3278
- [Fix] bug where langfuse was reinitialized on every call by @ishaan-jaff in #3392
New Contributors
- @nobu007 made their first contribution in #3349
- @DomMartin27 made their first contribution in #3217
Full Changelog: v1.35.35...v1.35.35.dev1
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 82 | 87.7852207272744 | 1.5800051833320798 | 0.0 | 473 | 0 | 75.94807399999581 | 982.152463000034 |
| /health/liveliness | Passed ✅ | 66 | 68.29673453535338 | 15.212142927894908 | 0.0 | 4554 | 0 | 63.44337299998415 | 1519.900495999991 |
| /health/readiness | Passed ✅ | 66 | 68.07394291904264 | 15.349098979727076 | 0.0 | 4595 | 0 | 63.444413000013355 | 1027.792063999982 |
| Aggregated | Passed ✅ | 66 | 69.14835857316545 | 32.14124709095406 | 0.0 | 9622 | 0 | 63.44337299998415 | 1519.900495999991 |