What's Changed
- add langfuse logging by @maxdeichmann in #2685
cryptographyandpython-multipartversion bump by @RoniGurvich in #2672- (feat) Perf Improvement - stop eagerly evaluating fstring by @ishaan-jaff in #2683
- Fix pip install 'litellm[extra_proxy]' by @dragosMC91 in #2660
Full Changelog: v1.34.0...v1.34.1
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 39 | 44.70487909533914 | 1.5764456770634518 | 0.0 | 472 | 0 | 35.648874999992586 | 767.226882999978 |
| /health/liveliness | Passed ✅ | 25 | 28.792333194952395 | 15.88135422550151 | 0.0 | 4755 | 0 | 23.25843599999189 | 1419.5746369999824 |
| /health/readiness | Passed ✅ | 25 | 28.926927010092044 | 15.223388550964435 | 0.0033399272819140927 | 4558 | 1 | 23.396136000030765 | 1421.804757000018 |
| Aggregated | Passed ✅ | 25 | 29.622604045682124 | 32.681188453529394 | 0.0033399272819140927 | 9785 | 1 | 23.25843599999189 | 1421.804757000018 |