github BerriAI/litellm pr-litellm-spend-logs-db

latest releases: v1.46.5, v1.46.4, v1.46.2...
5 months ago

What's Changed

Full Changelog: v1.34.8...pr-litellm-spend-logs-db

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Failed ❌ 1800.0 1751.7575420724997 1.335942383458703 1.335942383458703 400 400 439.62278799995147 4451.947691999976
/health/liveliness Passed ✅ 77 80.13010847316541 14.935835847068299 0.0 4472 0 73.72404599999527 1496.24484200001
/health/readiness Passed ✅ 77 79.17682240710946 14.939175703026946 0.0 4473 0 73.97242600006848 1457.6939319999838
Aggregated Passed ✅ 77 151.22555254660296 31.210953933553945 1.335942383458703 9345 400 73.72404599999527 4451.947691999976

Don't miss a new litellm release

NewReleases is sending notifications on new releases.