BerriAI/litellm v1.35.10 on GitHub

What's Changed

add vertex_ai/text-embedding-preview-0409 by @Dev-Khant in #2999
Fix Anthropic system message handling by @ligaz in #3019
Update: gpt-4-turbo-preview pricing and context. Included in docs. by @ryanwclark1 in #2817
docs: add langfuse to callback docs by @marcklingen in #3044
test - setting up langfuse callback on proxy + assert logs written by @ishaan-jaff in #3067
[Fix + Test] - Return correct params from /user/new by @ishaan-jaff in #3066
(feat): Add Claude v3 Opus on Amazon Bedrock. by @Manouchehri in #3069
fix(proxy_server.py): ensure id used in delete deployment matches id used in litellm Router by @krrishdholakia in #3077
UI - Save / Edit router settings UI by @ishaan-jaff in #3079
[FEAT] - View router settings (backend) by @ishaan-jaff in #3076
UI - view router settings on UI by @ishaan-jaff in #3078
build(ui): view_key_table.tsx by @krrishdholakia in #3081
[Fix] Prometheus /metrics - don't log user_api_key to prometheus by @ishaan-jaff in #3084
Fix - show model, deployment and model_group in vertex exceptions by @ishaan-jaff in #3087
fix(vertex_ai.py): accept credentials as a json string by @krrishdholakia in #3082
Use max_input_token for trim_messages by @cwang in #3062

Full Changelog: v1.35.8.dev1...v1.35.10

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Request Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Passed ✅	42	49.6385708482911	1.5629026707638956	468	36.01543100000981	1183.660677999967
/health/liveliness	Passed ✅	26	29.30218259242742	15.699156955686053	4701	23.077996000040457	1128.3300599999961
/health/readiness	Passed ✅	26	28.14200395417242	15.448691784089275	4626	23.042472000042835	1140.643462000014
Aggregated	Passed ✅	26	29.725913406432227	32.710751410539224	9795	23.042472000042835	1183.660677999967