What's Changed
🚨 Breaking Change v1.1.0 -> This version is only compatible with OpenAI python 1.1.0
Migration Guide: https://docs.litellm.ai/docs/migration
Key changes in v1.1.0
- Requires
openai>=1.0.0 openai.InvalidRequestError→openai.BadRequestErroropenai.ServiceUnavailableError→openai.APIStatusError- NEW litellm client, allow users to pass api_key
litellm.Litellm(api_key="sk-123")
- response objects now inherit from
BaseModel(prev.OpenAIObject) - NEW default exception -
APIConnectionError(prev.APIError) - litellm.get_max_tokens() now returns an int not a dict
max_tokens = litellm.get_max_tokens("gpt-3.5-turbo") # returns an int not a dict assert max_tokens==4097
Other updates
- Update function calling docs by @kevinjyee in #673
- Fix data being overwritten by @mc-marcocheng in #679
- Updating the docker image builder for GitHub Action by @coconut49 in #678
- fix: bugs in traceloop integration by @nirga in #647
- Router aembedding by @mc-marcocheng in #691
- support release and debug params for langfuse client by @SlapDrone in #695
- docs error ==> openai.error instead of openai.errors by @josearangos in #700
- refactor Contributing to documentation steps by @josearangos in #713
- Fix Router.set_model_list & Avoid overwriting litellm_params by @mc-marcocheng in #706
- Update Together AI pricing by @dedeswim in #724
- Update README.md by @chinmay7016 in #727
- Router.get_available_deployment: Handle empty input edge case by @mc-marcocheng in #729
- Fix caching for Router by @karvetskiy in #722
- support for custom bedrock runtime endpoint by @canada4663 in #717
- Use supplied headers by @stanfea in #741
- Docker Hub image is built for ARM64 only by @morgendigital in #734
- doc name chagne by @kylehh in #764
- fix: fix bug for the case --model is not specified by @clalanliu in #781
- add custom open ai models to asyncio call by @PrathamSoni in #789
- Fix bad returns in get_available_deployment by @nathankim7 in #790
- Improve message trimming by @duc-phamh in #787
- build(deps): bump postcss from 8.4.27 to 8.4.31 in /docs/my-website by @dependabot in #804
- build(deps): bump urllib3 from 2.0.5 to 2.0.7 by @dependabot in #805
- build(deps): bump @babel/traverse from 7.22.10 to 7.23.3 in /docs/my-website by @dependabot in #806
- Fix ServiceUnavailableError super.init error by @jackmpcollins in #813
- Update Together prices by @dedeswim in #814
- need to re-attempt backoff and yaml imports if the first import attempt fails by @kfsone in #820
- Fix typo for initial_prompt_value and too many values to unpack error by @rodneyxr in #826
- Bedrock llama by @dchristian3188 in #811
- build(deps): bump sharp from 0.32.5 to 0.32.6 in /docs/my-website by @dependabot in #832
New Contributors
- @kevinjyee made their first contribution in #673
- @mc-marcocheng made their first contribution in #679
- @SlapDrone made their first contribution in #695
- @josearangos made their first contribution in #700
- @dedeswim made their first contribution in #724
- @chinmay7016 made their first contribution in #727
- @karvetskiy made their first contribution in #722
- @stanfea made their first contribution in #741
- @morgendigital made their first contribution in #734
- @clalanliu made their first contribution in #781
- @PrathamSoni made their first contribution in #789
- @nathankim7 made their first contribution in #790
- @duc-phamh made their first contribution in #787
- @dependabot made their first contribution in #804
- @jackmpcollins made their first contribution in #813
- @kfsone made their first contribution in #820
- @rodneyxr made their first contribution in #826
- @dchristian3188 made their first contribution in #811
Full Changelog: v0.11.1...v1.1.0