github xorbitsai/inference v0.11.3

latest releases: v1.0.0, v0.16.3, v0.16.2...
5 months ago

What's new in 0.11.3 (2024-05-31)

These are the changes in inference v0.11.3.

New features

Enhancements

Bug fixes

  • BUG: fix launch model error when use torch 2.3.0 by @amumu96 in #1543
  • BUG: fix vl-model img path error by @amumu96 in #1559
  • BUG: Fix validation errors when define a custom baichuan-chat LLM model by @buptzyf in #1557

Documentation

  • DOC: update readme and fix description about model engine by @qinxuye in #1566

Others

New Contributors

Full Changelog: v0.11.2...v0.11.3

Don't miss a new inference release

NewReleases is sending notifications on new releases.