github xorbitsai/inference v0.10.3

latest releases: v1.0.0, v0.16.3, v0.16.2...
6 months ago

What's new in 0.10.3 (2024-04-24)

These are the changes in inference v0.10.3.

New features

Enhancements

Bug fixes

  • BUG: Fix Launching embedding or reranking models from commandline fails due to PEFT by @hainaweiben in #1343
  • BUG: Fix extra parameters issue when auto-recovering models by @ChengjieLi28 in #1348
  • BUG: Fix old rerank models use flag rerank issue by @codingl2k1 in #1350

Documentation

New Contributors

Full Changelog: v0.10.2.post1...v0.10.3

Don't miss a new inference release

NewReleases is sending notifications on new releases.