github xorbitsai/inference v0.13.2

latest releases: v0.16.3, v0.16.2, v0.16.1...
3 months ago

What's new in 0.13.2 (2024-07-19)

These are the changes in inference v0.13.2.

New features

Enhancements

Bug fixes

  • BUG: Fix stream unicode issue for chinese characters when using vllm backend by @ChengjieLi28 in #1865
  • BUG: sglang stream error while stream_option not set by @wxiwnd in #1901
  • BUG: fix client import by @amumu96 in #1905

Full Changelog: v0.13.1...v0.13.2

Don't miss a new inference release

NewReleases is sending notifications on new releases.