github xorbitsai/inference v0.15.3

latest releases: v0.16.2, v0.16.1, v0.16.0...
one month ago

What's new in 0.15.3 (2024-09-30)

These are the changes in inference v0.15.3.

New features

Bug fixes

  • BUG: [UI] Fix 'Model Format' bug on model registration page. by @yiboyasss in #2353
  • BUG: Fix default value of max_model_len for vLLM backend. by @zjuyzj in #2385

New Contributors

Full Changelog: v0.15.2...v0.15.3

Don't miss a new inference release

NewReleases is sending notifications on new releases.