github xorbitsai/inference v0.14.3

latest releases: v0.16.3, v0.16.2, v0.16.1...
2 months ago

What's new in 0.14.3 (2024-08-25)

These are the changes in inference v0.14.3.

New features

  • FEAT: ChatTTS speech voice support encoded speaker str by @codingl2k1 in #2096
  • FEAT: [UI] Add other parameters to other models besides the LLM model. by @yiboyasss in #2129
  • FEAT: support SD3-medium inpainting by @qinxuye in #2137
  • feat: 🎸 Added the model dtype parameter for embedding (currently only supported for models gte-Qwen2). by @Zzzz1111 in #2120
  • FEAT: Support fish speech model by @codingl2k1 in #2119
  • FEAT: support CogVLM2-video by @Minamiyama in #2110
  • FEAT: Support LMDeploy for internvl2 and fix finish reasion miss at internvl stream by @amumu96 in #2145

Enhancements

  • ENH: make internvl2 support video by @Minamiyama in #2104
  • ENH: support process_image with padding for image_to_image by @qinxuye in #2109
  • REF: use utils._decode_image replacing same codes in individual vl files by @Minamiyama in #2105

Bug fixes

Documentation

Others

New Contributors

Full Changelog: v0.14.2...v0.14.3

Don't miss a new inference release

NewReleases is sending notifications on new releases.