github vllm-project/vllm v0.1.2
vLLM v0.1.2

latest releases: v0.6.3.post1, v0.6.3, v0.6.2...
16 months ago

What's Changed

  • Initial support for GPTBigCode
  • Support for MPT and BLOOM
  • Custom tokenizer
  • ChatCompletion endpoint in OpenAI demo server
  • Code format
  • Various bug fixes and improvements
  • Documentation improvement

Contributors

Thanks to the following amazing people who contributed to this release:

@michaelfeil @WoosukKwon @metacryptom @merrymercy @BasicCoder @zhuohan123 @twaka @comaniac @neubig @JRC1995 @LiuXiaoxuanPKU @bm777 @Michaelvll @gesanqiu @ironpinguin @coolcloudcol @akxxsb

Full Changelog: v0.1.1...v0.1.2

Don't miss a new vllm release

NewReleases is sending notifications on new releases.