vllm 0.1.6

v0.1.6

on Python PyPI

Note: This is an emergency release to revert a breaking API change that can make many existing codes using AsyncLLMServer not work.

What's Changed

• faster startup of vLLM by @ri938 in #982
• Start background task in AsyncLLMEngine.generate by @Yard1 in #988
• Bump up the version to v0.1.6 by @zhuohan123 in #989

New Contributors

• @ri938 made their first contribution in #982

Full Changelog: v0.1.5...v0.1.6