What's Changed
- Add nccl package and Bump vLLM to 0.4.3 for huggingface runtime by @sivanantha321 (#3723)
- Propagate trust_remote_code flag throughout vLLM startup by @calwoo (#3729)
- Use add_generation_prompt while creating chat template by @Datta0 (#3775)
- Fix logprobs for vLLM by @sivanantha321 (#3738)
- Install packages needed for vllm model load by @gavrissh (#3802)
- Publish 0.13.1 Release by @johnugeorge in #3824
Full Changelog: v0.13.0...v0.13.1