What's new in 0.5.1 (2023-09-26)
These are the changes in inference v0.5.1.
Enhancements
- ENH: Safe iterate stream of ggml model by @codingl2k1 in #449
- ENH: Skip download if model exists by @aresnow1 in #495
Documentation
- DOC: vLLM by @UranusSeven in #491
Full Changelog: v0.5.0...v0.5.1