github xorbitsai/inference v0.1.2

latest releases: v0.16.3, v0.16.2, v0.16.1...
15 months ago

What's new in 0.1.2 (2023-08-04)

These are the changes in inference v0.1.2.

New features

Enhancements

  • ENH: select q4_0 as default quantization method for ggmlv3 model in benchmark by @pangyoki in #293
  • ENH: disable gradio telemetry by @UranusSeven in #299

Bug fixes

Others

Full Changelog: v0.1.1...v0.1.2

Don't miss a new inference release

NewReleases is sending notifications on new releases.